09.05.2023 Views

pdfcoffee

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Chapter 13

Figure 9: An example of Q&A on Android with TensorFlow Lite and Bert

A note about using mobile GPUs

This section concludes the overview on pretrained models for mobile devices and

IoT. Note that modern phones are equipped with internal GPUs. For instance, on

Pixel 3, TensorFlow Lite GPU inference accelerates inference to 2–7x faster than

CPUs for many models (see Figure 10, source: https://medium.com/tensorflow/

tensorflow-lite-now-faster-with-mobile-gpus-developer-previewe15797e6dee7):

[ 473 ]

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!