机器学习 部署 嵌入式_如何在移动和嵌入式设备上部署机器学习模型

机器学习 部署 嵌入式

介绍 (Introduction)

Thanks to libraries such as Pandas, scikit-learn, and Matplotlib, it is relatively easy to start exploring datasets and make some first predictions using simple Machine Learning (ML) algorithms in Python. Although, to make these trained models useful in the real world, it is necessary to make them available to make predictions on either the Web or Portable devices.

多亏了Pandas，scikit-learn和Matplotlib等库，使用Python中的简单机器学习(ML)算法开始探索数据集并做出一些初步预测相对容易。 虽然，为了使这些训练有素的模型在现实世界中有用，有必要使它们可用于在Web或便携式设备上进行预测。

In two of my previous articles, I explained how to create and deploy a simple Machine Learning model using Heroku/Flask and Tensorflow.js. Today, I will instead explain to you how to deploy Machine Learning models on Smartphones and Embedded Devices using TensorFlow Lite.

在前两篇文章中，我解释了如何使用Heroku / Flask和Tensorflow.js创建和部署简单的机器学习模型。 今天，我将向您解释如何使用TensorFlow Lite在智能手机和嵌入式设备上部署机器学习模型。

TensorFlow Lite (TensorFlow Lite)

TensorFlow Lite is a platform developed by Google to train Machine Learning models on mobile, IoT (Interned of Things) and embedded devices.

TensorFlow Lite是Google开发的一个平台，用于在移动，IoT(物联网)和嵌入式设备上训练机器学习模型。

Using TensorFlow Lite, all the workflow is executed within the device, which avoids having to send data back and forth from a server. Some of the main advantages of doing this are:

使用TensorFlow Lite，所有工作流程都在设备内执行，从而避免了必须从服务器来回发送数据的情况。 这样做的一些主要优点是：

• Increased privacy since the data doesn't have to leave the device (this can allow you to apply techniques such as Differential Privacy and Federated Learning).

  由于数据不必离开设备，因此提高了隐私性(这可以使您应用差分隐私和联合学习之类的技术 )。

• Reduced power consumption, because no internet connection is required.
  降低了功耗，因为不需要互联网连接。
• Decreased latency, since there is no communication with the server.
  延迟减少，因为与服务器之间没有通信。

TensorFlow Lite offers API support for different languages such as Python, Java, Swift and C++.