STM32全国研讨会：且看Python 和OpenMV如何在 STM32 MCU上运行AI 2020-09-15 07:10 预计 24 分钟读完

最新推荐文章于 2024-09-24 08:00:00 发布

yazhouren

最新推荐文章于 2024-09-24 08:00:00 发布

阅读量800

点赞数

分类专栏： IT硬件news

原文链接：https://www.eefocus.com/industrial-electronics/472914

版权

IT硬件news 专栏收录该内容

254 篇文章 6 订阅

订阅专栏

What is the state of machine learning at the edge today? What tools can help engineers collect data and run inferences? Where can you find ST MEMS, and how can they make a difference in real-world products? This piece is the second part of our series on the upcoming STM32 Roadshow. For the 14th year in a row, we are reaching out to our community. We will hold demos, show products, and have engineers ready to answer questions. The first part of our STM32 Roadshow Series focused on cloud connectivity as we talked about a new smart doorbell demo. We also featured industrial and security applications. Today, we will explore artificial intelligence and computing as well as sensing.

如今网络边缘侧的机器学习现状如何？哪些工具可以帮助工程师收集数据并执行推断运算？在哪里可以找到 ST MEMS，它们对现实生活中的产品有哪些影响？本文是我们即将举行的 STM32 全国研讨会系列的第二篇专题文章。在第 14 届 STM32 全国研讨会上，我们将通过应用演示、产品展示以及工程师与观众互动回答问题的方式，来与蝶粉社区近距离交流。在 STM32 全国研讨会专题系列报道第一部分我们着重介绍了云连接方面的用例，如一款新的智能门铃功能演示，还介绍了工业和数据安全相关应用。今天，我们将重点探讨人工智能、计算以及感知技术。

Artificial Intelligence and Computing
人工智能与计算
Qeexo 和 STM32Cube.AI
The range of solutions enabling machine learning at the edge is also increasing, and the STM32Roadshow highlights the central role of STM32 MCUs. For example, we will show a demo of Qeexo’s AutoML. It uses a SensorTile to capture vibrations and sounds to detect if a fan is broken or blocked. It is a classic example of a predictive maintenance application that can vastly transform a factory’s operation with minimal investments. Qeexo is a member of the ST Partner Program.

当今边缘机器学习解决方案的种类越来越多，本届 STM32 全国研讨会将聚焦讨论 STM32 MCU 在这类应用中的核心角色。我们将演示 Qeexo’s AutoML 工业自动化机器学习解决方案（Qeexo 是 ST 合作伙伴计划成员）。该系统使用 SensorTile 捕获振动和噪声，检测风扇是否损坏或阻塞，这是一个经典的，以最少的投资来最大化提高工厂运营效率的预测性维护应用示例。

There will also be numerous ST demos that leverage our machine learning solutions. Some of them a

re already popular, such as the STM32H747I-DISCO that uses machine learning to recognize dishes and drinks. It was a show favorite at the Technology Tour in Toronto and remains popular amongst our attendees. Our engineers will also demonstrate a system capable of reading a digital meter. This particular presentation uses an STM32WL, our first MCU, with an embedded LoRa transceiver.

全国研讨会上还有很多 ST 的机器学习应用演示，其中一些已经很有人气，例如，使用机器学习识别食品饮料的 STM32H747I-DISCO。它在 Technology Tour in Toronto（多伦多科技展）上广受关注，在本届全国研讨会参观者中也仍享有很高的人气。我们的工程师还将演示一个智能电表抄表系统，这个特别的演示使用的是 STM32WL——我们的第一款带有嵌入式 LoRa 收发器的 MCU。

Similarly, the STM32MP1 will run on a new AI demo offering multiple object detection. We rewrote the code in C to optimize it, and it will be the first time we show it in Asia. Moreover, we will showcase FP-AI-NANOEDG1, a Function Pack that allows developers to quickly test a Machine Learning library from Cartesiam on an STM32L5.

同样，STM32MP1 将出现在一个新的 AI 多物体检测演示板上。我们重写并优化了 C 语言代码，这个解决方案是首次在亚洲演示。此外，ST 还将展示一个使开发人员可以在 STM32L5 上快速测试 Cartesiam 机器学习库的 FP-AI-NANOEDG1 功能包。

OpenMV

The STM32 Roadshow will be a great place to experience the OpenMV Cam H7 Plus. The product relies on an STM32H7 microcontroller to capture videos using a five-megapixel camera module on top of the PCB. Additionally, the platform works using MicroPython to make it easier to program. It thus puts a robust system in the hands of engineers and enthusiasts wishing to experiment with embedded systems quickly. Users can even download the OpenMV IDE and run example applications that will show some of the system’s capabilities.

本届 STM32 全国研讨会将是观众体验 OpenMV Cam H7 Plus 的绝佳机会。该产品依靠 STM32H7 微控制器和 PCB 板载 500 万像素摄像模块拍摄视频。此外，该平台还可以支持 MicroPython 语言，使编程变得更轻松，它为那些希望快速测试嵌入式系统 AI 的工程师和发烧友提供了一个稳健的系统。用户甚至可以下载 OpenMV IDE 开发环境，运行系统功能演示应用程序，查看某些系统功能。

The event will also demonstrate to attendees that they can go much further than the typical demos. For instance, Edge Impulse has a tutorial showing how to write a machine learning application with the OpenMV Cam H7 Plus. The ST Partner Program member facilitates the creation of neural networks that can then run inference operations on ST’s MCUs. In this instance, developers use the OpenMV PCB and IDE to collect data. They then send it to Edge Impulse for processing. Finally, users can export a neural network as an OpenMV library. This system is also impressive because as engineers transition to an industrial setting, it is possible to use Edge Impulse to get a neural network that will work with STM32Cube.AI. This software solution converts neural networks into optimized code for STM32 to vastly facilitate machine learning at the edge.

观众还将在本届研讨会上了解到比一般 demo 演示更深层次的东西。例如，Edge Impulse（ST 合作伙伴计划成员之一）有一个如何使用 OpenMV Cam H7 Plus 编写机器学习应用程序的教程，让开发在 ST MCU 上执行推断运算的神经网络变得更容易。在这个示例中，开发人员可以使用 OpenMV PCB 和 IDE 收集数据，然后，发送到 Edge Impulse 进行数据处理，最后，可以导出神经网络的 OpenMV 库。该系统令人印象深刻。随着工程师开始关注工业环境，使用 Edge Impulse 就可以获得一个支持 STM32Cube.AI 的神经网络。该软件解决方案将神经网络转换为可在 STM32 上运行的代码，从而极大地降低了边缘机器学习的开发难度。

Sensing and Innovation
感知与创新

SensorTile.box and the Crying Baby Detector
SensorTile.box 和宝宝哭声检测器

The SensorTile.box will be another highlight of the STM32 Roadshow. Our most powerful sensor box with multiple user modes will be at the center of a few demos. Users will be able to interact with built-in demo applications. The STEVAL-MKSBOX1V1 (the reference of the SensorTile.box) with iOS and Android applications to quickly showcase some of its capabilities. For instance, ST provides a baby crying detector. The application first uses an algorithm that employs a Fast Fourier Transform to process the signal. It then runs the data through a neural network on the host STM32. Thanks in part to STM32Cube.AI, developers can use a regular MCU to distinguish between ambient noise and a child’s cries. This demo is also highly symbolic because it exemplifies how our sensors, MCUs, and more work to create unique and wholesome solutions.

SensorTile.box 将是 STM32 全国研讨会的另一个亮点。我们最强的多用户模式传感器模组 SensorTile.box 将是几场演示活动的核心角色。用户将能够与内置的演示应用程序互动，装有 iOS 和 Android 应用程序的 STEVAL-MKSBOX1V1（Sensor-Tile.box 的型号）可快速展示模组的部分功能，例如，ST 提供的宝宝哭声检测器。该应用先是运行一个算法，采用快速傅立叶变换方法处理信号；然后，通过主控制器 STM32 上的神经网络运行数据。开发人员可以使用常规 MCU 辨别环境噪声和孩子的哭声，其中，STM32Cube.AI 功不可没。该演示还具有高度的示范意义，因为它是一个展示我们的传感器、MCU 等芯片如何协同工作，创建独特而有益的解决方案的范例。

OPPO Smartwatch and Edifier Dreampods
OPPO 智能手表和漫步者耳机

The STM32 Roadshow will also be an opportunity to check out significant design wins physically. For instance, we will showcase an OPPO smartwatch that includes our LPS27HHW barometer. The component can measure how deep a user is swimming or how high that person is climbing. The OPPO watch also includes the LSM6DSOW, which uses finite state machines to detect human activities while reducing the overall power consumption. The system can thus detect if a user is running or cycling while consuming very little to save its battery.

本届 STM32 全国研讨会的另一个看点是，观众将有机会看到几个重要的 ST 设计采纳用例。举例来说，我们将展示一个 OPPO 智能手表，这款手表内置我们的 LPS27HHW 气压计传感器，可以测量用户游泳水深或攀爬高度。OPPO 手表还集成了 LSM6DSOW 惯性测量单元，它使用有限状态机检测人类活动，同时能够降低系统总体功耗。因此，该系统可以检测用户是在跑步还是骑车，而且几乎不耗电，十分节省电池电量。

Similarly, we will also showcase the Edifier Dreampods. It is fascinating to learn how these wireless earphones use a LIS25BA to detect vibrations crawling from the inner ear to the facial bones. Such a system ensures the device can distinguish between the audio and ambient noise. The Dreampods also use the LIS2DH12 accelerometer to enable users to tap on the earphones to play or pause music and operate other controls, such as picking up a call or hanging up. Both the Dreampods and the OPPO smartwatch are available on the Chinese market.

同样，我们还将展示漫步者的 Dreampods 耳机。了解这些无线耳机如何使用 LIS25BA 检测从内耳传向面部骨骼的振动对开发者抑或耳机发烧友而言无疑是一件非常有趣的事情。该系统确保设备可以区分音频和环境噪声。 Dreampods 还集成了 LIS2DH12 加速度计，用户只要敲击耳机就可以播放或暂停音乐，还可以进行其他控制操作，例如接听电话或挂断电话。现今 Dreampods 和 OPPO 智能手表都能在中国市场买到。

Cities That Will Host the STM32 Roadshow

STM32 全国研讨会城市名单