机器学习嵌入式实现
I first came across the concept of embeddings while developing the RNN typing practice app.
在开发RNN打字练习应用程序时,我首先遇到了嵌入的概念。
Even though I am just beginning to understand the range of uses for embeddings, I thought it would be useful to write down some of the basics.
即使我才刚刚开始了解嵌入的用途范围,但我认为写下一些基本知识将很有用。
First, let’s look at what I knew before embeddings, one-hot vectors.
首先,让我们看一看在嵌入矢量之前我所知道的。
刷新一键向量 (Refresher on one-hot vectors)
Remember one-hot vectors? No? Well do you remember unit vectors from math class? Still no? Okay — assume that we have three labels, [🍎, 🍊, 🍌]. We want to represent these values in a way that machines can understand. Initially, we might be tempted to assign the values [1, 2, 3], but the issue here is we don’t necessarily want a 🍌 to equal three 🍎.
还记得一个热门向量吗? 没有? 您还记得数学课上的单位向量吗? 仍然没有? 好的-假设我们有三个标签[🍎,🍊,🍌]。 我们希望以机器可以理解的方式来表示这些值。 最初,我们可能很想分配值[1、2、3],但是这里的问题是我们不必让🍌等于3。