深度学习领域专业词汇_深度学习时代的人文领域专业知识

深度学习领域专业词汇

It’s a bit of an understatement to say that Deep Learning has recently become a hot topic. Within a decade alone, the field has made significant strides on problems once thought to be impossible, including facial recognition, generating text that mimics human writing, making art, and playing games involving strategy and intuition.

我T的有点轻描淡写地说，深学，最近成为热门话题。 仅在十年内，该领域就在人们认为不可能的问题上取得了长足的进步，包括面部识别，生成模仿人类文字的文字，制作艺术品以及玩涉及策略和直觉的游戏。

Given the buzz surrounding the (seemingly unreasonable) effectiveness of these algorithms, it’s easy to get lost in the extremes of speculation and skepticism towards Deep Learning. Instead, I’d like to focus on the following issues.

鉴于围绕这些算法的有效性(看似不合理)的嗡嗡声，很容易在对深度学习的猜测和怀疑的极端中迷失了方向。 相反，我想重点关注以下问题。

First, what is the role of human expertise in a world where Deep Learning is becoming more prevalent as a problem-solving tool? Second, where is the field of Deep Learning headed, and how can (human) expertise help move it forward?

首先，在深度学习日益成为解决问题的工具的世界中，人类专业知识的作用是什么？ 其次，深度学习领域的发展方向如何，(人类)专业知识如何帮助其向前发展？

As we will soon see, these two questions are intimately related. But first, let’s start with the basics.

我们将很快看到，这两个问题密切相关。 但是首先，让我们从基础开始。

深度学习与人类学习 (Deep vs. human learning)

To get a better scope of the picture, it helps to get a common understanding of what we mean when we refer to Deep Learning.

为了更好地了解图片，这有助于我们对深度学习的理解。

Simply put, Deep Learning refers to a broad range of algorithms, very loosely inspired by the human brain.

简而言之，深度学习涉及广泛的算法，受到人脑的启发。

These algorithms take the form of networks, known as Deep Neural Networks (DNNs), which iteratively improve as they encounter new examples. It’s important to note that the kind of learning we refer to when we talk about Deep Learning is a very narrow subset of what we as humans might consider learning.

这些算法采用称为深度神经网络(DNN)的网络形式，在遇到新示例时会不断改进。 重要的是要注意，当我们谈论深度学习时，我们所指的那种学习只是我们人类可能认为学习的一小部分。

Human learning often involves the ability to explain, generalize, and even teach concepts that we have come to understand, all of which encompass different forms and levels of learning. It turns out that a lot of the questions surrounding these variants of learning are still open problems in Deep Learning, ones where domain expertise may play a large role.

人类学习通常包含解释，概括甚至教授我们已经理解的概念的能力，所有这些概念都包含不同形式和水平的学习。 事实证明，围绕这些学习变体的许多问题仍然是深度学习中的开放问题，在这些领域中领域专业知识可能起着很大的作用。

可解释性 (Explainability)

While Deep Learning algorithms outperform other machine learning methods at a wide variety of tasks, they are often notoriously difficult to interpret. Often, these networks are so complex that it’s difficult to know how they made their decisions. Like your pesky third-grade math teacher, we want these networks to “show their work”.

虽然深度学习算法在各种各样的任务上胜过其他机器学习方法，但众所周知，它们通常难以解释。 通常，这些网络是如此复杂，以至于很难知道它们是如何做出决定的。 就像您讨厌的三年级数学老师一样，我们希望这些网络“展示他们的工作”。

This problem of understanding how and why a network arrives at its decisions is known as explainability. In machine learning literature, this term is often used in conjunction with concepts of interpretability, understandability, and trust. Explainability is important because it gives us a better reason to trust that these algorithms are doing what we want, and enables us to troubleshoot them when problems arise.

理解网络如何以及为何做出决策的问题称为可解释性。 在机器学习文献中，该术语通常与可解释性，可理解性和信任度概念结合使用。 可解释性很重要，因为它使我们有更好的理由相信这些算法可以实现我们想要的功能，并可以在出现问题时对它们进行故障排除。

It’s important to note that explainability isn’t a one-way street. In the vast majority of cases, you want to explain your decisions to someone. That’s where expertise comes in. Just as a doctor knows what information should be included in a medical report or diagram to reach a diagnosis, domain experts know what components are necessary to make sound decisions in their domains.

重要的是要注意，可解释性不是一条单向的街道。 在大多数情况下，您想向某人解释您的决定。 这就是专业知识的源泉。正如医生知道应该在医疗报告或图表中包含哪些信息以进行诊断一样，领域专家也知道在他们的领域做出正确决策所必需的组件。

These experts are not simply peripheral consultants; they are necessary players in designing and implementing good problem-solving algorithms. Experts know what information is relevant and irrelevant to making a decision, and this domain expertise is incredibly valuable in constraining the kinds of algorithms that are worth considering. At the end of the day, it will be the experts who will be able to see if a decision is made correctly, and what steps need to be taken to fix it.

这些专家不仅仅是简单的外围顾问。 他们是设计和实施好的问题解决算法的必要参与者。 专家知道哪些信息与决策有关且无关，并且该领域的专业知识在限制值得考虑的算法种类方面具有不可估量的价值。 归根结底，专家们将能够查看决策是否正确以及需要采取哪些步骤来解决该问题。

Without experts, we cannot design good algorithms, period. It’s telling that when DeepMind decided to develop AlphaGo to defeat one of the reigning world champions at the game of Go, they regularly consulted with Go experts to design their algorithm⁵. This idea is so important it’s worth repeating again: domain expertise isn’t peripheral. It’s the whole damn picture.

没有专家，我们就无法设计好的算法。 这说明DeepMind决定开发AlphaGo在Go游戏中击败一位统治的世界冠军时，他们会定期与Go专家协商以设计算法⁵。 这个想法是如此重要，值得再次重复：领域专业知识不是外围的。 这是整个该死的图片。

概括 (Generalization)

Another key aspect of learning is the ability to generalize. In the Machine Learning community, generalization refers to the ability to learn beyond just the examples you’ve already seen. Any college undergrad knows how to brute-force memorize sections of the textbook, but how well do they really know the ideas they’ve crammed into their heads the night before? The test lies in the ability to answer questions that test similar, but slightly different information to the concepts they’ve studied.

学习的另一个关键方面是泛化能力。 在机器学习社区中，泛化指的是超越您已经看到的示例的学习能力。 任何一所大学的本科生都知道如何强行记住教科书的各个部分，但是他们到底有多了解前一天晚上塞入他们脑海的想法呢？ 测试在于回答与所研究概念相似但略有不同信息的问题的能力。

It’s no different for Deep Neural Networks (incidentally, there are a lot of similarities that can be drawn between DNNs and college undergrads, particularly in terms of decision-making efficacy, but I’m writing a Medium article and not a novel so I’ll leave it at that).

深度神经网络没有什么不同(顺便说一下，DNN和大学本科生之间可以得出很多相似之处，特别是在决策效力方面，但是我写的是中级文章，而不是小说，所以我我会留在那)。

There are two main kinds of generalization: generalization within distribution, and out-of-distribution. The first refers to examples where the examples you use to test your network are similar to the ones you used to train it. If I train a network on, say, thousands of pictures of apples, it should be able to identify new apple even if it hasn’t seen that specific image before. DNNs are actually fairly good at this.

归纳主要有两种：分布内的归纳和分布外的归纳。 第一个参考示例，其中用于测试网络的示例与用于训练网络的示例相似。 如果我在数千张苹果图片上训练网络，则即使以前没有看到该特定图片，它也应该能够识别新苹果。 DNN实际上对此非常擅长。

But while DNNs require tens of thousands of examples to identify an apple, humans and other intelligent animals can learn after just a handful of examples. This is known as few-shot learning (sometimes used in relation to zero-shot or one-shot learning), referring to the ability to learn or generalize over just a few examples.

但是，尽管DNN需要数以万计的示例来识别一个苹果，但人类和其他智能动物只需几个示例就可以学习。 这被称为少拍学习(有时用于零拍或单拍学习)，指的是仅通过几个示例进行学习或概括的能力。

The second kind of generalization is out-of-distribution learning. Ever notice how your athletic friend seems to be good at not only running but also football and swimming? Or how the math whiz in your class is also great at physics and chemistry? That’s because those concepts, while distinct, are related. The ability to take one skill and apply it to another domain is known in Machine Learning circles as transfer learning.

第二种概括是分布外学习。 是否曾经注意到您的运动朋友似乎不仅擅长跑步，还擅长足球和游泳？ 或者您的班级中的数学天才在物理和化学方面也很出色？ 这是因为这些概念虽然不同，但却是相关的。 掌握一项技能并将其应用于另一领域的能力在机器学习界称为转移学习。

Like few-shot learning, the idea of transfer learning centers around the idea that it shouldn’t take thousands of examples to learn concepts, especially if you’ve already learned a similar task before. Importantly, learning a new task shouldn’t require that you unlearn the old one.

像几次学习一样，转移学习的思想围绕这样一个思想，即不应该使用成千上万的示例来学习概念，特别是如果您之前已经学习过类似的任务。 重要的是，学习一项新任务不应要求您取消旧任务。

Again, human expertise is necessary to understand how to approach the design of these algorithms as well. When you talk to experts, they often tie distinct examples together, while also describing their differences: “Playing guitar is kind of like playing piano, except…” This is exactly the kind of thing that transfer learning seeks to mimic. Seeking expert opinions is the key to understanding if transfer learning is effective across the domains it seeks to transfer to.

同样，必须有专门的人员才能理解如何进行这些算法的设计。 当您与专家交谈时，他们通常将不同的例子联系在一起，同时也描述了他们的差异：“弹吉他有点像弹钢琴，除了……”这正是转移学习试图模仿的东西。 寻求专家意见是了解转让学习是否在其试图转移到的各个领域有效的关键。

元学习 (Meta-learning)

A deep (pardon the pun) question in the Deep Learning community is how to develop algorithms not only to learn but to learn how to learn. This idea of learning how to learn is known as meta-learning, a term just as confusing as it is mysterious.

深度学习社区中一个深层的问题是如何开发算法，不仅要学习，而且要学习如何学习。 这种学习如何学习的想法被称为元学习，这个术语既神秘又令人困惑。

The key behind meta-learning is this: often what separates an expert from a simpleton is the way that they practice. The best violinists in the world practice for hours on end, but they do so smartly — that’s what makes them the best. If we can develop effective algorithms that can practice smarter, then we can make significant strides towards more-intelligent agents. It’s not hard to see where the value of expertise comes here too. Different domains require different approaches toward a variety of definitions of success. To practice well as a pianist may look very different from practicing well as a swimmer, for example.

元学习背后的关键是这样的：通常，使专家与简单者分开的是他们的实践方式。 世界上最好的小提琴家连续练习了几个小时，但他们做得很聪明-这就是使他们成为最好的小提琴家的原因。 如果我们能够开发出可以实践得更聪明的有效算法，那么我们就可以朝着更智能的代理迈进一大步。 不难看出专业知识的价值在这里也能体现出来。 不同的领域要求对成功的各种定义采取不同的方法。 例如，练好钢琴家看起来与练好运动员完全不同。

What “smart learning” looks like may vary from discipline to discipline, ultimately requiring the informed design with human experts at the lead.

“智能学习”的外观可能因学科而异，最终需要在人类专家的带领下进行明智的设计。

期待 (Looking forward)

As impressive as the accomplishments of Deep Learning are, it’s hard to imagine that any of these networks would have achieved their level of prowess without the experts that were consulted to design and structure them. Human experts, not AI agents, facilitated the curation of datasets, the design of reward functions, and the deployment of these algorithms. On top of that, it’s up to human experts to translate the outputs of these algorithms to decisions and insights in the real world. For now, humans are the agents.

尽管深度学习取得了令人印象深刻的成就，但很难想象如果没有经过咨询的专家来设计和构造这些网络，它们中的任何一个都将达到自己的水平。 人类专家而不是AI代理促进了数据集的管理，奖励功能的设计以及这些算法的部署。 最重要的是，由人类专家将这些算法的输出转换为现实世界中的决策和见解。 目前，人类是主体。

In the future, as Deep Learning becomes more prevalent in industry applications, people outside the field will be faced with adapting their roles to accommodate these new and unfamiliar statistical tools. As domain experts, they can contribute meaningfully by considering the role they play in facilitating the ability to interpret, transfer, and teach these algorithms to learn and perform better within their domain of interest. They can interface with ML researchers and engineers by helping to narrow the search space of possible algorithms.

将来，随着深度学习在行业应用中变得越来越普遍，该领域以外的人们将面临着调整其角色以适应这些新的和不熟悉的统计工具的挑战。 作为领域专家，他们可以通过考虑他们在促进解释，转移和教导这些算法的能力方面做出有意义的贡献，以在自己感兴趣的领域内学习和更好地发挥作用。 他们可以帮助缩小可能算法的搜索空间，从而与ML研究人员和工程师建立联系。

I like to think of the role of expertise as constraining the set of possible algorithms from infinity to finite, and the role of ML researchers as narrowing from finite to a few. I leave it as an exercise to the reader to determine which of the two is harder.

我喜欢认为专业知识的作用是将可能的算法从无穷限制到有限，而ML研究人员的作用则从有限限制到少数。 我将其留给读者练习，以确定两者中哪个更难。

Human expertise isn’t dead, not by a long shot. In fact, in the age of Deep Learning, it may be more important than ever.

人类的专业知识不会死，也不会长远。 实际上，在深度学习时代，它可能比以往任何时候都更加重要。

翻译自: https://medium.com/swlh/human-domain-expertise-in-the-age-of-deep-learning-89b3381c5cba

深度学习领域专业词汇