深度分享：世界顶级计算语言学科学家Ken Church CCL 2018主旨报告（附PPT全文）

最新推荐文章于 2022-07-04 23:58:57 发布

数据派THU

最新推荐文章于 2022-07-04 23:58:57 发布

阅读量635

点赞数

本文分享了顶级科学家Kenneth Ward Church在CCL2018的报告，探讨Minsky和Chomsky对机器学习的早期质疑及对现代深度网络的影响，提出深度学习领域需要类似乔姆斯基层级的组织框架，并讨论大数据对不同问题解决的帮助程度。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

640?wx_fmt=png

来源：TsinghuaNLP

本文多图，建议阅读10分钟。

本文为你分享世界顶级计算语言学科学家在CCL2018的报告内容。

640?wx_fmt=jpeg

报告人：Kenneth Ward Church (Baidu Research Fellow)

题目：Minsky, Chomsky & Deep Nets

摘要：When Minsky and Chomsky were at Harvard in the 1950s, they started out their careers questioning a number of machine learning methods that have since regained popularity. Their objections are remembered as too negative: ngrams can't do this and nets can't do that. But more constructively, their arguments led to what is now known as the Chomsky Hierarchy and time and space complexity. The deep nets literature needs a high-level organization like the Chomsky Hierarchy. There are so many results being published these days that it is hard to see the big picture.My colleagues at Baidu have proposed a metric for ranking deep net problems by a metric of difficulty. There is no data like more data, but more data helps more for some problems than others. Their ranking suggests that more data is particularly helpful for problems that people are really excited about in speech and vision, and less so for problems in computational linguistics.

PPT下载: 请点击“阅读原文”或复制以下网址在浏览器中下载。