本文详细介绍了如何实现BiDAF模型的数据预处理步骤，包括从SQuAD1.1数据集中获取训练样本，将答案的字符级索引转化为词级索引，以及数据集的batch划分和padding处理。同时，提到了在处理过程中可能遇到的nltk库的问题及其解决方法。
本文将带你实现由Minjoon Seo、Aniruddha Kembhavi、Ali Farhadi和Hananneh Hajishirzi共同完成的模型BiDAF
目标
本小节目标：
-
从原始数据集中获取出可以训练的样本格式，如：
原文(context) 问题(query) 答案(answer) Super Bowl 50 was an American football game to determine the champion of the National Football League (NFL) for the 2015 season. The American Football Conference (AFC) champion Denver Broncos defeated the National Football Conference (NFC) champion Carolina Panthers 24–10 to earn their third Super Bowl title. The game was played on February 7, 2016, at Levi’s Stadium in the San Francisco Bay Area at Santa Clara, California. As this was the 50th Super Bowl, the league emphasized the “golden anniversary” with various gold-themed initiatives, as well as temporarily suspending the tradition of naming each Sup
订阅专栏 解锁全文
432
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
