我就喜欢这种格式简单明了的数据集:
id qid1 qid2 question1 question2 is_duplicate
0 1 2 What is the step by step guide to invest in share market in india? What is the step by step guide to invest in share market? 0
1 3 4 What is the story of Kohinoor (Koh-i-Noor) Diamond? What would happen if the Indian government stole the Kohinoor (Koh-i-Noor) diamond back? 0
2 5 6 How can I increase the speed of my internet connection while using a VPN? How can Internet speed be increased by hacking through DNS? 0
3 7 8 Why am I mentally very lonely? How can I solve it? Find the remainder when [math]23^{24}[/math] is divided by 24,23? 0
行号 问题1标号 问题2标号 问题1 问题2 是否相同问题标签(是非项)
一共400,000行,
注意:
1.很多负样本是含有相同主题,但语义上不相关
2.问题的分布并非真正代表quora的问题分布
3.标签可能存在噪声,即存在标注错误
https://data.quora.com/First-Quora-Dataset-Release-Question-Pairs