文本分类数据集汇总

本文列举了2020年7月1日时收集的多个文本分类数据集,包括未能下载的数据集,并提供了相关参考链接和免费下载资源。
摘要由CSDN通过智能技术生成

统计了下载到的文本分类数据集信息,汇总成表格如下(时间:2020.7.1):

Dataset Classes Type Samples Best Method Performance
AG News 4 Topic Train:120000 Test: 7600 XLNet Error: 4.45
Dbpedia 14 Topic Train: 560000 Test: 70000 XLNet Error: 0.6
TREC-6 6 Question Train: 5452 Test: 500 USE_T+CNN Error: 1.93
TREC-50 50 Question Train: 5452 Test: 500 Rules Error: 2.8
20NEWS 20 Topic 20,000 SGC Acc: 88.5
IMDb 2 Sentiment Train: 25,000 Test: 25,000 XLNet Acc: 96.8
Yahoo! Answers 10 Question Train: 1,400,000 Test: 60,000 BERT-ITPT-FiT<
AG's News Topic Classification Dataset Version 3, Updated 09/09/2015 ORIGIN AG is a collection of more than 1 million news articles. News articles have been gathered from more than 2000 news sources by ComeToMyHead in more than 1 year of activity. ComeToMyHead is an academic news search engine which has been running since July, 2004. The dataset is provided by the academic comunity for research purposes in data mining (clustering, classification, etc), information retrieval (ranking, search, etc), xml, data compression, data streaming, and any other non-commercial activity. For more information, please refer to the link http://www.di.unipi.it/~gulli/AG_corpus_of_news_articles.html . The AG's news topic classification dataset is constructed by Xiang Zhang (xiang.zhang@nyu.edu) from the dataset above. It is used as a text classification benchmark in the following paper: Xiang Zhang, Junbo Zhao, Yann LeCun. Character-level Convolutional Networks for Text Classification. Advances in Neural Information Processing Systems 28 (NIPS 2015). DESCRIPTION The AG's news topic classification dataset is constructed by choosing 4 largest classes from the original corpus. Each class contains 30,000 training samples and 1,900 testing samples. The total number of training samples is 120,000 and testing 7,600. The file classes.txt contains a list of classes corresponding to each label. The files train.csv and test.csv contain all the training samples as comma-sparated values. There are 3 columns in them, corresponding to class index (1 to 4), title and description. The title and description are escaped using double quotes ("), and any internal double quote is escaped by 2 double quotes (""). New lines are escaped by a backslash followed with an "n" character, that is "\n".
评论 18
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值