官方给出的fasttext预训练词向量下载地址:https://fasttext.cc/docs/en/english-vectors.html
我下载的是wiki-news-300d-1M.vec.zip,下载地址:
https://dl.fbaipublicfiles.com/fasttext/vectors-english/wiki-news-300d-1M.vec.zip
官方给出的格式是
import io
def load_vectors(fname):
fin = io.open(fname, 'r', encoding='utf-8', newline='\n', errors='ignore')
n, d = map(int, fin.readline().split())
data = {}
for line in fin:
tokens = line.rstr