Can’t find model ‘en’. 解决方案
OSError: [E941] Can’t find model ‘en’. It looks like you’re trying to load a model from a shortcut, which is obsolete as of spaCy v3.0. To load the model, use its full name instead:
nlp = spacy.load(“en_core_web_sm”)
点击报错发现是在调用spacy的时候token_language默认是en,而需要的是en_core_web_sm,所以修改这个就好了。
首先,从别人的GitHub上快速下载en_core_web_sm
pip install https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-3.0.0/en_core_web_sm-3.0.0.tar.gz
然后,在调用的时候设置token_language = 'en_core_web_sm’即可
TEXT = data.Field(tokenize='spacy',tokenizer_language='en_core_web_sm')