allenNLP 使用predictor加载模型进行预测

最新推荐文章于 2024-05-06 00:08:33 发布

qq_34373543

最新推荐文章于 2024-05-06 00:08:33 发布

阅读量442

点赞数

分类专栏： allenNLP predictor 文章标签： python 深度学习自然语言处理

本文链接：https://blog.csdn.net/qq_34373543/article/details/129279703

版权

allenNLP 同时被 2 个专栏收录

2 篇文章 0 订阅

订阅专栏

predictor

1 篇文章 0 订阅

订阅专栏

allenNLP加载模型model/model.tar.gz预测

from my_text_classifier.predictors.sentence_classifier_predictor import SentenceClassifierPredictor
model_path = 'model/model.tar.gz'
predictor = SentenceClassifierPredictor.from_path(model_path,predictor_name="sentence_classifier")
res = predictor.predict("数据探索-营销费用分析")
print(res) #{'probs': [0.012842098250985146, 0.009376253001391888, 0.9777816534042358]}

prodictor预测器

from allennlp.common import JsonDict
from allennlp.data import DatasetReader, Instance
from allennlp.models import Model
from allennlp.predictors import Predictor

@Predictor.register("sentence_classifier")
class SentenceClassifierPredictor(Predictor):
    def predict(self, sentence: str) -> JsonDict:
        return self.predict_json({"sentence": sentence})
    def _json_to_instance(self, json_dict: JsonDict) -> Instance:
        '''
        :param json_dict:{'sentence': '...', 'label': '...'},对sentence进行预测
        :return: Instance(fields)
        '''
        sentence = json_dict["sentence"]
        return self._dataset_reader.text_to_instance(sentence)

注意：

SentenceClassifierPredictor.from_path(model_path,predictor_name=“sentence_classifier”) 使用@Predictor.register(“sentence_classifier”)的注册名字"sentence_classifier"