huggingface text-generation代码实现文本生成

python代码为：

from transformers import pipeline
model_path='codellama/CodeLlama-7b-Instruct-hf'
tokenizer = AutoTokenizer.from_pretrained(model_path)
generator = pipeline('text-generation', model = model_path,device_map="auto",)
generator("Hello, I'm a language model", max_length = 30, num_return_sequences=1)

为了简洁，也可以手动定义生成的函数

def gene_text(text):
    output=generator(
        text, 
        max_length = 300,
        do_sample=True,
        temperature=0.9,
        top_p=0.75,
        return_full_text=False,
        )
    return output[0]['generated_text']

参考：https://huggingface.co/tasks/text-generation