HuggingFace - 使用 Inference API

编程乐园

已于 2024-09-12 09:23:19 修改

阅读量550

点赞数 4

分类专栏： LLM & AIGC 文章标签： HuggingFace Inference API

于 2024-09-12 09:21:30 首次发布

本文链接：https://blog.csdn.net/lovechris00/article/details/142165820

版权

LLM & AIGC 专栏收录该内容

161 篇文章

订阅专栏

以 mistralai/Mistral-7B-v0.1 为例：
https://huggingface.co/mistralai/Mistral-7B-v0.1

在这里插入图片描述

Python

import requests

API_URL = "https://api-inference.huggingface.co/models/mistralai/Mistral-7B-v0.1"
headers = {"Authorization": "Bearer hf_xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"}

def query(payload):
	response = requests.post(API_URL, headers=headers, json=payload)
	return response.json()
	
output = query({
	"inputs": "Can you please let us know more details about your ",
})

cURL 命令

curl https://api-inference.huggingface.co/models/mistralai/Mistral-7B-v0.1 \
	-X POST \
	-d '{"inputs": "Can you please let us know more details about your "}' \
	-H 'Content-Type: application/json' \
	-H "Authorization: Bearer hf_xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"