这里写自定义目录标题
简单调用llama3进行对话
pip install ollama
环境配置为
conda create -n openai-demo python=3.8
conda activate openai-demo
pip install openai==1.14.2 # 或者conda install openai
#pip install openai==0.28 这里用0.28 版本就跑不出来一直报错ImportError: cannot import name 'OpenAI' from 'openai' )
from openai import OpenAI
client = OpenAI(
base_url = "https://integrate.api.nvidia.com/v1",
api_key = "Your-api-key"
)
completion = client.chat.completions.create(
model="meta/llama3-70b-instruct",
messages=[{"role":"user","content":"介绍一下llama3,用中文"}],
temperature=0.5,
top_p=1,
max_tokens=1024,
stream=True
)
for chunk in completion:
if chunk.choices[0].delta.content is not None:
print(chunk.choices[0].delta.content, end="")
- Your-api-key 需要替换成自己的API
- 进入nivida官网
- 点击一个模型,比如llama3-70b-instruct,出现下方的代码,点击 Get API KEY,注册之后就出现一堆字母数字了
- 作者这里尝试科学上网/不科学上网都可以使用
- 结果图如下