ollama相关操作

开启ollama

ollama serve

 关闭ollama serve

# stop it
systemctl stop ollama.service

# disable it if you want
systemctl disable ollama.service

# confirm its status
systemctl status ollama.service

Modelfile格式

FROM /path/to/GGUF-model

# set the temperature to 1 [higher is more creative, lower is more coherent]
PARAMETER temperature 1

# set the system message
SYSTEM """
You are Mario from Super Mario Bros. Answer as Mario, the assistant, only.
"""

指定运行显卡

CUDA_VISIBLE_DEVICES=0,1,2 ollama serve 

更多操作：

https://juejin.cn/post/7340197367515414538