rk3576上部署deepseek

最新推荐文章于 2025-03-13 17:47:41 发布

于山巅相见

最新推荐文章于 2025-03-13 17:47:41 发布

阅读量1.4k

点赞数 28

分类专栏： RK平台知识分享文章标签： deepseek rk3576 ollama rkllm deepseek-r1 rk3588

本文链接：https://blog.csdn.net/m0_60805802/article/details/145636558

版权

1. 部署方式

deepseek的部署方式有两种：

1.开发板内直接部署，这种方式简单快捷，但是没有用上rk芯片的npu性能，完全使用CPU来进行推理

2.使用RKLLM 软件堆栈将 AI 模型部署到 Rockchip 芯片上

2. 开发板部署Deepseek-r1模型

部署流程：

安装必要命令；
安装 ollama；
部署 deepseek

2.1 安装必要命令

安装curl

#升级软件
sudo apt-get update
#安装curl
sudo apt-get install curl
通过以上两条指令，完成了curl命令的安装。

2.2 安装 `ollama`

打开ollama

在这里插入图片描述

运行上图所示指令：

curl -fsSL https://ollama.com/install.sh | sh
>>> Installing ollama to /usr/local
>>> Downloading Linux arm64 bundle
######################################################################## 100.0%
>>> Creating ollama user...
>>> Adding ollama user to render group...
>>> Adding ollama user to video group...
>>> Adding current user to ollama group...
>>> Creating ollama systemd service...
>>> Enabling and starting ollama service...
Created symlink /etc/systemd/system/default.target.wants/ollama.service → /etc/systemd/system/ollama.service.
>>> The Ollama API is now available at 127.0.0.1:11434.
>>> Install complete. Run "ollama" from the command line.
WARNING: No NVIDIA/AMD GPU detected. Ollama will run in CPU-only mode.

2.3 部署 `deepseek`

在 ollama 的官网上，选择 "Models"

在这里插入图片描述

1.5B的模型大概1.1G，复制指令黏贴到命令行里，就可以自动开始下载了

$ollama run deepseek-r1:1.5b
pulling manifest
pulling aabd4debf0c8... 100% ▕▏ 1.1 GB
pulling 369ca498f347... 100% ▕▏  387 B
pulling 6e4c38e1172f... 100% ▕▏ 1.1 KB
pulling f4d24e9138dd... 100% ▕▏  148 B
pulling a85fe2a2e58e... 100% ▕▏  487 B
verifying sha256 digest
writing manifest
success

2.4 测试deepseek

开发板下载deepseek完成后使用命令打开：

How to earn an annual salary of millions
<think>

</think>

To earn an annual salary of millions, the approach will depend on several factors such as your industry, work location, and level of experience. Here are some general strategies:

### 1. **High-Paying Jobs**
   - **Specialization:** Work in industries with high demand for specialized skills.
   - **Location:** Consider working remotely or in a high-demand region.
   - **Experience:** Look into roles that require exceptional technical expertise and strategic thinking.

### 2. **Online Courses and Training Programs**
   - **Specialized Training:** Enroll in online courses or certifications related to your desired field, such as data science, engineering, finance, or law.
   - **Skill Development:** Focus on acquiring advanced skills through platforms like Coursera, Udemy, or LinkedIn Learning.

### 3. **Consulting and High-Stakes Work**
   - **Consulting Services:** If you have a bac