书生大模型实战营第3期-MindSearch 快速部署

1. 创建开发机&环境配配置

和原有的CPU版本相比区别是把internstudio换成了github codespace。随着硅基流动提供了免费的 InternLM2.5-7B-Chat 服务(免费的 InternLM2.5-7B-Chat 真的很香),MindSearch 的部署与使用也就迎来了纯 CPU 版本,进一步降低了部署门槛

下面操作均在codespace主页进行操作(web版vscode)

2. 获取硅基流动API Key

我们打开 硅基流动统一登录 来注册硅基流动的账号,创建API密钥并复制

3. 启动MindSearch

用两个终端分别启动后端和前端(如果启动后端报错,需要先更新class_registry库)

由于使用codespace,这里我们不需要使用ssh端口转发了,github会自动提示我们打开一个在公网的前端地址,即可体验webagent gradio simple demo

4. 部署到HuggingFace Space

4.1 在HuggingFace上创建一个new space

首先打开 https://huggingface.co/spaces ,并点击 Create new Space,如下图所示。 

在输入space name后选择如下配置

 4.2 在vscode创建app.py文件,保存准备提交到HuggingFace Space的全部文件

4.3 在最后,将 /root/mindsearch/mindsearch_deploy 目录下的文件(使用 git)提交到 HuggingFace Space 即可完成部署了

git push会遇到很多问题,直接给出完成操作流程仅供参考

(base) @LEO6068 ➜ /workspaces/codespaces-blank $ conda activate mindsearch
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank $ mkdir -p /workspaces/mindsearch/mindsearch_deploy
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank $ cd ..
(mindsearch) @LEO6068 ➜ /workspaces $ cd mindsearch/
(mindsearch) @LEO6068 ➜ /workspaces/mindsearch $ cp -r /workspaces/mindsearch/MindSearch/mindsearch /workspaces/mindsearch/mindsearch_deploy
(mindsearch) @LEO6068 ➜ /workspaces/mindsearch $ cp /workspaces/mindsearch/MindSearch/requirements.txt /workspaces/mindsearch/mindsearch_deploy
(mindsearch) @LEO6068 ➜ /workspaces/mindsearch $ touch /workspaces/mindsearch/mindsearch_deploy/app.py
(mindsearch) @LEO6068 ➜ /workspaces/mindsearch $ cd mindsearch_deploy/
(mindsearch) @LEO6068 ➜ /workspaces/mindsearch/mindsearch_deploy $ ls
app.py  mindsearch  requirements.txt
(mindsearch) @LEO6068 ➜ /workspaces/mindsearch/mindsearch_deploy $ code app.py 
(mindsearch) @LEO6068 ➜ /workspaces/mindsearch/mindsearch_deploy $ ls
app.py  mindsearch  requirements.txt
(mindsearch) @LEO6068 ➜ /workspaces/mindsearch/mindsearch_deploy $ code app.py 
(mindsearch) @LEO6068 ➜ /workspaces/mindsearch/mindsearch_deploy $ cd ..
(mindsearch) @LEO6068 ➜ /workspaces/mindsearch $ cd ..
(mindsearch) @LEO6068 ➜ /workspaces $ cd codespaces-blank/
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank $ git clone https://huggingface.co/spaces/LEO6068/MindSearch_Demo
Cloning into 'MindSearch_Demo'...
remote: Enumerating objects: 4, done.
remote: Total 4 (delta 0), reused 0 (delta 0), pack-reused 4 (from 1)
Unpacking objects: 100% (4/4), 1.27 KiB | 1.27 MiB/s, done.
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank $ git remote set-url space https://LEO6068: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@huggingface.co/spaces/LEO6068/MindSearch_Demo
fatal: not a git repository (or any parent up to mount point /)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank $ cd MindSearch_Demo/
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank/MindSearch_Demo (main) $ git remote set-url space https://LEO6068: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@huggingface.co/spaces/LEO6068/MindSearch_Demo
error: No such remote 'space'
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank/MindSearch_Demo (main) $ cp /workspaces/mindsearch/mindsearch_deploy/* .
cp: -r not specified; omitting directory '/workspaces/mindsearch/mindsearch_deploy/mindsearch'
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank/MindSearch_Demo (main) $ cp -r /workspaces/mindsearch/mindsearch_deploy/* .
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank/MindSearch_Demo (main) $ ls
README.md  app.py  mindsearch  requirements.txt
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank/MindSearch_Demo (main) $ git remote set-url space https://LEO6068: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@huggingface.co/spaces/LEO6068/MindSearch_Demo
error: No such remote 'space'
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank/MindSearch_Demo (main) $ git add .
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank/MindSearch_Demo (main) $ git commit -m "update"
[main 80a184c] update
 13 files changed, 1237 insertions(+)
 create mode 100644 app.py
 create mode 100644 mindsearch/__pycache__/app.cpython-310.pyc
 create mode 100644 mindsearch/agent/__init__.py
 create mode 100644 mindsearch/agent/__pycache__/__init__.cpython-310.pyc
 create mode 100644 mindsearch/agent/__pycache__/mindsearch_agent.cpython-310.pyc
 create mode 100644 mindsearch/agent/__pycache__/mindsearch_prompt.cpython-310.pyc
 create mode 100644 mindsearch/agent/__pycache__/models.cpython-310.pyc
 create mode 100644 mindsearch/agent/mindsearch_agent.py
 create mode 100644 mindsearch/agent/mindsearch_prompt.py
 create mode 100644 mindsearch/agent/models.py
 create mode 100644 mindsearch/app.py
 create mode 100644 mindsearch/terminal.py
 create mode 100644 requirements.txt
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank/MindSearch_Demo (main) $ git push
remote: Password authentication in git is no longer supported. You must use a user access token or an SSH key instead. See https://huggingface.co/blog/password-git-deprecation
fatal: Authentication failed for 'https://huggingface.co/spaces/LEO6068/MindSearch_Demo/'
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank/MindSearch_Demo (main) $ git remote set-url origin https://LEO6068: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@huggingface.co/spaces/LEO6068/MindSearch_Demo
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank/MindSearch_Demo (main) $ git push
Enumerating objects: 20, done.
Counting objects: 100% (20/20), done.
Delta compression using up to 2 threads
Compressing objects: 100% (18/18), done.
Writing objects: 100% (19/19), 27.84 KiB | 5.57 MiB/s, done.
Total 19 (delta 2), reused 0 (delta 0), pack-reused 0 (from 0)
To https://huggingface.co/spaces/LEO6068/MindSearch_Demo
   932c866..80a184c  main -> main
(mindsearch) @LEO6068 ➜ /workspaces/codespaces-blank/MindSearch_Demo (main) $ 

 5. HuggingFace应用启动

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值