https://github.com/gpustack/gpustack
root@node38:~# curl -sfL https://get.gpustack.ai | sh -s -
[INFO] Python module ensurepip could not be found. Attempting to install the python3-venv package...
Get:1 file:/var/cuda-repo-ubuntu2204-12-6-local InRelease [1,572 B]
Get:1 file:/var/cuda-repo-ubuntu2204-12-6-local InRelease [1,572 B]
Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB]
Hit:3 http://mirrors.tuna.tsinghua.edu.cn/ubuntu jammy InRelease
Get:4 http://mirrors.tuna.tsinghua.edu.cn/ubuntu jammy-updates InRelease [128 kB]
Hit:5 https://nvidia.github.io/libnvidia-container/stable/deb/amd64 InRelease
Hit:6 http://mirrors.tuna.tsinghua.edu.cn/ubuntu jammy-backports InRelease
Get:7 http://mirrors.tuna.tsinghua.edu.cn/ubuntu jammy-updates/main amd64 Packages [2,510 kB]
Get:8 http://mirrors.tuna.tsinghua.edu.cn/ubuntu jammy-updates/main i386 Packages [793 kB]
Get:9 http://mirrors.tuna.tsinghua.edu.cn/ubuntu jammy-updates/universe amd64 Packages [1,200 kB]
Get:10 http://mirrors.tuna.tsinghua.edu.cn/ubuntu jammy-updates/universe i386 Packages [764 kB]
Fetched 5,524 kB in 37s (147 kB/s)
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
231 packages can be upgraded. Run 'apt list --upgradable' to see them.
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following additional packages will be installed:
python3-pip-whl python3-setuptools-whl python3.10-venv
The following NEW packages will be installed:
python3-pip-whl python3-setuptools-whl python3-venv python3.10-venv
0 upgraded, 4 newly installed, 0 to remove and 231 not upgraded.
Need to get 2,475 kB of archives.
After this operation, 2,891 kB of additional disk space will be used.
Get:1 http://cn.archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-pip-whl all 22.0.2+dfsg-1ubuntu0.5 [1,680 kB]
Get:2 http://mirrors.tuna.tsinghua.edu.cn/ubuntu jammy-updates/universe amd64 python3-setuptools-whl all 59.6.0-1.2ubuntu0.22.04.2 [788 kB]
Get:3 http://cn.archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3.10-venv amd64 3.10.12-1~22.04.9 [5,722 B]
Get:4 http://cn.archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-venv amd64 3.10.6-1~22.04.1 [1,042 B]
Fetched 2,475 kB in 23s (108 kB/s)
Selecting previously unselected package python3-pip-whl.
(Reading database ... 228344 files and directories currently installed.)
Preparing to unpack .../python3-pip-whl_22.0.2+dfsg-1ubuntu0.5_all.deb ...
Unpacking python3-pip-whl (22.0.2+dfsg-1ubuntu0.5) ...
Selecting previously unselected package python3-setuptools-whl.
Preparing to unpack .../python3-setuptools-whl_59.6.0-1.2ubuntu0.22.04.2_all.deb ...
Unpacking python3-setuptools-whl (59.6.0-1.2ubuntu0.22.04.2) ...
Selecting previously unselected package python3.10-venv.
Preparing to unpack .../python3.10-venv_3.10.12-1~22.04.9_amd64.deb ...
Unpacking python3.10-venv (3.10.12-1~22.04.9) ...
Selecting previously unselected package python3-venv.
Preparing to unpack .../python3-venv_3.10.6-1~22.04.1_amd64.deb ...
Unpacking python3-venv (3.10.6-1~22.04.1) ...
Setting up python3-setuptools-whl (59.6.0-1.2ubuntu0.22.04.2) ...
Setting up python3-pip-whl (22.0.2+dfsg-1ubuntu0.5) ...
Setting up python3.10-venv (3.10.12-1~22.04.9) ...
Setting up python3-venv (3.10.6-1~22.04.1) ...
[INFO] Pipx could not be found. Attempting to install...
Looking in indexes: https://mirrors.aliyun.com/pypi/simple/
DEPRECATION: The HTML index page being used (https://mirrors.aliyun.com/pypi/simple/pipx/) is not a proper HTML 5 document. This is in violation of PEP 503 which requires these pages to be well-formed HTML 5 documents. Please reach out to the owners of this index page, and ask them to update this index page to a valid HTML 5 document. pip 22.2 will enforce this behaviour change. Discussion can be found at https://github.com/pypa/pip/issues/10825
Collecting pipx
Downloading https://mirrors.aliyun.com/pypi/packages/35/af/66db02a214590a841bcd1df1f02f7ef818dc3f43487acddab0b8c40b25d2/pipx-1.7.1-py3-none-any.whl (78 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.7/78.7 KB 74.2 kB/s eta 0:00:00
DEPRECATION: The HTML index page being used (https://mirrors.aliyun.com/pypi/simple/platformdirs/) is not a proper HTML 5 document. This is in violation of PEP 503 which requires these pages to be well-formed HTML 5 documents. Please reach out to the owners of this index page, and ask them to update this index page to a valid HTML 5 document. pip 22.2 will enforce this behaviour change. Discussion can be found at https://github.com/pypa/pip/issues/10825
Collecting platformdirs>=2.1
Downloading https://mirrors.aliyun.com/pypi/packages/6d/45/59578566b3275b8fd9157885918fcd0c4d74162928a5310926887b856a51/platformdirs-4.3.7-py3-none-any.whl (18 kB)
DEPRECATION: The HTML index page being used (https://mirrors.aliyun.com/pypi/simple/userpath/) is not a proper HTML 5 document. This is in violation of PEP 503 which requires these pages to be well-formed HTML 5 documents. Please reach out to the owners of this index page, and ask them to update this index page to a valid HTML 5 document. pip 22.2 will enforce this behaviour change. Discussion can be found at https://github.com/pypa/pip/issues/10825
Collecting userpath!=1.9,>=1.6
Downloading https://mirrors.aliyun.com/pypi/packages/43/99/3ec6335ded5b88c2f7ed25c56ffd952546f7ed007ffb1e1539dc3b57015a/userpath-1.9.2-py3-none-any.whl (9.1 kB)
DEPRECATION: The HTML index page being used (https://mirrors.aliyun.com/pypi/simple/argcomplete/) is not a proper HTML 5 document. This is in violation of PEP 503 which requires these pages to be well-formed HTML 5 documents. Please reach out to the owners of this index page, and ask them to update this index page to a valid HTML 5 document. pip 22.2 will enforce this behaviour change. Discussion can be found at https://github.com/pypa/pip/issues/10825
Collecting argcomplete>=1.9.4
Downloading https://mirrors.aliyun.com/pypi/packages/31/da/e42d7a9d8dd33fa775f467e4028a47936da2f01e4b0e561f9ba0d74cb0ca/argcomplete-3.6.2-py3-none-any.whl (43 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.7/43.7 KB 135.3 kB/s eta 0:00:00
Requirement already satisfied: packaging>=20 in /usr/local/lib/python3.10/dist-packages (from pipx) (24.2)
DEPRECATION: The HTML index page being used (https://mirrors.aliyun.com/pypi/simple/tomli/) is not a proper HTML 5 document. This is in violation of PEP 503 which requires these pages to be well-formed HTML 5 documents. Please reach out to the owners of this index page, and ask them to update this index page to a valid HTML 5 document. pip 22.2 will enforce this behaviour change. Discussion can be found at https://github.com/pypa/pip/issues/10825
Collecting tomli
Downloading https://mirrors.aliyun.com/pypi/packages/6e/c2/61d3e0f47e2b74ef40a68b9e6ad5984f6241a942f7cd3bbfbdbd03861ea9/tomli-2.2.1-py3-none-any.whl (14 kB)
Requirement already satisfied: click in /usr/lib/python3/dist-packages (from userpath!=1.9,>=1.6->pipx) (8.0.3)
Installing collected packages: userpath, tomli, platformdirs, argcomplete, pipx
Successfully installed argcomplete-3.6.2 pipx-1.7.1 platformdirs-4.3.7 tomli-2.2.1 userpath-1.9.2
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Success! Added /root/.local/bin to the PATH environment variable.
Consider adding shell completions for pipx. Run 'pipx completions' for instructions.
Otherwise pipx is ready to go! ✨ 🌟 ✨
Success! Added /root/.local/bin to the PATH environment variable.
Consider adding shell completions for pipx. Run 'pipx completions' for instructions.
Otherwise pipx is ready to go! ✨ 🌟 ✨
[INFO] Installing GPUStack...
pipx >(setup:1110): pipx version is 1.7.1
pipx >(setup:1111): Default python interpreter is '/usr/bin/python3.10'
pipx >(package_name_from_spec:378): Determined package name: gpustack
pipx >(package_name_from_spec:379): Package name determined in 0.0s
pipx >(create_venv:164): Creating virtual environment
creating virtual environment...
pipx >(run_subprocess:175): running /usr/bin/python3 -m venv --without-pip /root/.local/share/pipx/venvs/gpustack
creating shared libraries...
pipx >(run_subprocess:175): running /usr/bin/python3.10 -m venv --clear /root/.local/share/pipx/shared
pipx >(run_subprocess:175): running <checking pip's availability>
pipx >(upgrade:119): Upgrading shared libraries in /root/.local/share/pipx/shared
upgrading shared libraries...
pipx >(run_subprocess:175): running /root/.local/share/pipx/shared/bin/python -m pip --no-input --disable-pip-version-check install --force-reinstall --upgrade pip >= 23.1
pipx >(run_subprocess:175): running /root/.local/share/pipx/venvs/gpustack/bin/python -c import sysconfig; print(sysconfig.get_path('purelib'))
pipx >(run_subprocess:175): running /root/.local/share/pipx/shared/bin/python -c import sysconfig; print(sysconfig.get_path('purelib'))
pipx >(run_subprocess:175): running /root/.local/share/pipx/venvs/gpustack/bin/python --version
pipx >(_parsed_package_to_package_or_url:139): cleaned package spec: gpustack[all]
pipx >(install_package:247): Installing gpustack from spec 'gpustack[all]'
installing gpustack from spec 'gpustack[all]'...
pipx >(run_subprocess:175): running /root/.local/share/pipx/venvs/gpustack/bin/python -m pip --no-input install gpustack[all]
pipx >(subprocess_post_check_handle_pip_error:332): '/root/.local/share/pipx/venvs/gpustack/bin/python -m pip --no-input install gpustack[all]' failed
pipx >(subprocess_post_check_handle_pip_error:347): Fatal error from pip prevented installation. Full pip output in file:
/root/.local/state/pipx/log/cmd_2025-04-25_09.14.50_pip_errors.log
pipx >(analyze_pip_output:311): pip seemed to fail to build package:
asyncpg<0.30.0,>=0.29.0
Some possibly relevant errors from pip install:
TimeoutError: The read operation timed out
pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='mirrors.aliyun.com', port=443): Read timed out.
pipx >(rmdir:56): removing directory /root/.local/share/pipx/venvs/gpustack
Error installing gpustack from spec 'gpustack[all]'.
改成清华源ok了
pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple/
pip config set install.trusted-host pypi.tuna.tsinghua.edu.cn
root@node38:~# pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple/
pip config set install.trusted-host pypi.tuna.tsinghua.edu.cn
Writing to /root/.config/pip/pip.conf
Writing to /root/.config/pip/pip.conf
root@node38:~#
root@node38:~# curl -sfL https://get.gpustack.ai | sh -s -
Success! Added /root/.local/bin to the PATH environment variable.
Consider adding shell completions for pipx. Run 'pipx completions' for instructions.
Otherwise pipx is ready to go! ✨ 🌟 ✨
[INFO] Installing GPUStack...
pipx >(setup:1110): pipx version is 1.7.1
pipx >(setup:1111): Default python interpreter is '/usr/bin/python3.10'
pipx >(package_name_from_spec:378): Determined package name: gpustack
pipx >(package_name_from_spec:379): Package name determined in 0.0s
pipx >(create_venv:164): Creating virtual environment
creating virtual environment...
pipx >(run_subprocess:175): running /usr/bin/python3 -m venv --without-pip /root/.local/share/pipx/venvs/gpustack
pipx >(run_subprocess:175): running <checking pip's availability>
pipx >(run_subprocess:175): running /root/.local/share/pipx/venvs/gpustack/bin/python -c import sysconfig; print(sysconfig.get_path('purelib'))
pipx >(run_subprocess:175): running /root/.local/share/pipx/shared/bin/python -c import sysconfig; print(sysconfig.get_path('purelib'))
pipx >(run_subprocess:175): running /root/.local/share/pipx/venvs/gpustack/bin/python --version
pipx >(_parsed_package_to_package_or_url:139): cleaned package spec: gpustack[all]
pipx >(install_package:247): Installing gpustack from spec 'gpustack[all]'
installing gpustack from spec 'gpustack[all]'...
pipx >(run_subprocess:175): running /root/.local/share/pipx/venvs/gpustack/bin/python -m pip --no-input install gpustack[all]
pipx >(run_subprocess:175): running <fetch_info_in_venv commands>
pipx >(get_venv_metadata_for_package:351): get_venv_metadata_for_package: 20379ms
pipx >(_parsed_package_to_package_or_url:139): cleaned package spec: gpustack[all]
pipx >(_symlink_package_resource:132): Force is true. Removing /root/.local/bin/gpustack.
installed package gpustack 0.6.0, installed using Python 3.10.12
These apps are now globally available
- gpustack
done! ✨ 🌟 ✨
[INFO] Setting up GPUStack as a service using systemd.
Created symlink /etc/systemd/system/multi-user.target.wants/gpustack.service → /etc/systemd/system/gpustack.service.
[INFO] Waiting for the service to initialize...
[INFO] Running post-install checks...
[INFO] GPUStack service is running.
[INFO] Install complete.
GPUStack UI is available at http://localhost.
Default username is 'admin'.
To get the default password, run 'cat /var/lib/gpustack/initial_admin_password'.
root@node38:~#
root@node38:~#
root@node38:~#
root@node38:~# cat /var/lib/gpustack/initial_admin_password
+0Of0D@I9%oi
root@node38:~# nvidia-smi
Fri Apr 25 14:02:01 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 565.57.01 Driver Version: 565.57.01 CUDA Version: 12.7 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 Tesla P100-SXM2-16GB Off | 00000000:1F:00.0 Off | Off |
| N/A 40C P0 43W / 300W | 10969MiB / 16384MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 1 Tesla P100-SXM2-16GB Off | 00000000:20:00.0 Off | Off |
| N/A 42C P0 42W / 300W | 261MiB / 16384MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 2 Tesla P100-SXM2-16GB Off | 00000000:65:00.0 Off | Off |
| N/A 42C P0 43W / 300W | 261MiB / 16384MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 3 Tesla P100-SXM2-16GB Off | 00000000:66:00.0 Off | 0 |
| N/A 43C P0 43W / 300W | 261MiB / 16384MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 4 Tesla P100-SXM2-16GB Off | 00000000:B6:00.0 Off | Off |
| N/A 42C P0 44W / 300W | 261MiB / 16384MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 5 Tesla P100-SXM2-16GB Off | 00000000:B7:00.0 Off | 0 |
| N/A 44C P0 41W / 300W | 261MiB / 16384MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 6 Tesla P100-SXM2-16GB Off | 00000000:DF:00.0 Off | Off |
| N/A 40C P0 43W / 300W | 261MiB / 16384MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 7 Tesla P100-SXM2-16GB Off | 00000000:E0:00.0 Off | 0 |
| N/A 50C P0 46W / 300W | 261MiB / 16384MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 2200 G /usr/lib/xorg/Xorg 4MiB |
| 0 N/A N/A 10438 C .../bin/llama-box/llama-box-rpc-server 254MiB |
| 0 N/A N/A 31864 C python 10708MiB |
| 1 N/A N/A 2200 G /usr/lib/xorg/Xorg 4MiB |
| 1 N/A N/A 10441 C .../bin/llama-box/llama-box-rpc-server 254MiB |
| 2 N/A N/A 2200 G /usr/lib/xorg/Xorg 4MiB |
| 2 N/A N/A 10427 C .../bin/llama-box/llama-box-rpc-server 254MiB |
| 3 N/A N/A 2200 G /usr/lib/xorg/Xorg 4MiB |
| 3 N/A N/A 10449 C .../bin/llama-box/llama-box-rpc-server 254MiB |
| 4 N/A N/A 2200 G /usr/lib/xorg/Xorg 4MiB |
| 4 N/A N/A 10445 C .../bin/llama-box/llama-box-rpc-server 254MiB |
| 5 N/A N/A 2200 G /usr/lib/xorg/Xorg 4MiB |
| 5 N/A N/A 10419 C .../bin/llama-box/llama-box-rpc-server 254MiB |
| 6 N/A N/A 2200 G /usr/lib/xorg/Xorg 4MiB |
| 6 N/A N/A 10421 C .../bin/llama-box/llama-box-rpc-server 254MiB |
| 7 N/A N/A 2200 G /usr/lib/xorg/Xorg 4MiB |
| 7 N/A N/A 10415 C .../bin/llama-box/llama-box-rpc-server 254MiB |
+-----------------------------------------------------------------------------------------+