@Linux 查看硬件配置
#查看CPU
[capios@capios8163 ~]$ cat /proc/cpuinfo | grep name
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
model name : Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz
#查看GPU
[capios@capios8163 ~]$ lspci | grep VGA
05:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41)
18:00.0 VGA compatible controller: NVIDIA Corporation Device 2684 (rev a1)
3b:00.0 VGA compatible controller: NVIDIA Corporation Device 2684 (rev a1)
86:00.0 VGA compatible controller: NVIDIA Corporation Device 2684 (rev a1)
af:00.0 VGA compatible controller: NVIDIA Corporation Device 2684 (rev a1)
#查看内存
[capios@capios8163 ~]$ cat /proc/meminfo | head -4
MemTotal: 526775948 kB
MemFree: 517180704 kB
MemAvailable: 517160152 kB
Buffers: 7096 kB
#查看主板
[capios@capios8163 ~]$ sudo -i
[sudo] password for capios:
[root@capios8163 ~]# dmidecode | more
# dmidecode 3.2
Getting SMBIOS data from sysfs.
SMBIOS 3.2.1 present.
# SMBIOS implementations newer than version 3.2.0 are not
# fully supported by this version of dmidecode.
Table at 0x6F3CC000.
Handle 0x0000, DMI type 0, 26 bytes
BIOS Information
Vendor: American Megatrends Inc.
Version: 3.6
Release Date: 01/22/2022
Address: 0xF0000
Runtime Size: 64 kB
ROM Size: 32 MB
Characteristics:
PCI is supported
BIOS is upgradeable
BIOS shadowing is allowed
Boot from CD is supported
Selectable boot is supported
BIOS ROM is socketed
EDD is supported
5.25"/1.2 MB floppy services are supported (int 13h)
3.5"/720 kB floppy services are supported (int 13h)
3.5"/2.88 MB floppy services are supported (int 13h)
Print screen service is supported (int 5h)
Serial services are supported (int 14h)
Printer services are supported (int 17h)
ACPI is supported
USB legacy is supported
BIOS boot specification is supported
Targeted content distribution is supported
UEFI is supported
BIOS Revision: 5.14
Handle 0x0001, DMI type 1, 27 bytes
System Information
Manufacturer: Supermicro
Product Name: Super Server
Version: 0123456789
Serial Number: 0123456789
UUID: c73d0e00-5026-11ed-8000-3cecefab75a8
Wake-up Type: Power Switch
SKU Number: To be filled by O.E.M.
Family: To be filled by O.E.M.
Handle 0x0002, DMI type 2, 15 bytes
Base Board Information
Manufacturer: Supermicro
Product Name: X11DPG-QT
--More--
#查看磁盘分配情况
[capios@capios8163 ~]$ df -h
Filesystem Size Used Avail Use% Mounted on
devtmpfs 252G 0 252G 0% /dev
tmpfs 252G 0 252G 0% /dev/shm
tmpfs 252G 13M 252G 1% /run
tmpfs 252G 0 252G 0% /sys/fs/cgroup
/dev/mapper/centos-root 50G 12G 39G 23% /
/dev/nvme0n1p2 1014M 260M 755M 26% /boot
/dev/nvme0n1p1 200M 12M 189M 6% /boot/efi
/dev/sda 7.3T 93M 6.9T 1% /data
/dev/mapper/centos-home 899G 1.1G 898G 1% /home
tmpfs 51G 44K 51G 1% /run/user/1000
tmpfs 51G 0 51G 0% /run/user/0
[root@capios8163 docker]# docker pull dataelement/bisheng-unstructured:0.0.3.2
0.0.3.2: Pulling from dataelement/bisheng-unstructured
b549f31133a9: Downloading [=======> ] 3.943MB/27.47MB
64e0fd402fbf: Pulling fs layer
b549f31133a9: Downloading [=======> ] 4.221MB/27.47MB
64e0fd402fbf: Downloading [> ] 527.5kB/716.1MB
4f4fb700ef54: Waiting
b549f31133a9: Pull complete
64e0fd402fbf: Pull complete
d2b58601be35: Pull complete
0401ce3390d0: Pull complete
4f4fb700ef54: Pull complete
58580d94bdb4: Pull complete
d227b3919718: Pull complete
140074c15ec2: Pull complete
1fa41e3ee950: Pull complete
Digest: sha256:4583da599f86d71f1a6a96cf6e4103fe571ae2f3d7bb6d70a827807d3e8b9909
Status: Downloaded newer image for dataelement/bisheng-unstructured:0.0.3.2
docker.io/dataelement/bisheng-unstructured:0.0.3.2
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
ae91796f3275 milvusdb/milvus:v2.2.10 "/tini -- milvus run…" 39 hours ago Up 2 minutes 0.0.0.0:9091->9091/tcp, :::9091->9091/tcp, 0.0.0.0:19530->19530/tcp, :::19530->19530/tcp milvus-standalone
07533ea200f3 minio/minio:RELEASE.2023-03-20T20-16-18Z "/usr/bin/docker-ent…" 39 hours ago Up 4 seconds (health: starting) 9000/tcp milvus-minio
2e24260fcedf quay.io/coreos/etcd:v3.5.5 "etcd -advertise-cli…" 39 hours ago Up 3 seconds 2379-2380/tcp milvus-etcd
86772b873f93 dataelement/bisheng-backend:latest "bash -c 'uvicorn bi…" 46 hours ago Up About a minute (health: starting) 0.0.0.0:7860->7860/tcp, :::7860->7860/tcp docker-backend-1
6fa999c06824 onlyoffice/documentserver:7.1.1 "/app/ds/run-documen…" 46 hours ago Up 5 minutes 443/tcp, 0.0.0.0:8701->80/tcp, :::8701->80/tcp docker-office-1
fc8a0857ba44 mysql:8.0 "docker-entrypoint.s…" 46 hours ago Created docker-mysql-1
32299238dcdf redis:7.0.4 "docker-entrypoint.s…" 46 hours ago Up 5 minutes 0.0.0.0:6379->6379/tcp, :::6379->6379/tcp redis
d9b24185352f dataelement/bisheng-frontend:latest "/docker-entrypoint.…" 46 hours ago Up 57 seconds 80/tcp, 0.0.0.0:3001->3001/tcp, :::3001->3001/tcp docker-nginx-1
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
e6ff44a0767d dataelement/bisheng-unstructured:0.0.3.2 "bash bin/entrypoint…" 13 seconds ago Up 12 seconds 0.0.0.0:10001->10001/tcp, :::10001->10001/tcp bisheng_uns_v003
ae91796f3275 milvusdb/milvus:v2.2.10 "/tini -- milvus run…" 39 hours ago Up 10 minutes 0.0.0.0:9091->9091/tcp, :::9091->9091/tcp, 0.0.0.0:19530->19530/tcp, :::19530->19530/tcp milvus-standalone
07533ea200f3 minio/minio:RELEASE.2023-03-20T20-16-18Z "/usr/bin/docker-ent…" 39 hours ago Up 8 minutes (healthy) 9000/tcp milvus-minio
2e24260fcedf quay.io/coreos/etcd:v3.5.5 "etcd -advertise-cli…" 39 hours ago Up 8 minutes 2379-2380/tcp milvus-etcd
86772b873f93 dataelement/bisheng-backend:latest "bash -c 'uvicorn bi…" 47 hours ago Up 10 minutes (unhealthy) 0.0.0.0:7860->7860/tcp, :::7860->7860/tcp docker-backend-1
6fa999c06824 onlyoffice/documentserver:7.1.1 "/app/ds/run-documen…" 47 hours ago Up 14 minutes 443/tcp, 0.0.0.0:8701->80/tcp, :::8701->80/tcp docker-office-1
fc8a0857ba44 mysql:8.0 "docker-entrypoint.s…" 47 hours ago Created docker-mysql-1
32299238dcdf redis:7.0.4 "docker-entrypoint.s…" 47 hours ago Up 14 minutes 0.0.0.0:6379->6379/tcp, :::6379->6379/tcp redis
d9b24185352f dataelement/bisheng-frontend:latest "/docker-entrypoint.…" 47 hours ago Up 9 minutes 80/tcp, 0.0.0.0:3001->3001/tcp, :::3001->3001/tcp docker-nginx-1
# Step 0. pull image，0.0.x改成需要pull的版本号
docker pull dataelement/bisheng-rt:0.0.4
# Step 1 下载开源模型（大语言模型、embedding模型等）并将模型文件移动到模型仓库路径下
mkdir -p /path/to/your/model_repository && cd /path/to/your/model_repository
mkdir -p /data/model_repository && cd /data/model_repository
# 模型下载方法请参考【开源模型下载指南】
# Step 2. start container
function run_container() {
LOCAL_MODEL_REPO="/data/model_repository" # 改成你自己的repo地址
MOUNT="-v $LOCAL_MODEL_REPO:/opt/bisheng-rt/models/model_repository"
IMAGE="dataelement/bisheng-rt:0.0.4"
docker run --gpus=all -p 9000:9000 -p 9001:9001 -p 9002:9002 -itd --workdir /opt/bisheng-rt \
--shm-size=10G --name bisheng_rt_v004 ${MOUNT} $IMAGE ./bin/rtserver f
}
run_container
# Step 3. 模型服务上线
在“模型管理”页面，点击右上角“RT服务管理”按钮，注册该RT服务，并上线所需要的模型
扫一扫
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
