1. nvidia-docker安装
[参考链接](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html#docker)
2. 测试nvidia-docker是否安装成功
```shell
nvidia-docker run -it -v ~/dir/to/my/data:/data nvidia/cuda:9.0-base nvidia-smi
nvidia-docker run -it -v ~/:/data nvidia/cuda:10.2-base nvidia-smi
```
3. 运行docker容器
```
docker run -p 5000:5000 --gpus all --shm-size=8g -it -v /opt/ai-serv:/data ai-serv:latest
# -p 映射端口
# -gpus 指定使用的gpu
# 查看容器IP
docker inspect --format '{{ .NetworkSettings.IPAddress }}' a2371725fa5b
#运行服务
flask run -h 0.0.0.0 -p 5000
```
4. docker运行wrk
```shell
docker pull williamyeh/wrk
docker run -it --rm williamyeh/wrk -t12 -c400 -d30s http://0.0.0.0:5000/
```