docker container 指定gpu设备

最新推荐文章于 2024-05-28 18:26:12 发布

pkuyjxu

最新推荐文章于 2024-05-28 18:26:12 发布

阅读量880

点赞数 7

文章标签： docker 容器运维

本文链接：https://blog.csdn.net/pkuyjxu/article/details/135182818

版权

1，在yaml中 Turn on GPU access with Docker Compose | Docker Docs

Example of a Compose file for running a service with access to 1 GPU device:

services:
  test:
    image: nvidia/cuda:12.3.1-base-ubuntu20.04
    command: nvidia-smi
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: 1
              capabilities: [gpu]

Access specific devices

To allow access only to GPU-0 and GPU-3 devices:

services:
  test:
    image: tensorflow/tensorflow:latest-gpu
    command: python -c "import tensorflow as tf;tf.test.gpu_device_name()"
    deploy:
      resources:
        reservations:
          devices:
          - driver: nvidia
            device_ids: ['0', '3']
            capabilities: [gpu]

2，执行以下命令

docker run --rm -ti --gpus device=1 -p 8080:8080 -e DEBUG=true -e MODELS_PATH=/models -e THREADS=1 -v $PWD/models:/models quay.io/go-skynet/local-ai:master-cublas-cuda12