MindSpore配置记录

MindSpore 配置记录

CUDA 配置

CUDA有两个CUDA版本

• runtime api 使用nvcc -V显示
• driver api 使用nvidia-smi显示

对应深度学习中使用的GPU接口的则是runtime api。
问题预警：
有的时候nvcc -V该命令提示-bash: nvcc: command not found。
原因：
系统路径里缺少对cuda的说明。所以：

1. 查看是否有nvcc

cd /usr/local/cuda/bin

2. 存在则将其加入系统路径

#进入配置文件
vim ~/.bashrc
#添加以下两行
#在/.bashrc中配置LD_LIBRARY_PATH路径、配置PATH路径，完整配置如下：
export LD_LIBRARY_PATH=/usr/local/cuda/lib
export PATH=$PATH:/usr/local/cuda/bin

3. 更新系统路径

source ~/.bashrc

4. 此时再次使用nvcc -V 则可以显示runtime api版本。

Anaconda 创建新的虚拟python环境

Conda常用命令整理(列举已有环境\创建环境\进入环境)
最常用指令：
1 列举环境:conda env list
2 创建环境: conda create --name xxx python=3.7
3 激活环境: conda activate xxx
4 退出环境: conda deactivate xxx
说明: 其中xxx表示环境的名称.

问题一

执行conda create --na mdsp_python38 python=3.8 出现报错如下：

Traceback (most recent call last):
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/gateways/connection/session.py", line 50, in __call__
    return cls._thread_local.session
AttributeError: '_thread._local' object has no attribute 'session'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/exceptions.py", line 819, in __call__
    return func(*args, **kwargs)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/cli/main.py", line 78, in _main
    exit_code = do_call(args, p)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/cli/conda_argparse.py", line 77, in do_call
    exit_code = getattr(module, func_name)(args, parser)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/cli/main_create.py", line 11, in execute
    install(args, parser, 'create')
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/cli/install.py", line 235, in install
    force_reinstall=context.force,
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/core/solve.py", line 505, in solve_for_transaction
    force_remove, force_reinstall)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/core/solve.py", line 438, in solve_for_diff
    final_precs = self.solve_final_state(deps_modifier, prune, ignore_pinned, force_remove)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/core/solve.py", line 179, in solve_final_state
    index, r = self._prepare(prepared_specs)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/core/solve.py", line 560, in _prepare
    self.subdirs, prepared_specs)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/core/index.py", line 215, in get_reduced_index
    new_records = query_all(spec)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/core/index.py", line 184, in query_all
    return tuple(concat(future.result() for future in as_completed(futures)))
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/core/subdir_data.py", line 94, in query
    self.load()
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/core/subdir_data.py", line 148, in load
    _internal_state = self._load()
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/core/subdir_data.py", line 216, in _load
    mod_etag_headers.get('_mod'))
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/core/subdir_data.py", line 397, in fetch_repodata_remote_request
    session = CondaSession()
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/gateways/connection/session.py", line 52, in __call__
    session = cls._thread_local.session = super(CondaSessionType, cls).__call__()
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/gateways/connection/session.py", line 85, in __init__
    self.headers['User-Agent'] = context.user_agent
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/base/context.py", line 621, in user_agent
    return _get_user_agent(self.platform)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/_vendor/auxlib/decorators.py", line 56, in _memoized_func
    result = func(*args, **kwargs)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/base/context.py", line 918, in _get_user_agent
    from .._vendor.distro import linux_distribution
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/_vendor/distro.py", line 1084, in <module>
    _distro = LinuxDistribution()
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/_vendor/distro.py", line 600, in __init__
    if include_lsb else {}
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/_vendor/distro.py", line 943, in _get_lsb_release_info
    raise subprocess.CalledProcessError(code, cmd, stdout, stderr)
subprocess.CalledProcessError: Command 'lsb_release -a' returned non-zero exit status 1.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/anaconda3/bin/conda", line 11, in <module>
    sys.exit(main())
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/cli/main.py", line 113, in main
    return conda_exception_handler(_main, *args)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/exceptions.py", line 1112, in conda_exception_handler
    return_value = exception_handler(func, *args, **kwargs)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/exceptions.py", line 822, in __call__
    return self.handle_exception(exc_val, exc_tb)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/exceptions.py", line 864, in handle_exception
    return self.handle_unexpected_exception(exc_val, exc_tb)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/exceptions.py", line 880, in handle_unexpected_exception
    self._execute_upload(error_report)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/exceptions.py", line 1047, in _execute_upload
    'User-Agent': self.user_agent,
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/exceptions.py", line 837, in user_agent
    return context.user_agent
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/base/context.py", line 621, in user_agent
    return _get_user_agent(self.platform)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/_vendor/auxlib/decorators.py", line 56, in _memoized_func
    result = func(*args, **kwargs)
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/base/context.py", line 918, in _get_user_agent
    from .._vendor.distro import linux_distribution
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/_vendor/distro.py", line 1084, in <module>
    _distro = LinuxDistribution()
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/_vendor/distro.py", line 600, in __init__
    if include_lsb else {}
  File "/usr/local/anaconda3/lib/python3.6/site-packages/conda/_vendor/distro.py", line 943, in _get_lsb_release_info
    raise subprocess.CalledProcessError(code, cmd, stdout, stderr)
subprocess.CalledProcessError: Command 'lsb_release -a' returned non-zero exit status 1.

根据该博文，重新建立的python软连接。

ln -sf /usr/bin/python3.6 /usr/bin/python3
ln -sf /usr/bin/python3.6 /usr/bin/python

问题二

再次conda create --na mdsp_python38 python=3.8出现第二个报错。

(base) root@interactive85138:~# conda create -n mdsp_py38 python=3.8
Solving environment: failed

# >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<

`$ /usr/local/anaconda3/bin/conda create -n mdsp_py38 python=3.8`

  environment variables:
                 CIO_TEST=<not set>
        CONDA_DEFAULT_ENV=base
                CONDA_EXE=/usr/local/anaconda3/bin/conda
             CONDA_PREFIX=/usr/local/anaconda3
    CONDA_PROMPT_MODIFIER=(base)
         CONDA_PYTHON_EXE=/usr/local/anaconda3/bin/python
               CONDA_ROOT=/usr/local/anaconda3
              CONDA_SHLVL=1
                     PATH=/usr/local/anaconda3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr
                          /bin:/sbin:/bin
       REQUESTS_CA_BUNDLE=<not set>
            SSL_CERT_FILE=<not set>

     active environment : base
    active env location : /usr/local/anaconda3
            shell level : 1
       user config file : /root/.condarc
 populated config files : /root/.condarc
          conda version : 4.5.4
    conda-build version : 3.10.5
         python version : 3.6.5.final.0
       base environment : /usr/local/anaconda3  (writable)
           channel URLs : https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main/linux-64
                          https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main/noarch
                          https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/free/linux-64
                          https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/free/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/free/linux-64
                          https://repo.anaconda.com/pkgs/free/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
                          https://repo.anaconda.com/pkgs/pro/linux-64
                          https://repo.anaconda.com/pkgs/pro/noarch
          package cache : /usr/local/anaconda3/pkgs
                          /root/.conda/pkgs
       envs directories : /usr/local/anaconda3/envs
                          /root/.conda/envs
               platform : linux-64
             user-agent : conda/4.5.4 requests/2.18.4 CPython/3.6.5 Linux/4.4.0-116-generic ubuntu/18.04 glibc/2.27
                UID:GID : 0:0
             netrc file : None
           offline mode : False


V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V V

CondaHTTPError: HTTP 000 CONNECTION FAILED for url <https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/free/noarch/repodata.json>
Elapsed: -

An HTTP error occurred when trying to retrieve this URL.
HTTP errors are often intermittent, and a simple retry will get you on your way.
SSLError(MaxRetryError('HTTPSConnectionPool(host=\'mirrors.tuna.tsinghua.edu.cn\', port=443): Max retries exceeded with url: /anaconda/pkgs/free/noarch/repodata.json (Caused by SSLError(SSLError("bad handshake: Error([(\'SSL routines\', \'ssl3_get_server_certificate\', \'certificate verify failed\')],)",),))',),)

A reportable application error has occurred. Conda has prepared the above report.
If submitted, this report will be used by core maintainers to improve
future releases of conda.
Would you like conda to send this report to the core maintainers?
[y/N]: n

No report sent. To permanently opt-out, use

    $ conda config --set report_errors false

根据同一篇博文 ，关闭了SSL认证。

conda config --set ssl_verify false
conda clean -i

之后顺利创建了环境。