baselines五大bug：%run ppo.py，No module named ‘cupy‘

最新推荐文章于 2023-09-23 22:25:59 发布
hamimelon2020
最新推荐文章于 2023-09-23 22:25:59 发布
阅读量1.7k
点赞数
文章标签： cupy
本文链接：https://blog.csdn.net/weixin_40945354/article/details/107985169
版权
在运行ppo.py文件时遇到了一个常见的错误：'No module named 'cupy''。该错误表明系统中缺少了CuPy库，这是一个用于GPU加速的Python库，通常在深度学习和计算密集型任务中使用。为了解决这个问题，你需要首先安装CuPy，可以使用pip install cupy来添加缺失的模块到你的Python环境中。
摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >
Jupyter Notebook

代码
%run ppo.py
%run ppo.py
/Users//opt/anaconda3/lib/python3.7/site-packages/gym-0.17.2-py3.7.egg/gym/logger.py:30: UserWarning: WARN: Box bound precision lowered by casting to float32
  warnings.warn(colorize('%s: %s'%('WARN', msg % args), 'yellow'))
INFO     - 2020-08-12 21:24:42,045 - [__main__ main 101] Output files are saved in results/20200812T212441.967897
INFO     - 2020-08-12 21:24:42,046 - [utils log_versions 9] 3.7.4 (default, Aug 13 2019, 15:17:50) 
[Clang 4.0.1 (tags/RELEASE_401/final)]
WARNING  - 2020-08-12 21:24:42,049 - [pip._internal.operations.freeze freeze 75] Could not generate requirement for distribution -ip 20.2 (/Users//opt/anaconda3/lib/python3.7/site-packages): Parse error at "'-ip==20.'": Expected W:(abcd...)
WARNING  - 2020-08-12 21:24:42,052 - [pip._internal.operations.freeze freeze 75] Could not generate requirement for distribution -graph 0.1.11 (/Users//opt/anaconda3/lib/python3.7/site-packages): Parse error at "'-graph=='": Expected W:(abcd...)
WARNING  - 2020-08-12 21:24:42,054 - [pip._internal.operations.freeze freeze 75] Could not generate requirement for distribution - p (/Users//opt/anaconda3/lib/python3.7/site-packages): Parse error at "'-===p'": Expected W:(abcd...)
INFO     - 2020-08-12 21:24:42,281 - [utils log_versions 10] absl-py==0.9.0,alabaster==0.7.12,anaconda-client==1.7.2,anaconda-navigator==1.9.7,anaconda-project==0.8.3,appnope==0.1.0,appscript==1.0.1,ase==3.19.2,asn1crypto==1.0.1,astroid==2.3.1,astropy==3.2.2,astunparse==1.6.3,atari-py==0.2.6,atomicwrites==1.3.0,attrs==19.2.0,Babel==2.7.0,backcall==0.1.0,backports.functools-lru-cache==1.5,backports.os==0.1.1,backports.shutil-get-terminal-size==1.0.0,backports.tempfile==1.0,backports.weakref==1.0.post1,baselines==0.1.6,beautifulsoup4==4.8.0,bert==2.2.0,bert-pytorch==0.0.1a4,bitarray==1.0.1,bkcharts==0.2,bleach==3.1.0,bokeh==1.3.4,boto==2.49.0,boto3==1.14.25,botocore==1.17.25,Bottleneck==1.2.1,cached-property==1.5.1,cachetools==4.1.1,certifi==2019.9.11,cffi==1.12.3,chainer==7.7.0,chainerrl==0.8.0,chardet==3.0.4,Click==7.0,cloudpickle==1.2.2,clyent==1.2.2,colorama==0.4.1,coloredlogs==14.0,conda==4.7.12,conda-build==3.18.9,conda-package-handling==1.6.0,conda-verify==3.4.2,contextlib2==0.6.0,crowdai-api==0.1.22,cryptography==2.7,cycler==0.10.0,Cython==0.29.13,cytoolz==0.10.0,dask==2.5.2,decorator==4.4.0,defusedxml==0.6.0,dill==0.3.2,distributed==2.5.2,docutils==0.15.2,entrypoints==0.3,erlastic==2.0.0,et-xmlfile==1.0.1,fastcache==1.1.0,filelock==3.0.12,fire==0.3.1,Flask==1.1.1,fsspec==0.5.2,future==0.18.2,fuzzywuzzy==0.18.0,gast==0.3.3,gcn==1.0,geometric==0.9.7.2,getch==1.0,gevent==1.4.0,glob2==0.7,gmpy2==2.0.8,google-auth==1.19.2,google-auth-oauthlib==0.4.1,google-pasta==0.2.0,googledrivedownloader==0.3,greenlet==0.4.15,grpcio==1.30.0,# Editable install with no version control (gym==0.17.2)
-e /Users//opt/anaconda3/lib/python3.7/site-packages/gym-0.17.2-py3.7.egg,h5py==2.10.0,HeapDict==1.0.1,html5lib==1.0.1,humanfriendly==8.2,idna==2.8,igraph==0.1.11,imageio==2.6.0,imagesize==1.1.0,importlib-metadata==0.23,install==1.3.3,ipykernel==5.1.2,ipython==7.8.0,ipython-genutils==0.2.0,ipywidgets==7.5.1,isodate==0.6.0,isort==4.3.21,itsdangerous==1.1.0,jdcal==1.4.1,jedi==0.15.1,Jinja2==2.10.3,jmespath==0.10.0,joblib==0.13.2,json5==0.8.5,jsonschema==3.0.2,jupyter==1.0.0,jupyter-client==5.3.3,jupyter-console==6.0.0,jupyter-core==4.5.0,jupyterlab==1.1.4,jupyterlab-server==1.0.6,Keras-Preprocessing==1.1.2,keyring==18.0.0,kiwisolver==1.1.0,lazy-object-proxy==1.4.2,libarchive-c==2.8,lief==0.9.0,llvmlite==0.29.0,locket==0.2.0,lxml==4.4.1,Markdown==3.2.2,MarkupSafe==1.1.1,matplotlib==3.0.3,mccabe==0.6.1,minerl==0.3.6,mistune==0.8.4,mkl-fft==1.0.14,mkl-random==1.1.0,mkl-service==2.3.0,mock==3.0.5,more-itertools==7.2.0,mpmath==1.1.0,msgpack==0.6.1,multipledispatch==0.6.0,navigator-updater==0.2.1,nbconvert==5.6.0,nbformat==4.4.0,networkx==2.3,nltk==3.4.5,nose==1.3.7,notebook==6.0.1,numba==0.45.1,numexpr==2.7.0,numpy==1.17.2,numpydoc==0.9.1,oauthlib==3.1.0,olefile==0.46,opencv-python==4.3.0.36,openpyxl==3.0.0,opt-einsum==3.3.0,packaging==19.2,pandas==0.25.1,pandocfilters==1.4.2,parso==0.5.1,partd==1.0.0,path.py==12.0.1,pathlib2==2.3.5,patsy==0.5.1,pep8==1.7.1,pexpect==4.7.0,pickleshare==0.7.5,Pillow==6.2.0,pip==20.2,pkginfo==1.5.0.1,pluggy==0.13.0,ply==3.11,prometheus-client==0.7.1,prompt-toolkit==2.0.10,protobuf==3.12.2,psutil==5.6.3,ptyprocess==0.6.0,py==1.8.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycodestyle==2.5.0,pycosat==0.6.3,pycparser==2.19,pycrypto==2.6.1,pycurl==7.43.0.3,pyflakes==2.1.1,pyglet==1.2.4,Pygments==2.4.2,pylint==2.4.2,pyodbc==4.0.27,pyOpenSSL==19.0.0,pyparsing==2.4.2,Pyro4==4.80,pyrsistent==0.15.4,PySocks==1.7.1,pytest==5.2.1,pytest-arraydiff==0.3,pytest-astropy==0.5.0,pytest-doctestplus==0.4.0,pytest-openfiles==0.4.0,pytest-remotedata==0.3.2,python-dateutil==2.8.0,python-gitlab==2.4.0,python-igraph==0.8.2,pytorch-pretrained-bert==0.6.2,pytz==2019.3,PyWavelets==1.0.3,PyYAML==5.1.2,pyzmq==18.1.0,QtAwesome==0.6.0,qtconsole==4.5.5,QtPy==1.9.0,rdflib==5.0.0,redis==3.5.3,regex==2020.7.14,requests==2.22.0,requests-oauthlib==1.3.0,rope==0.14.0,rsa==4.6,ruamel-yaml==0.15.46,s3transfer==0.3.3,scikit-image==0.15.0,scikit-learn==0.21.3,scipy==1.4.1,seaborn==0.9.0,Send2Trash==1.5.0,serpent==1.30.2,setuptools==41.4.0,simplegeneric==0.8.1,singledispatch==3.4.0.3,six==1.12.0,snowballstemmer==2.0.0,sortedcollections==1.1.2,sortedcontainers==2.1.0,soupsieve==1.9.3,Sphinx==2.2.0,sphinxcontrib-applehelp==1.0.1,sphinxcontrib-devhelp==1.0.1,sphinxcontrib-htmlhelp==1.0.2,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.2,sphinxcontrib-serializinghtml==1.1.3,sphinxcontrib-websupport==1.1.2,spyder==3.3.6,spyder-kernels==0.5.2,SQLAlchemy==1.3.9,statsmodels==0.10.1,sympy==1.4,tables==3.5.2,tblib==1.4.0,tensorboard==2.3.0,tensorboard-logger==0.1.0,tensorboard-plugin-wit==1.7.0,tensorboardX==2.1,tensorflow==2.3.0,tensorflow-estimator==2.3.0,termcolor==1.1.0,terminado==0.8.2,testpath==0.4.2,texttable==1.6.2,toolz==0.10.0,torch==0.4.1,torch-geometric==1.6.0,torch-sparse @ file:///Users//torch_sparse-0.6.6%2Bcpu-cp37-cp37m-macosx_10_9_x86_64.whl,torchvision==0.4.2,tornado==6.0.3,tqdm==4.36.1,traitlets==4.3.3,typing==3.7.4.3,typing-extensions==3.7.4.2,ujson==3.0.0,unicodecsv==0.14.1,urllib3==1.24.2,wcwidth==0.1.7,webencodings==0.5.1,Werkzeug==0.16.0,wget==3.2,wheel==0.33.6,widgetsnbextension==3.5.1,wrapt==1.11.2,wurlitzer==1.0.3,xlrd==1.2.0,XlsxWriter==1.2.1,xlwings==0.15.10,xlwt==1.3.0,zict==1.0.0,zipp==0.6.0
INFO     - 2020-08-12 21:24:42,282 - [__main__ _main 113] The first `gym.make(MineRL*)` may take several minutes. Be patient!
INFO     - 2020-08-12 21:24:42,493 - [minerl.env.malmo.instance.b504cd _launch_minecraft 671] Starting Minecraft process: ['/var/folders/l9/kpwnx6f551d69kvflqcjbnsr0000gn/T/tmphouxxj_7/Minecraft/launchClient.sh', '-port', '9826', '-env', '-runDir', '/var/folders/l9/kpwnx6f551d69kvflqcjbnsr0000gn/T/tmphouxxj_7/Minecraft/run']
INFO     - 2020-08-12 21:24:42,506 - [minerl.env.malmo.instance.b504cd _launch_process_watcher 694] Starting process watcher for process 2419 @ localhost:9826
INFO     - 2020-08-12 21:25:49,013 - [minerl.env.malmo.instance.b504cd launch 533] Minecraft process ready
INFO     - 2020-08-12 21:25:49,019 - [minerl.env.malmo log_to_file 548] Logging output of Minecraft to results/20200812T212441.967897/logs/mc_826.log
INFO     - 2020-08-12 21:25:49,025 - [__main__ wrap_env 127] Detected `gym.wrappers.TimeLimit`! Unwrap it and re-wrap our own time limit.
INFO     - 2020-08-12 21:25:49,028 - [env_wrappers __init__ 481] always pressing keys: []
INFO     - 2020-08-12 21:25:49,032 - [env_wrappers __init__ 487] reversed pressing keys: []
INFO     - 2020-08-12 21:25:49,033 - [env_wrappers __init__ 492] always ignored keys: []
INFO     - 2020-08-12 21:25:49,039 - [env_wrappers __init__ 545] Dict(attack:Discrete(2), back:Discrete(2), camera:Box(low=-180.0, high=180.0, shape=(2,)), forward:Discrete(2), jump:Discrete(2), left:Discrete(2), right:Discrete(2), sneak:Discrete(2), sprint:Discrete(2)) is converted to Discrete(11).
INFO     - 2020-08-12 21:25:49,055 - [__main__ wrap_env 127] Detected `gym.wrappers.TimeLimit`! Unwrap it and re-wrap our own time limit.
INFO     - 2020-08-12 21:25:49,069 - [env_wrappers __init__ 481] always pressing keys: []
INFO     - 2020-08-12 21:25:49,073 - [env_wrappers __init__ 487] reversed pressing keys: []
INFO     - 2020-08-12 21:25:49,083 - [env_wrappers __init__ 492] always ignored keys: []
INFO     - 2020-08-12 21:25:49,090 - [env_wrappers __init__ 545] Dict(attack:Discrete(2), back:Discrete(2), camera:Box(low=-180.0, high=180.0, shape=(2,)), forward:Discrete(2), jump:Discrete(2), left:Discrete(2), right:Discrete(2), sneak:Discrete(2), sprint:Discrete(2)) is converted to Discrete(11).
ERROR    - 2020-08-12 21:25:49,283 - [__main__ main 108] execution failed.
Traceback (most recent call last):
  File "/Users//baselines/general/chainerrl/baselines/ppo.py", line 106, in main
    _main(args)
  File "/Users//baselines/general/chainerrl/baselines/ppo.py", line 204, in _main
    minibatch_size=32, epochs=args.epochs, clip_eps=CLIP_EPS, standardize_advantages=args.standardize_advantages)
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/chainerrl/agents/ppo.py", line 321, in __init__
    cuda.get_device_from_id(gpu).use()
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/chainer/backends/cuda.py", line 279, in get_device_from_id
    check_cuda_available()
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/chainer/backends/cuda.py", line 142, in check_cuda_available
    raise RuntimeError(msg)
RuntimeError: CUDA environment is not correctly set up
(see https://github.com/chainer/chainer#installation).No module named 'cupy'
---------------------------------------------------------------------------
RuntimeError                              Traceback (most recent call last)
~/baselines/general/chainerrl/baselines/ppo.py in <module>
    239 
    240 if __name__ == '__main__':
--> 241     main()

~/baselines/general/chainerrl/baselines/ppo.py in main()
    104 
    105     try:
--> 106         _main(args)
    107     except:  # noqa
    108         logger.exception('execution failed.')

~/baselines/general/chainerrl/baselines/ppo.py in _main(args)
    202     agent = chainerrl.agents.ppo.PPO(
    203         model, opt, gpu=args.gpu, gamma=args.gamma, phi=phi, update_interval=args.update_interval,
--> 204         minibatch_size=32, epochs=args.epochs, clip_eps=CLIP_EPS, standardize_advantages=args.standardize_advantages)
    205     if args.load:
    206         agent.load(args.load)

~/opt/anaconda3/lib/python3.7/site-packages/chainerrl/agents/ppo.py in __init__(self, model, optimizer, obs_normalizer, gpu, gamma, lambd, phi, value_func_coef, entropy_coef, update_interval, minibatch_size, epochs, clip_eps, clip_eps_vf, standardize_advantages, batch_states, recurrent, max_recurrent_sequence_len, act_deterministically, value_stats_window, entropy_stats_window, value_loss_stats_window, policy_loss_stats_window)
    319 
    320         if gpu is not None and gpu >= 0:
--> 321             cuda.get_device_from_id(gpu).use()
    322             self.model.to_gpu(device=gpu)
    323             if self.obs_normalizer is not None:

~/opt/anaconda3/lib/python3.7/site-packages/chainer/backends/cuda.py in get_device_from_id(device_id)
    277     if device_id is not None:
    278         if device_id >= 0:
--> 279             check_cuda_available()
    280             return Device(int(device_id))
    281     return DummyDevice

~/opt/anaconda3/lib/python3.7/site-packages/chainer/backends/cuda.py in check_cuda_available()
    140                '(see https://github.com/chainer/chainer#installation).')
    141         msg += str(_resolution_error)
--> 142         raise RuntimeError(msg)
    143     if (not cudnn_enabled and
    144             not _cudnn_disabled_by_user and

RuntimeError: CUDA environment is not correctly set up
(see https://github.com/chainer/chainer#installation).No module named 'cupy'

install cupy
pip install cupy
Collecting cupy
  Downloading cupy-7.7.0.tar.gz (3.7 MB)
     |▍                               | 51 kB 3.1 kB/s eta 0:19:28ERROR: Exception:
Traceback (most recent call last):
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 437, in _error_catcher
    yield
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 519, in read
    data = self._fp.read(amt) if not fp_closed else b""
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 62, in read
    data = self.__fp.read(amt)
  File "/Users//opt/anaconda3/lib/python3.7/http/client.py", line 457, in read
    n = self.readinto(b)
  File "/Users//opt/anaconda3/lib/python3.7/http/client.py", line 501, in readinto
    n = self.fp.readinto(b)
  File "/Users//opt/anaconda3/lib/python3.7/socket.py", line 589, in readinto
    return self._sock.recv_into(b)
  File "/Users//opt/anaconda3/lib/python3.7/ssl.py", line 1071, in recv_into
    return self.read(nbytes, buffer)
  File "/Users//opt/anaconda3/lib/python3.7/ssl.py", line 929, in read
    return self._sslobj.read(len, buffer)
socket.timeout: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 216, in _main
    status = self.run(options, args)
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 182, in wrapper
    return func(self, options, args)
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 325, in run
    reqs, check_supported_wheels=not options.target_dir
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 183, in resolve
    discovered_reqs.extend(self._resolve_one(requirement_set, req))
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 388, in _resolve_one
    abstract_dist = self._get_abstract_dist_for(req_to_install)
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 340, in _get_abstract_dist_for
    abstract_dist = self.preparer.prepare_linked_requirement(req)
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 469, in prepare_linked_requirement
    hashes=self._get_linked_req_hashes(req)
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 259, in unpack_url
    hashes=hashes,
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 130, in get_http_url
    link, downloader, temp_dir.path, hashes
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 282, in _download_http_url
    for chunk in download.chunks:
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_internal/cli/progress_bars.py", line 168, in iter
    for x in it:
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_internal/network/utils.py", line 88, in response_chunks
    decode_content=False,
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 576, in stream
    data = self.read(amt=amt, decode_content=decode_content)
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 541, in read
    raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
  File "/Users//opt/anaconda3/lib/python3.7/contextlib.py", line 130, in __exit__
    self.gen.throw(type, value, traceback)
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 442, in _error_catcher
    raise ReadTimeoutError(self._pool, None, "Read timed out.")
pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out.
WARNING: You are using pip version 20.2; however, version 20.2.1 is available.
You should consider upgrading via the '/Users//opt/anaconda3/bin/python -m pip install --upgrade pip' command.
Note: you may need to restart the kernel to use updated packages.
conda 
conda install cupy
Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.

PackagesNotFoundError: The following packages are not available from current channels:

  - cupy

Current channels:

  - https://repo.anaconda.com/pkgs/main/osx-64
  - https://repo.anaconda.com/pkgs/main/noarch
  - https://repo.anaconda.com/pkgs/r/osx-64
  - https://repo.anaconda.com/pkgs/r/noarch

To search for alternate channels that may provide the conda package you're
looking for, navigate to

    https://anaconda.org

and use the search bar at the top of the page.



Note: you may need to restart the kernel to use updated packages.
%run 
%run gail.py
usage: gail.py [-h]
               [--env {MineRLTreechop-v0,MineRLNavigate-v0,MineRLNavigateDense-v0,MineRLNavigateExtreme-v0,MineRLNavigateExtremeDense-v0,MineRLObtainIronPickaxe-v0,MineRLObtainDiamond-v0,MineRLObtainIronPickaxeDense-v0,MineRLObtainDiamondDense-v0,MineRLNavigateDenseFixed-v0}]
               [--outdir OUTDIR] --expert EXPERT [--seed SEED] [--gpu GPU]
               [--demo] [--load LOAD] [--eval-n-runs EVAL_N_RUNS]
               [--logging-level LOGGING_LEVEL] [--gray-scale] [--monitor]
               [--frame-stack FRAME_STACK] [--frame-skip FRAME_SKIP]
               [--gamma GAMMA] [--always-keys [ALWAYS_KEYS [ALWAYS_KEYS ...]]]
               [--reverse-keys [REVERSE_KEYS [REVERSE_KEYS ...]]]
               [--exclude-keys [EXCLUDE_KEYS [EXCLUDE_KEYS ...]]]
               [--exclude-noop]
               [--action-wrapper {discrete,continuous,multi-dimensional-softmax}]
               [--max-camera-range MAX_CAMERA_RANGE]
               [--num-camera-discretize NUM_CAMERA_DISCRETIZE]
               [--activation-function {sigmoid,tanh,relu,leaky-relu}]
               [--prioritized-elements PRIORITIZED_ELEMENTS [PRIORITIZED_ELEMENTS ...]]
               [--policy {trpo,ppo}] [--discriminator-lr DISCRIMINATOR_LR]
               [--policy-lr POLICY_LR]
               [--policy-update-interval POLICY_UPDATE_INTERVAL]
               [--policy-minibatch-size POLICY_MINIBATCH_SIZE]
               [--discriminator-update-interval DISCRIMINATOR_UPDATE_INTERVAL]
               [--discriminator-minibatch-size DISCRIMINATOR_MINIBATCH_SIZE]
               [--policy-entropy-coef POLICY_ENTROPY_COEF]
               [--initial-var-param INITIAL_VAR_PARAM]
               [--discriminator-entropy-coef DISCRIMINATOR_ENTROPY_COEF]
               [--original-reward-weight ORIGINAL_REWARD_WEIGHT] [--pretrain]
gail.py: error: the following arguments are required: --expert
An exception has occurred, use %tb to see the full traceback.

SystemExit: 2


%run 
%run train_dqfd.py
---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
~/baselines/general/chainerrl/baselines/train_dqfd.py in <module>
     28 from chainerrl import experiments, explorers
     29 from chainerrl.experiments.evaluator import Evaluator
---> 30 from dqfd import DQfD, PrioritizedDemoReplayBuffer
     31 
     32 from q_functions import CNNBranchingQFunction

~/baselines/general/chainerrl/baselines/dqfd.py in <module>
     26 
     27 from chainerrl.misc.batch_states import batch_states
---> 28 from chainerrl.replay_buffer import PrioritizedBuffer, PrioritizedReplayBuffer
     29 
     30 

ImportError: cannot import name 'PrioritizedBuffer' from 'chainerrl.replay_buffer' (/Users//opt/anaconda3/lib/python3.7/site-packages/chainerrl/replay_buffer.py)

%run behavioral_cloning.py
%run behavioral_cloning.py
usage: behavioral_cloning.py [-h]
                             [--env {MineRLTreechop-v0,MineRLNavigate-v0,MineRLNavigateDense-v0,MineRLNavigateExtreme-v0,MineRLNavigateExtremeDense-v0,MineRLObtainIronPickaxe-v0,MineRLObtainDiamond-v0,MineRLObtainIronPickaxeDense-v0,MineRLObtainDiamondDense-v0,MineRLNavigateDenseFixed-v0}]
                             [--outdir OUTDIR] --expert EXPERT [--seed SEED]
                             [--gpu GPU] [--demo] [--load LOAD]
                             [--eval-n-runs EVAL_N_RUNS]
                             [--logging-level LOGGING_LEVEL] [--gray-scale]
                             [--monitor] [--lr LR] [--frame-stack FRAME_STACK]
                             [--frame-skip FRAME_SKIP]
                             [--always-keys [ALWAYS_KEYS [ALWAYS_KEYS ...]]]
                             [--reverse-keys [REVERSE_KEYS [REVERSE_KEYS ...]]]
                             [--exclude-keys [EXCLUDE_KEYS [EXCLUDE_KEYS ...]]]
                             [--exclude-noop]
                             [--action-wrapper {discrete,continuous,multi-dimensional-softmax}]
                             [--activation-function {sigmoid,tanh,relu,leaky-relu}]
                             [--prioritized-elements PRIORITIZED_ELEMENTS [PRIORITIZED_ELEMENTS ...]]
                             [--entropy-coef ENTROPY_COEF] [--allow-pitch]
                             [--max-camera-range MAX_CAMERA_RANGE]
                             [--num-camera-discretize NUM_CAMERA_DISCRETIZE]
                             [--training-dataset-ratio TRAINING_DATASET_RATIO]
behavioral_cloning.py: error: the following arguments are required: --expert
An exception has occurred, use %tb to see the full traceback.

SystemExit: 2


%run 
%run dqfd.py
---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
~/baselines/general/chainerrl/baselines/dqfd.py in <module>
     26 
     27 from chainerrl.misc.batch_states import batch_states
---> 28 from chainerrl.replay_buffer import PrioritizedBuffer, PrioritizedReplayBuffer
     29 
     30 

ImportError: cannot import name 'PrioritizedBuffer' from 'chainerrl.replay_buffer' (/Users//opt/anaconda3/lib/python3.7/site-packages/chainerrl/replay_buffer.py)

%run 
%run dqn_family.py
INFO     - 2020-08-12 21:35:24,154 - [__main__ main 105] Output files are saved in results/20200812T213524.057725
INFO     - 2020-08-12 21:35:24,154 - [__main__ main 105] Output files are saved in results/20200812T213524.057725
INFO     - 2020-08-12 21:35:24,156 - [utils log_versions 9] 3.7.4 (default, Aug 13 2019, 15:17:50) 
[Clang 4.0.1 (tags/RELEASE_401/final)]
INFO     - 2020-08-12 21:35:24,156 - [utils log_versions 9] 3.7.4 (default, Aug 13 2019, 15:17:50) 
[Clang 4.0.1 (tags/RELEASE_401/final)]
WARNING  - 2020-08-12 21:35:24,160 - [pip._internal.operations.freeze freeze 75] Could not generate requirement for distribution -ip 20.2 (/Users//opt/anaconda3/lib/python3.7/site-packages): Parse error at "'-ip==20.'": Expected W:(abcd...)
WARNING  - 2020-08-12 21:35:24,160 - [pip._internal.operations.freeze freeze 75] Could not generate requirement for distribution -ip 20.2 (/Users//opt/anaconda3/lib/python3.7/site-packages): Parse error at "'-ip==20.'": Expected W:(abcd...)
WARNING  - 2020-08-12 21:35:24,163 - [pip._internal.operations.freeze freeze 75] Could not generate requirement for distribution -graph 0.1.11 (/Users//opt/anaconda3/lib/python3.7/site-packages): Parse error at "'-graph=='": Expected W:(abcd...)
WARNING  - 2020-08-12 21:35:24,163 - [pip._internal.operations.freeze freeze 75] Could not generate requirement for distribution -graph 0.1.11 (/Users//opt/anaconda3/lib/python3.7/site-packages): Parse error at "'-graph=='": Expected W:(abcd...)
WARNING  - 2020-08-12 21:35:24,172 - [pip._internal.operations.freeze freeze 75] Could not generate requirement for distribution - p (/Users//opt/anaconda3/lib/python3.7/site-packages): Parse error at "'-===p'": Expected W:(abcd...)
WARNING  - 2020-08-12 21:35:24,172 - [pip._internal.operations.freeze freeze 75] Could not generate requirement for distribution - p (/Users//opt/anaconda3/lib/python3.7/site-packages): Parse error at "'-===p'": Expected W:(abcd...)
INFO     - 2020-08-12 21:35:24,386 - [utils log_versions 10] absl-py==0.9.0,alabaster==0.7.12,anaconda-client==1.7.2,anaconda-navigator==1.9.7,anaconda-project==0.8.3,appnope==0.1.0,appscript==1.0.1,ase==3.19.2,asn1crypto==1.0.1,astroid==2.3.1,astropy==3.2.2,astunparse==1.6.3,atari-py==0.2.6,atomicwrites==1.3.0,attrs==19.2.0,Babel==2.7.0,backcall==0.1.0,backports.functools-lru-cache==1.5,backports.os==0.1.1,backports.shutil-get-terminal-size==1.0.0,backports.tempfile==1.0,backports.weakref==1.0.post1,baselines==0.1.6,beautifulsoup4==4.8.0,bert==2.2.0,bert-pytorch==0.0.1a4,bitarray==1.0.1,bkcharts==0.2,bleach==3.1.0,bokeh==1.3.4,boto==2.49.0,boto3==1.14.25,botocore==1.17.25,Bottleneck==1.2.1,cached-property==1.5.1,cachetools==4.1.1,certifi==2019.9.11,cffi==1.12.3,chainer==7.7.0,chainerrl==0.8.0,chardet==3.0.4,Click==7.0,cloudpickle==1.2.2,clyent==1.2.2,colorama==0.4.1,coloredlogs==14.0,conda==4.7.12,conda-build==3.18.9,conda-package-handling==1.6.0,conda-verify==3.4.2,contextlib2==0.6.0,crowdai-api==0.1.22,cryptography==2.7,cycler==0.10.0,Cython==0.29.13,cytoolz==0.10.0,dask==2.5.2,decorator==4.4.0,defusedxml==0.6.0,dill==0.3.2,distributed==2.5.2,docutils==0.15.2,entrypoints==0.3,erlastic==2.0.0,et-xmlfile==1.0.1,fastcache==1.1.0,filelock==3.0.12,fire==0.3.1,Flask==1.1.1,fsspec==0.5.2,future==0.18.2,fuzzywuzzy==0.18.0,gast==0.3.3,gcn==1.0,geometric==0.9.7.2,getch==1.0,gevent==1.4.0,glob2==0.7,gmpy2==2.0.8,google-auth==1.19.2,google-auth-oauthlib==0.4.1,google-pasta==0.2.0,googledrivedownloader==0.3,greenlet==0.4.15,grpcio==1.30.0,# Editable install with no version control (gym==0.17.2)
-e /Users//opt/anaconda3/lib/python3.7/site-packages/gym-0.17.2-py3.7.egg,h5py==2.10.0,HeapDict==1.0.1,html5lib==1.0.1,humanfriendly==8.2,idna==2.8,igraph==0.1.11,imageio==2.6.0,imagesize==1.1.0,importlib-metadata==0.23,install==1.3.3,ipykernel==5.1.2,ipython==7.8.0,ipython-genutils==0.2.0,ipywidgets==7.5.1,isodate==0.6.0,isort==4.3.21,itsdangerous==1.1.0,jdcal==1.4.1,jedi==0.15.1,Jinja2==2.10.3,jmespath==0.10.0,joblib==0.13.2,json5==0.8.5,jsonschema==3.0.2,jupyter==1.0.0,jupyter-client==5.3.3,jupyter-console==6.0.0,jupyter-core==4.5.0,jupyterlab==1.1.4,jupyterlab-server==1.0.6,Keras-Preprocessing==1.1.2,keyring==18.0.0,kiwisolver==1.1.0,lazy-object-proxy==1.4.2,libarchive-c==2.8,lief==0.9.0,llvmlite==0.29.0,locket==0.2.0,lxml==4.4.1,Markdown==3.2.2,MarkupSafe==1.1.1,matplotlib==3.0.3,mccabe==0.6.1,minerl==0.3.6,mistune==0.8.4,mkl-fft==1.0.14,mkl-random==1.1.0,mkl-service==2.3.0,mock==3.0.5,more-itertools==7.2.0,mpmath==1.1.0,msgpack==0.6.1,multipledispatch==0.6.0,navigator-updater==0.2.1,nbconvert==5.6.0,nbformat==4.4.0,networkx==2.3,nltk==3.4.5,nose==1.3.7,notebook==6.0.1,numba==0.45.1,numexpr==2.7.0,numpy==1.17.2,numpydoc==0.9.1,oauthlib==3.1.0,olefile==0.46,opencv-python==4.3.0.36,openpyxl==3.0.0,opt-einsum==3.3.0,packaging==19.2,pandas==0.25.1,pandocfilters==1.4.2,parso==0.5.1,partd==1.0.0,path.py==12.0.1,pathlib2==2.3.5,patsy==0.5.1,pep8==1.7.1,pexpect==4.7.0,pickleshare==0.7.5,Pillow==6.2.0,pip==20.2,pkginfo==1.5.0.1,pluggy==0.13.0,ply==3.11,prometheus-client==0.7.1,prompt-toolkit==2.0.10,protobuf==3.12.2,psutil==5.6.3,ptyprocess==0.6.0,py==1.8.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycodestyle==2.5.0,pycosat==0.6.3,pycparser==2.19,pycrypto==2.6.1,pycurl==7.43.0.3,pyflakes==2.1.1,pyglet==1.2.4,Pygments==2.4.2,pylint==2.4.2,pyodbc==4.0.27,pyOpenSSL==19.0.0,pyparsing==2.4.2,Pyro4==4.80,pyrsistent==0.15.4,PySocks==1.7.1,pytest==5.2.1,pytest-arraydiff==0.3,pytest-astropy==0.5.0,pytest-doctestplus==0.4.0,pytest-openfiles==0.4.0,pytest-remotedata==0.3.2,python-dateutil==2.8.0,python-gitlab==2.4.0,python-igraph==0.8.2,pytorch-pretrained-bert==0.6.2,pytz==2019.3,PyWavelets==1.0.3,PyYAML==5.1.2,pyzmq==18.1.0,QtAwesome==0.6.0,qtconsole==4.5.5,QtPy==1.9.0,rdflib==5.0.0,redis==3.5.3,regex==2020.7.14,requests==2.22.0,requests-oauthlib==1.3.0,rope==0.14.0,rsa==4.6,ruamel-yaml==0.15.46,s3transfer==0.3.3,scikit-image==0.15.0,scikit-learn==0.21.3,scipy==1.4.1,seaborn==0.9.0,Send2Trash==1.5.0,serpent==1.30.2,setuptools==41.4.0,simplegeneric==0.8.1,singledispatch==3.4.0.3,six==1.12.0,snowballstemmer==2.0.0,sortedcollections==1.1.2,sortedcontainers==2.1.0,soupsieve==1.9.3,Sphinx==2.2.0,sphinxcontrib-applehelp==1.0.1,sphinxcontrib-devhelp==1.0.1,sphinxcontrib-htmlhelp==1.0.2,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.2,sphinxcontrib-serializinghtml==1.1.3,sphinxcontrib-websupport==1.1.2,spyder==3.3.6,spyder-kernels==0.5.2,SQLAlchemy==1.3.9,statsmodels==0.10.1,sympy==1.4,tables==3.5.2,tblib==1.4.0,tensorboard==2.3.0,tensorboard-logger==0.1.0,tensorboard-plugin-wit==1.7.0,tensorboardX==2.1,tensorflow==2.3.0,tensorflow-estimator==2.3.0,termcolor==1.1.0,terminado==0.8.2,testpath==0.4.2,texttable==1.6.2,toolz==0.10.0,torch==0.4.1,torch-geometric==1.6.0,torch-sparse @ file:///Users//torch_sparse-0.6.6%2Bcpu-cp37-cp37m-macosx_10_9_x86_64.whl,torchvision==0.4.2,tornado==6.0.3,tqdm==4.36.1,traitlets==4.3.3,typing==3.7.4.3,typing-extensions==3.7.4.2,ujson==3.0.0,unicodecsv==0.14.1,urllib3==1.24.2,wcwidth==0.1.7,webencodings==0.5.1,Werkzeug==0.16.0,wget==3.2,wheel==0.33.6,widgetsnbextension==3.5.1,wrapt==1.11.2,wurlitzer==1.0.3,xlrd==1.2.0,XlsxWriter==1.2.1,xlwings==0.15.10,xlwt==1.3.0,zict==1.0.0,zipp==0.6.0
INFO     - 2020-08-12 21:35:24,386 - [utils log_versions 10] absl-py==0.9.0,alabaster==0.7.12,anaconda-client==1.7.2,anaconda-navigator==1.9.7,anaconda-project==0.8.3,appnope==0.1.0,appscript==1.0.1,ase==3.19.2,asn1crypto==1.0.1,astroid==2.3.1,astropy==3.2.2,astunparse==1.6.3,atari-py==0.2.6,atomicwrites==1.3.0,attrs==19.2.0,Babel==2.7.0,backcall==0.1.0,backports.functools-lru-cache==1.5,backports.os==0.1.1,backports.shutil-get-terminal-size==1.0.0,backports.tempfile==1.0,backports.weakref==1.0.post1,baselines==0.1.6,beautifulsoup4==4.8.0,bert==2.2.0,bert-pytorch==0.0.1a4,bitarray==1.0.1,bkcharts==0.2,bleach==3.1.0,bokeh==1.3.4,boto==2.49.0,boto3==1.14.25,botocore==1.17.25,Bottleneck==1.2.1,cached-property==1.5.1,cachetools==4.1.1,certifi==2019.9.11,cffi==1.12.3,chainer==7.7.0,chainerrl==0.8.0,chardet==3.0.4,Click==7.0,cloudpickle==1.2.2,clyent==1.2.2,colorama==0.4.1,coloredlogs==14.0,conda==4.7.12,conda-build==3.18.9,conda-package-handling==1.6.0,conda-verify==3.4.2,contextlib2==0.6.0,crowdai-api==0.1.22,cryptography==2.7,cycler==0.10.0,Cython==0.29.13,cytoolz==0.10.0,dask==2.5.2,decorator==4.4.0,defusedxml==0.6.0,dill==0.3.2,distributed==2.5.2,docutils==0.15.2,entrypoints==0.3,erlastic==2.0.0,et-xmlfile==1.0.1,fastcache==1.1.0,filelock==3.0.12,fire==0.3.1,Flask==1.1.1,fsspec==0.5.2,future==0.18.2,fuzzywuzzy==0.18.0,gast==0.3.3,gcn==1.0,geometric==0.9.7.2,getch==1.0,gevent==1.4.0,glob2==0.7,gmpy2==2.0.8,google-auth==1.19.2,google-auth-oauthlib==0.4.1,google-pasta==0.2.0,googledrivedownloader==0.3,greenlet==0.4.15,grpcio==1.30.0,# Editable install with no version control (gym==0.17.2)
-e /Users//opt/anaconda3/lib/python3.7/site-packages/gym-0.17.2-py3.7.egg,h5py==2.10.0,HeapDict==1.0.1,html5lib==1.0.1,humanfriendly==8.2,idna==2.8,igraph==0.1.11,imageio==2.6.0,imagesize==1.1.0,importlib-metadata==0.23,install==1.3.3,ipykernel==5.1.2,ipython==7.8.0,ipython-genutils==0.2.0,ipywidgets==7.5.1,isodate==0.6.0,isort==4.3.21,itsdangerous==1.1.0,jdcal==1.4.1,jedi==0.15.1,Jinja2==2.10.3,jmespath==0.10.0,joblib==0.13.2,json5==0.8.5,jsonschema==3.0.2,jupyter==1.0.0,jupyter-client==5.3.3,jupyter-console==6.0.0,jupyter-core==4.5.0,jupyterlab==1.1.4,jupyterlab-server==1.0.6,Keras-Preprocessing==1.1.2,keyring==18.0.0,kiwisolver==1.1.0,lazy-object-proxy==1.4.2,libarchive-c==2.8,lief==0.9.0,llvmlite==0.29.0,locket==0.2.0,lxml==4.4.1,Markdown==3.2.2,MarkupSafe==1.1.1,matplotlib==3.0.3,mccabe==0.6.1,minerl==0.3.6,mistune==0.8.4,mkl-fft==1.0.14,mkl-random==1.1.0,mkl-service==2.3.0,mock==3.0.5,more-itertools==7.2.0,mpmath==1.1.0,msgpack==0.6.1,multipledispatch==0.6.0,navigator-updater==0.2.1,nbconvert==5.6.0,nbformat==4.4.0,networkx==2.3,nltk==3.4.5,nose==1.3.7,notebook==6.0.1,numba==0.45.1,numexpr==2.7.0,numpy==1.17.2,numpydoc==0.9.1,oauthlib==3.1.0,olefile==0.46,opencv-python==4.3.0.36,openpyxl==3.0.0,opt-einsum==3.3.0,packaging==19.2,pandas==0.25.1,pandocfilters==1.4.2,parso==0.5.1,partd==1.0.0,path.py==12.0.1,pathlib2==2.3.5,patsy==0.5.1,pep8==1.7.1,pexpect==4.7.0,pickleshare==0.7.5,Pillow==6.2.0,pip==20.2,pkginfo==1.5.0.1,pluggy==0.13.0,ply==3.11,prometheus-client==0.7.1,prompt-toolkit==2.0.10,protobuf==3.12.2,psutil==5.6.3,ptyprocess==0.6.0,py==1.8.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycodestyle==2.5.0,pycosat==0.6.3,pycparser==2.19,pycrypto==2.6.1,pycurl==7.43.0.3,pyflakes==2.1.1,pyglet==1.2.4,Pygments==2.4.2,pylint==2.4.2,pyodbc==4.0.27,pyOpenSSL==19.0.0,pyparsing==2.4.2,Pyro4==4.80,pyrsistent==0.15.4,PySocks==1.7.1,pytest==5.2.1,pytest-arraydiff==0.3,pytest-astropy==0.5.0,pytest-doctestplus==0.4.0,pytest-openfiles==0.4.0,pytest-remotedata==0.3.2,python-dateutil==2.8.0,python-gitlab==2.4.0,python-igraph==0.8.2,pytorch-pretrained-bert==0.6.2,pytz==2019.3,PyWavelets==1.0.3,PyYAML==5.1.2,pyzmq==18.1.0,QtAwesome==0.6.0,qtconsole==4.5.5,QtPy==1.9.0,rdflib==5.0.0,redis==3.5.3,regex==2020.7.14,requests==2.22.0,requests-oauthlib==1.3.0,rope==0.14.0,rsa==4.6,ruamel-yaml==0.15.46,s3transfer==0.3.3,scikit-image==0.15.0,scikit-learn==0.21.3,scipy==1.4.1,seaborn==0.9.0,Send2Trash==1.5.0,serpent==1.30.2,setuptools==41.4.0,simplegeneric==0.8.1,singledispatch==3.4.0.3,six==1.12.0,snowballstemmer==2.0.0,sortedcollections==1.1.2,sortedcontainers==2.1.0,soupsieve==1.9.3,Sphinx==2.2.0,sphinxcontrib-applehelp==1.0.1,sphinxcontrib-devhelp==1.0.1,sphinxcontrib-htmlhelp==1.0.2,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.2,sphinxcontrib-serializinghtml==1.1.3,sphinxcontrib-websupport==1.1.2,spyder==3.3.6,spyder-kernels==0.5.2,SQLAlchemy==1.3.9,statsmodels==0.10.1,sympy==1.4,tables==3.5.2,tblib==1.4.0,tensorboard==2.3.0,tensorboard-logger==0.1.0,tensorboard-plugin-wit==1.7.0,tensorboardX==2.1,tensorflow==2.3.0,tensorflow-estimator==2.3.0,termcolor==1.1.0,terminado==0.8.2,testpath==0.4.2,texttable==1.6.2,toolz==0.10.0,torch==0.4.1,torch-geometric==1.6.0,torch-sparse @ file:///Users//torch_sparse-0.6.6%2Bcpu-cp37-cp37m-macosx_10_9_x86_64.whl,torchvision==0.4.2,tornado==6.0.3,tqdm==4.36.1,traitlets==4.3.3,typing==3.7.4.3,typing-extensions==3.7.4.2,ujson==3.0.0,unicodecsv==0.14.1,urllib3==1.24.2,wcwidth==0.1.7,webencodings==0.5.1,Werkzeug==0.16.0,wget==3.2,wheel==0.33.6,widgetsnbextension==3.5.1,wrapt==1.11.2,wurlitzer==1.0.3,xlrd==1.2.0,XlsxWriter==1.2.1,xlwings==0.15.10,xlwt==1.3.0,zict==1.0.0,zipp==0.6.0
INFO     - 2020-08-12 21:35:24,388 - [__main__ _main 117] The first `gym.make(MineRL*)` may take several minutes. Be patient!
INFO     - 2020-08-12 21:35:24,388 - [__main__ _main 117] The first `gym.make(MineRL*)` may take several minutes. Be patient!
INFO     - 2020-08-12 21:35:24,660 - [minerl.env.malmo.instance.087e80 _launch_minecraft 671] Starting Minecraft process: ['/var/folders/l9/kpwnx6f551d69kvflqcjbnsr0000gn/T/tmp0x87o1dt/Minecraft/launchClient.sh', '-port', '9827', '-env', '-runDir', '/var/folders/l9/kpwnx6f551d69kvflqcjbnsr0000gn/T/tmp0x87o1dt/Minecraft/run']
INFO     - 2020-08-12 21:35:24,660 - [minerl.env.malmo.instance.087e80 _launch_minecraft 671] Starting Minecraft process: ['/var/folders/l9/kpwnx6f551d69kvflqcjbnsr0000gn/T/tmp0x87o1dt/Minecraft/launchClient.sh', '-port', '9827', '-env', '-runDir', '/var/folders/l9/kpwnx6f551d69kvflqcjbnsr0000gn/T/tmp0x87o1dt/Minecraft/run']
INFO     - 2020-08-12 21:35:24,670 - [minerl.env.malmo.instance.087e80 _launch_process_watcher 694] Starting process watcher for process 2606 @ localhost:9827
INFO     - 2020-08-12 21:35:24,670 - [minerl.env.malmo.instance.087e80 _launch_process_watcher 694] Starting process watcher for process 2606 @ localhost:9827
INFO     - 2020-08-12 21:36:40,749 - [minerl.env.malmo.instance.087e80 launch 533] Minecraft process ready
INFO     - 2020-08-12 21:36:40,749 - [minerl.env.malmo.instance.087e80 launch 533] Minecraft process ready
INFO     - 2020-08-12 21:36:40,788 - [minerl.env.malmo log_to_file 548] Logging output of Minecraft to results/20200812T213524.057725/logs/mc_827.log
INFO     - 2020-08-12 21:36:40,788 - [minerl.env.malmo log_to_file 548] Logging output of Minecraft to results/20200812T213524.057725/logs/mc_827.log
INFO     - 2020-08-12 21:36:40,794 - [__main__ wrap_env 213] Detected `gym.wrappers.TimeLimit`! Unwrap it and re-wrap our own time limit.
INFO     - 2020-08-12 21:36:40,794 - [__main__ wrap_env 213] Detected `gym.wrappers.TimeLimit`! Unwrap it and re-wrap our own time limit.
INFO     - 2020-08-12 21:36:40,803 - [env_wrappers __init__ 481] always pressing keys: []
INFO     - 2020-08-12 21:36:40,803 - [env_wrappers __init__ 481] always pressing keys: []
INFO     - 2020-08-12 21:36:40,806 - [env_wrappers __init__ 487] reversed pressing keys: []
INFO     - 2020-08-12 21:36:40,806 - [env_wrappers __init__ 487] reversed pressing keys: []
INFO     - 2020-08-12 21:36:40,820 - [env_wrappers __init__ 492] always ignored keys: []
INFO     - 2020-08-12 21:36:40,820 - [env_wrappers __init__ 492] always ignored keys: []
INFO     - 2020-08-12 21:36:40,830 - [env_wrappers __init__ 545] Dict(attack:Discrete(2), back:Discrete(2), camera:Box(low=-180.0, high=180.0, shape=(2,)), forward:Discrete(2), jump:Discrete(2), left:Discrete(2), right:Discrete(2), sneak:Discrete(2), sprint:Discrete(2)) is converted to Discrete(11).
INFO     - 2020-08-12 21:36:40,830 - [env_wrappers __init__ 545] Dict(attack:Discrete(2), back:Discrete(2), camera:Box(low=-180.0, high=180.0, shape=(2,)), forward:Discrete(2), jump:Discrete(2), left:Discrete(2), right:Discrete(2), sneak:Discrete(2), sprint:Discrete(2)) is converted to Discrete(11).
INFO     - 2020-08-12 21:36:40,835 - [__main__ wrap_env 213] Detected `gym.wrappers.TimeLimit`! Unwrap it and re-wrap our own time limit.
INFO     - 2020-08-12 21:36:40,835 - [__main__ wrap_env 213] Detected `gym.wrappers.TimeLimit`! Unwrap it and re-wrap our own time limit.
INFO     - 2020-08-12 21:36:40,852 - [env_wrappers __init__ 481] always pressing keys: []
INFO     - 2020-08-12 21:36:40,852 - [env_wrappers __init__ 481] always pressing keys: []
INFO     - 2020-08-12 21:36:40,870 - [env_wrappers __init__ 487] reversed pressing keys: []
INFO     - 2020-08-12 21:36:40,870 - [env_wrappers __init__ 487] reversed pressing keys: []
INFO     - 2020-08-12 21:36:40,876 - [env_wrappers __init__ 492] always ignored keys: []
INFO     - 2020-08-12 21:36:40,876 - [env_wrappers __init__ 492] always ignored keys: []
INFO     - 2020-08-12 21:36:40,884 - [env_wrappers __init__ 545] Dict(attack:Discrete(2), back:Discrete(2), camera:Box(low=-180.0, high=180.0, shape=(2,)), forward:Discrete(2), jump:Discrete(2), left:Discrete(2), right:Discrete(2), sneak:Discrete(2), sprint:Discrete(2)) is converted to Discrete(11).
INFO     - 2020-08-12 21:36:40,884 - [env_wrappers __init__ 545] Dict(attack:Discrete(2), back:Discrete(2), camera:Box(low=-180.0, high=180.0, shape=(2,)), forward:Discrete(2), jump:Discrete(2), left:Discrete(2), right:Discrete(2), sneak:Discrete(2), sprint:Discrete(2)) is converted to Discrete(11).
ERROR    - 2020-08-12 21:36:41,026 - [__main__ main 112] execution failed.
Traceback (most recent call last):
  File "/Users//baselines/general/chainerrl/baselines/dqn_family.py", line 110, in main
    _main(args)
  File "/Users//baselines/general/chainerrl/baselines/dqn_family.py", line 171, in _main
    batch_accumulator=args.batch_accumulator
  File "/Users//baselines/general/chainerrl/baselines/dqn_family.py", line 315, in get_agent
    batch_accumulator=batch_accumulator, phi=phi)
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/chainerrl/agents/dqn.py", line 154, in __init__
    cuda.get_device_from_id(gpu).use()
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/chainer/backends/cuda.py", line 279, in get_device_from_id
    check_cuda_available()
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/chainer/backends/cuda.py", line 142, in check_cuda_available
    raise RuntimeError(msg)
RuntimeError: CUDA environment is not correctly set up
(see https://github.com/chainer/chainer#installation).No module named 'cupy'
ERROR    - 2020-08-12 21:36:41,026 - [__main__ main 112] execution failed.
Traceback (most recent call last):
  File "/Users//baselines/general/chainerrl/baselines/dqn_family.py", line 110, in main
    _main(args)
  File "/Users//baselines/general/chainerrl/baselines/dqn_family.py", line 171, in _main
    batch_accumulator=args.batch_accumulator
  File "/Users//baselines/general/chainerrl/baselines/dqn_family.py", line 315, in get_agent
    batch_accumulator=batch_accumulator, phi=phi)
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/chainerrl/agents/dqn.py", line 154, in __init__
    cuda.get_device_from_id(gpu).use()
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/chainer/backends/cuda.py", line 279, in get_device_from_id
    check_cuda_available()
  File "/Users//opt/anaconda3/lib/python3.7/site-packages/chainer/backends/cuda.py", line 142, in check_cuda_available
    raise RuntimeError(msg)
RuntimeError: CUDA environment is not correctly set up
(see https://github.com/chainer/chainer#installation).No module named 'cupy'
---------------------------------------------------------------------------
RuntimeError                              Traceback (most recent call last)
~/baselines/general/chainerrl/baselines/dqn_family.py in <module>
    319 
    320 if __name__ == '__main__':
--> 321     main()

~/baselines/general/chainerrl/baselines/dqn_family.py in main()
    108 
    109     try:
--> 110         _main(args)
    111     except:  # noqa
    112         logger.exception('execution failed.')

~/baselines/general/chainerrl/baselines/dqn_family.py in _main(args)
    169         agent_type=args.agent, gpu=args.gpu, gamma=args.gamma, replay_start_size=args.replay_start_size,
    170         target_update_interval=args.target_update_interval, clip_delta=args.clip_delta,
--> 171         batch_accumulator=args.batch_accumulator
    172     )
    173 

~/baselines/general/chainerrl/baselines/dqn_family.py in get_agent(n_actions, arch, n_input_channels, noisy_net_sigma, final_epsilon, final_exploration_frames, explorer_sample_func, lr, adam_eps, prioritized, steps, update_interval, replay_capacity, num_step_return, agent_type, gpu, gamma, replay_start_size, target_update_interval, clip_delta, batch_accumulator)
    313         q_func, opt, rbuf, gpu=gpu, gamma=gamma, explorer=explorer, replay_start_size=replay_start_size,
    314         target_update_interval=target_update_interval, clip_delta=clip_delta, update_interval=update_interval,
--> 315         batch_accumulator=batch_accumulator, phi=phi)
    316 
    317     return agent

~/opt/anaconda3/lib/python3.7/site-packages/chainerrl/agents/dqn.py in __init__(self, q_function, optimizer, replay_buffer, gamma, explorer, gpu, replay_start_size, minibatch_size, update_interval, target_update_interval, clip_delta, phi, target_update_method, soft_update_tau, n_times_update, average_q_decay, average_loss_decay, batch_accumulator, episodic_update_len, logger, batch_states, recurrent)
    152 
    153         if gpu is not None and gpu >= 0:
--> 154             cuda.get_device_from_id(gpu).use()
    155             self.model.to_gpu(device=gpu)
    156 

~/opt/anaconda3/lib/python3.7/site-packages/chainer/backends/cuda.py in get_device_from_id(device_id)
    277     if device_id is not None:
    278         if device_id >= 0:
--> 279             check_cuda_available()
    280             return Device(int(device_id))
    281     return DummyDevice

~/opt/anaconda3/lib/python3.7/site-packages/chainer/backends/cuda.py in check_cuda_available()
    140                '(see https://github.com/chainer/chainer#installation).')
    141         msg += str(_resolution_error)
--> 142         raise RuntimeError(msg)
    143     if (not cudnn_enabled and
    144             not _cudnn_disabled_by_user and

RuntimeError: CUDA environment is not correctly set up
(see https://github.com/chainer/chainer#installation).No module named 'cupy'

%run train_dqfd.py
---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
~/baselines/general/chainerrl/baselines/train_dqfd.py in <module>
     28 from chainerrl import experiments, explorers
     29 from chainerrl.experiments.evaluator import Evaluator
---> 30 from dqfd import DQfD, PrioritizedDemoReplayBuffer
     31 
     32 from q_functions import CNNBranchingQFunction

~/baselines/general/chainerrl/baselines/dqfd.py in <module>
     26 
     27 from chainerrl.misc.batch_states import batch_states
---> 28 from chainerrl.replay_buffer import PrioritizedBuffer, PrioritizedReplayBuffer
     29 
     30 

ImportError: cannot import name 'PrioritizedBuffer' from 'chainerrl.replay_buffer' (/Users//opt/anaconda3/lib/python3.7/site-packages/chainerrl/replay_buffer.py)

%run distribution.py
%run distribution.py