gcan pytorch实现_PyTorch实现的强化学习算法集

RLkit

Reinforcement learning framework and algorithms implemented in PyTorch.

Implemented algorithms:

Reinforcement Learning with Imagined Goals (RIG)

Special case of Skew-Fit: set power = 0

Temporal Difference Models (TDMs)

Only implemented in v0.1.2-. See Legacy Documentation section below.

Hindsight Experience Replay (HER)

Soft Actor Critic (SAC)

Includes the "min of Q" method, the entropy-constrained implementation, reparameterization trick, and numerical tanh-Normal Jacbian calcuation.

Twin Delayed Deep Determinstic Policy Gradient (TD3)

To get started, checkout the example scripts, linked above.

What's New

Version 0.2

04/25/2019

Use new multiworld code that requires explicit environment registration.

Make installation easier by adding setup.py and using default conf.py.

04/16/2019

Log how many train steps were called

Log env_info and agent_info.

04/05/2019-04/15/2019

Add rendering

Fix SAC bug to account for future entropy (#41, #43)

Add online algorithm mode (#42)

04/05/2019

The initial release for 0.2 has the following major changes:

Remove Serializable class and use default pickle scheme.

Remove PyTorchModule class and use native torch.nn.Module directly.

Switch to batch-style training rather than online training.

Makes code more amenable to parallelization.

Implementing the online-version is straightforward.

Refactor training code to be its own object, rather than being integrated inside of RLAlgorithm.

Refactor sampling code to be its own object, rather tha