RLkit
Reinforcement learning framework and algorithms implemented in PyTorch.
Implemented algorithms:
Reinforcement Learning with Imagined Goals (RIG)
Special case of Skew-Fit: set power = 0
Temporal Difference Models (TDMs)
Only implemented in v0.1.2-. See Legacy Documentation section below.
Hindsight Experience Replay (HER)
Soft Actor Critic (SAC)
Includes the "min of Q" method, the entropy-constrained implementation, reparameterization trick, and numerical tanh-Normal Jacbian calcuation.
Twin Delayed Deep Determinstic Policy Gradient (TD3)
To get started, checkout the example scripts, linked above.
What's New
Version 0.2
04/25/2019
Use new multiworld code that requires explicit environment registration.
Make installation easier by adding setup.py and using default conf.py.
04/16/2019
Log how many train steps were called
Log env_info and agent_info.
04/05/2019-04/15/2019
Add rendering
Fix SAC bug to account for future entropy (#41, #43)
Add online algorithm mode (#42)
04/05/2019
The initial release for 0.2 has the following major changes:
Remove Serializable class and use default pickle scheme.
Remove PyTorchModule class and use native torch.nn.Module directly.
Switch to batch-style training rather than online training.
Makes code more amenable to parallelization.
Implementing the online-version is straightforward.
Refactor training code to be its own object, rather than being integrated inside of RLAlgorithm.
Refactor sampling code to be its own object, rather tha