Roadmap

• Rewrite core.
• Distributed RL.
  • Refs:
    • Ray Rllib: https://github.com/ray-project/ray/blob/master/doc/source/rllib.rst
      • paper: https://arxiv.org/abs/1712.05889
      • talks: https://www.youtube.com/watch?v=Y6feXBY6_XQ&t=0s&list=PLkFD6_40KJIxJMR-j5A1mkxK26gh_qg37&index=6 https://www.youtube.com/watch?v=jAEPqjkjth4&t=1s
    • Ape-x: https://openreview.net/forum?id=H1Dy---0Z
      • uber single machine implementation: https://github.com/uber-research/ape-x
    • R2D2: Extension of Ape-x with recurrent networks: https://openreview.net/forum?id=r1lyTjAqYX
    • IMPALA: https://icml.cc/Conferences/2018/Schedule?showEvent=3093
    • Uber Faster Neuro-evolution: https://eng.uber.com/accelerated-neuroevolution/
• More environments.
  • Bullet
  • Box2D