ugurkanates/awesome-real-world-rl

Great resources for making Reinforcement Learning work in Real Life situations. Papers,projects and more.

Awesome Real World RL

Great resources for making Reinforcement Learning work in Real Life situations. Papers,projects and more.

This list is big compilation of all things trying to adapt Reinforcement Learning techniques in real world.Either it's mixing real world data into mix or trying to adapt simulations in a better way.It will also include some of Imitation Learning and Meta Learning along the way. If you have anything missing feel free to open a PR,I'm all for community contributions.

Contents

• Papers
• Books
• Conference Talks
• Education
• Simulation to Real with GANs
• Meta Reinforcement Learning
• Imitation Learning
• Multi Agent in Real World
• Real World Examples
• Offline RL
• Datasets
• Projects
• Libraries
• Prominent Researchers & Companies to Follow

Papers

Any academic work done related to RL in real world.This is the other part of list,anything doesn't fit but still related gets here.

• Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World
• Asymmetric Actor Critic for Image-Based Robot Learning
• Towards Learning Robots Which Can Adapt on the Fly
• Thinking while moving : Deep RL with Concurrent Control
• Towards Vision-Based Deep Reinforcement Learning for Robotic Motion Control
• Quantifying the Reality Gap in Robotic Manipulation Tasks
• Transferring End-to-End Visuomotor Control from Simulation to Real World for a Multi-Stage Task
• Sim-to-Real Robot Learning from Pixels with Progressive Nets
• A Practical Approach to Insertion with Variable Socket Position Using Deep Reinforcement Learning
• Modelling Generalized Forces with Reinforcement Learning for Sim-to-Real Transfer
• Off-Dynamics Reinforcement Learning: Training for Transfer with Domain Classifiers
• Emergent Real-World Robotic Skills via Unsupervised Off-Policy Reinforcement Learning
• The Ingredients of Real-World Robotic Reinforcement Learning
• Learning personalized treatments via IRL
• Reinforcement Learning Applications
• Challenges of Real-World Reinforcement Learning
• An empirical investigation of the challenges of real-world reinforcement learning
• Generalized State-Dependent Exploration for Deep Reinforcement Learning in Robotics
• Learning To Navigate The Synthetically Accessible Chemical Space Using Reinforcement Learning
• Scaling simulation-to-real transfer by learning composable robot skills
• The Importance and the Limitations of Sim2Real for Robotic Manipulation in Precision Agriculture
• Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions

Books

Any book dedicated to RL in real world or book parts that contains related content.

• Deep RL Hands On 2nd Edition Packt Edition - Has entire chapter dedicated to real world robotics agent.
• Foundations of Deep Reinforcement Learning: Theory and Practice in Python - Few chapters related to real world applications.

Conference Talks

Any recorded talk related to subject goes here.

• GPU Technology Conference 2017: Sim2real collision avoidance for indoor navigation of mobile robots
• Reinforcement learning and it's growing role in AI with Real World examples - Microsoft 2020
• RL in Real World 2020 Conference
• RL for Real Life Panel Discussion June 27-28 2020
• RL for Health Care Panel Discussion June 28 2020
• Learning to Dock Robustly
• On Demand Ride Sharing with RL
• BADGR: An Autonomous Self-Supervised Learning-Based Navigation System
• An empirical investigation of the challenges of real world Reinforcement Learning
• Why Sim2Real ? - July 10 2020
• Visual Learning and Reasoning for Robotic Manipulation

Education

Free or paid courses related to subject goes here.

• Stanford CS330 Meta RL + Multi Task by Chelsea Finn 2019-2020
• CMU Real Life Reinforcement Learning 2015 - A lot of advanced topics as well as talks about DARPA RL Challenge.
• Reinforcement Learning Robot Course CMPUT 652 Fall 2019

Simulation to Real with GANs

Any paper uses GANs to generate realistic simulation images for adaptation of policy goes here.

• Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Grasping - GraspGAN
• CycleGAN
• RL-CycleGAN: Reinforcement Learning Aware Simulation-To-Real

Meta Reinforcement Learning

Anything Meta RL goes here.

• Meta-Reinforcement Learning for Robotic Industrial Insertion Tasks
• Sim-to-Real Transfer of Accurate Grasping with Eye-In-Hand Observations and Continuous Control​
• Meta-Reinforcement Learning Robust to Distributional Shift via Model Identification and Experience Relabeling

Imitation Learning

Anything Imitation Learning goes here.

• Reinforcement and Imitation Learning for Diverse Visuomotor Skills
• Learning Agile Robotic Locomotion Skills by Imitating Animals

Multi Agent in Real World

Anything Multi Agent Real World RL related goes here.

• Python MARL

Real World Examples

Any real world news or projects deployed RL in real life goes here.Mostly news,comments,blog posts etc.

• Reinforcement learning for the real world - Article
• Reinforcement Learning Applications in Real Life June 2019

Offline RL

Anything Offline Reinforcement Learning goes here.

• Scaling data-driven robotics with reward sketching and batch reinforcement learning
• Accelerating Online Reinforcement Learning with Offline Datasets
• MOPO: Model-based Offline Policy Optimization
• Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems

Datasets

Saved datasets goes here.

• RoboNet - Large Scale Multi Robot Learning
• GQ-CNN Training Datasets
• GQ-CNN Object Mesh Datasets
• HDF5 Database of 3D Objects, Parallel-Jaw Grasps for YuMi, and Robustness Metrics
• Google Robotics Dataset - Includes Grasping-Push-Depth Image-Pouring-3DModels.
• D4RL: Datasets for Deep Data-Driven Reinforcement Learning

Projects

Any project link available on internet related to it goes here.

• Dexterity Network - Grasp Quality Convolutional Neural Networks (GQ-CNN)

Libraries

Open source libraries related goes to here.

• State Representation Learning Zoo - Implements most of SRL algorithms in robotic settings.
• Robotics Reinforcement Learning - Customizable PyBullet gym robotic environment.
• RL Bench - Includes object oriented approaches for robotic RL tasks.
• RL Garage - Includes common RL real world robotic benchmarks.
• RL Robotic Meta World - Robotic Manipulation Tasks - Real world examples regarding to Meta Learning.
• GYM Sawyer Robot Environments - ROS - Sawyer robot with ROS and RL.

Prominent Researchers & Companies to Follow

• Sergey Levine - Google Robotics,UC Berkeley.
• Chelsea Finn - Stanford Uni,Google Brain.
• Ashvin Nair - UC Berkeley.
• 99andBeyond - Chemical Company Uses RL for Research,Biomedical & Chemistry.
• Google Brain & Robotics - Mostly Real Life RL Robotics projects.
• X Company - A lot of physics and real life based problems with RL.
• Damien Ernst - Real Life solutions to energy related problems.
• Xinyang Geng - A lot of Meta Learning and locomotion RL.
• Maxim Lapan - Author of Deep RL Hands-On book.
• Scott Fujimoto - One of the most prominent Offline RL researcher.
• TalkRL Podcast - Includes a lot of new RL research.

Contribute

Contributions welcome! Read the contribution guidelines first.

To the extent possible under law, Ugurkan Ates has waived all copyright and related or neighboring rights to this work.

Contributors: Ugurkan Ates