Step 1: Download and Install Python MDP Tool box from https://pymdptoolbox.readthedocs.io/en/latest/api/mdptoolbox.html. Step 2: Replace the mdp.py and example.py file in original MDPToolbox with the updated mdp.py and example.py files provided respectively. We have included our SOR Q-Learning algorithm in the mdp.py provided.
Step3: Run the main.py for the results.