vaishak2future/sac

Implementation of Soft Actor Critic

sac

Notebook for the Tutorial Soft Actor Critic Demystified https://towardsdatascience.com/soft-actor-critic-demystified-b8427df61665

sac's Issues

Gym "Not Implemented" error

I am trying to follow your notebook but am getting the following error in my gym (0.13.0):

NotImplementedError                       Traceback (most recent call last)
<ipython-input-9-a77d459651d6> in <module>
      9         else:
     10             action = env.action_space.sample()
---> 11             next_state, reward, done, _ = env.step(action)
     12 
     13 

G:\Anaconda3\lib\site-packages\gym\core.py in step(self, action)
    280 
    281     def step(self, action):
--> 282         return self.env.step(self.action(action))
    283 
    284     def action(self, action):

G:\Anaconda3\lib\site-packages\gym\core.py in action(self, action)
    283 
    284     def action(self, action):
--> 285         raise NotImplementedError
    286 
    287     def reverse_action(self, action):

NotImplementedError: 

I tried downgrading my gym to 0.10.5. Now instead of a Not Implemented I get WARN: <class '__main__.NormalizedActions'> doesn't implement 'action' method. Maybe it implements deprecated '_action' method.

Can you please let me know what version of gym you are using - perhaps there is a dependency there...

License

Hi,

I would like to ask you if I could modify your code a little bit and publish the modified version on my github? Maybe you could also assign a license to the project.

Thank you very much!