onetimepad / advantage Goto Github PK
View Code? Open in Web Editor NEWA framework for making RL easy!
A framework for making RL easy!
The train_iteration method for DeepQModel has two if statements one for improve_policy_modulo and improve_target_modulo. If policy improvement happens, target improvement maybe shouldn't happen after ? (like one is a multiple of the other)
both for train, and restore for transfer learning
Tests and complete learning model interface
Model, Agent and Approximator need to have functionality for saving and restoring parameters.
has no attribute optimizer issue
The "config" parameter in base_approximators seems to bind approximators_builder and base_approximators together when the config should only be handled by approximators_builder. The proper pattern is used in agents_builder and base_agents. There might need to be separate "builder" for each approximator similar to agents. Basically, the config param shouldn't be passed around.
There can be multiple feed_dict elements to for an approximator but only one concatenated input tensor. Have a way to keep track of all of them. Change the way inference() works.
Pretty much a script that generates the models, agents, and protobufs files. Also always users to add elements, buffers, utils, etc... basically a CLI.
There is a wrapper (_action_wrapper) in DiscreteActionSpaceAgent. This wrapper is used to extract the one element np.array returned by the DQNAgent or any Discrete and ActionValue agent. However, it being placed in DiscreteActionSpaceAgent is a bit awkward, since technically an ActionValue agent could be continuous and a DiscreteAgent doesn't necessarily return an action that requires such a wrapper.
There should be a better fix for this...maybe a DiscreteActionValueAgent ?
See base_agents
Currently the DQNAgent tests don't mock anything...
This would allow for more fine-grain control over what inputs go into an Approximator and allow for connection of multiple approximators together reducing the need for writing specific classes that deal with combined approximators.
See approximators.proto and inputs_placeholder in set_up()
Look for TODO's involving making exceptions more specific.
For example: "BadActionExcpetion" or something.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.