Comments (16)
I think it makes sense to start with the basics, go with:
- Linear Regression
- Logistic Regression (natural extension due to just a kernel swap)
- k-Means
- Standard Multi Layer Perceptron.
And then take it from there! :)
Personally I would like to maybe do some LSTM's & other RNN type models.
However, for these we will need an optimizer. SGD & ADAM should be easy enough to implement
from arrayfire-ml.
@umar456 @pentschev @jramapuram Any suggestions about what can go in the first go would be greatly appreciated.
from arrayfire-ml.
In particular, additions to Regression and clustering would be nice.
from arrayfire-ml.
Btw for the suite of neural models it would be good to abstract a standard 'Layer' class. This will make the addition of conv layers/etc pretty easy.
from arrayfire-ml.
@jramapuram I was just running through the library design via github issues. I came up with this: #17 for the standard Layer class. It might change once the work actually begins.
from arrayfire-ml.
I will look into the optimization functions and update the list. Can you create an issue for base RNN class and / or LSTM and discuss what additional work should be done ?
from arrayfire-ml.
Sure thing. For optimization I suggest paralleling something like keras's solution minus maybe the automatic differentiation that theano offers (thats pretty tough to implement I'd imagine).
from arrayfire-ml.
@zxie has implemented a very elegant neural network library which maybe was based on the general flow graph described in the Stanford course Deep Learning for Natural Language Processing.
A graph based neural network model can be built with Nodes which do the math with Ops. Currently only one model was implemented with nodes. The library also implements some NNet models without using the nodes.
Caffe is also trying to manage the relationship of layers in a computation graph.
from arrayfire-ml.
I have some experience with recurrent learning models, like RTLR and LSTM. Those coluld be used for tasks like speech recognition and realtime time series predictions, and so. Do you have plans for supporting such functionality aswell?
from arrayfire-ml.
from arrayfire-ml.
Yeah, but that doesn't get icluded in this list above. Yet?
from arrayfire-ml.
Caffe is also trying to manage the relationship of layers in a computation graph.
FWIW, there is an increasing number of ML algorithms that are doing tree/graph processing to some extent, so that may be another useful thing to have in arrayfire-ml: graph processing utilities for some of the more common algorithms (e.g. breadth-first search implemented in OpenCL)
from arrayfire-ml.
Closing this because it is no longer relevant.
from arrayfire-ml.
Why is it no longer relevant?
from arrayfire-ml.
@jasonhargrove Using autograd for implementing neural networks. This involved changing the API. If you have any suggestions / questions, please follow up over here:
#17
from arrayfire-ml.
Hi,Could I join this project and develop some function in arrayfire-ml。Because write ml algorithm in C++ and GPU would interesting and challenging! Thank you!
from arrayfire-ml.
Related Issues (20)
- Example: Generalized Linear Regression HOT 1
- k-means
- Base classifier class HOT 1
- TODO List for 0.1 release HOT 53
- Principle Component Analysis
- Linear Discriminant Analysis
- RNN Models HOT 12
- HMM and Viterbi
- OpenCL Error OSX Radeon HD6750 HOT 6
- Add Initializers HOT 3
- Remove bias from Weights.hpp HOT 3
- Static Activations Class HOT 5
- Autodiff HOT 1
- Is ML project dead? HOT 2
- Convolution Functions HOT 1
- Loss functions HOT 2
- Optimizers
- Indexing and assignment support in autograd
- Degraded performance for variable input size HOT 2
- Possible anachronism in CMake `target_include_directories`
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from arrayfire-ml.