adri-romsor / fitnets Goto Github PK
View Code? Open in Web Editor NEWFitNets: Hints for Thin Deep Nets
FitNets: Hints for Thin Deep Nets
I just confused about how you update the lr during training. As mentioned in your paper, for cifar-10, the initial lr is set as 0.005. Does it mean that it will update during training or it is a fixed value?
Hi, we try running your code. Everything runs fine but at line 111 in fitnets-training.py it gives this error
: 'VectorSpace' doesn't have an attribute 'shape'.
Any help regarding that would be appreciated.
Mayank
When running fitnets_training.py it show an error at line
from pylearn2 import train
"You are importing theano.sandbox.cuda. This is the old GPU back-end and "
unittest.case.SkipTest: You are importing theano.sandbox.cuda. This is the old GPU back-end and is removed from Theano. Use Theano 0.9 to use it. Even better, transition to the new GPU back-end! See https://github.com/Theano/Theano/wiki/Converting-to-the-new-gpu-back-end%28gpuarray%29
How can this be solved if I choose not to install Theano 0.9?
In cifar10_fitnet19_all.yaml:
cost: !obj:costs.KDCost.KDCost {
teacher_path: "<path_teacher_pkl>",
temperature: 3,
lambda_teach: 4,
hints: [[10,1]],
},
what is the teacher_path supposed to be? When run, I get "No such file or directory: '<path_teacher_pkl>' ".
Also, What is the difference between cifar10_fitnet19_all.yaml and cifar10_fitnet19_valid.yam? What does the valid and all stand for?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.