Comments (2)
This error is because iCaRL is only compatible with training according to the Class-IL scenario. The reason for this is that iCaRL uses distillation of current task data on the classes of all previous tasks using binary classification loss (in my code this is indicated by the flag --bce-distill
, which is automatically selected when the flag --icarl
is used), and this aspect of iCaRL does not have a straight-forward translation to the Task- or Domain-IL scenarios.
Two other aspects of iCaRL could however also be used for training according to the other scenarios: (1) the use of stored exemplars for classification (indicated by the flag --use-exemplars
) and (2) the replay of stored exemplars during training (which can be selected with the option --replay=exemplars
). In Appendix C of our latest preprint (https://arxiv.org/abs/1904.07734) we explore the use of these two aspects of iCaRL in the different scenarios. I should note that a third aspect of iCaRL that could be used in all scenarios is the use of binary (instead of multi-class) classification loss (indicated by the flag --bce
).
Finally, another option could be to use iCaRL to train according to the Class-IL scenario, and then evaluate the performance according to the Task- or Domain-IL scenario. It could however be argued that this is not very fair on iCaRL as its performance won't be optimised for the scenario it is tested on. For this last option you would have to slightly modify the code.
Hope this helps!
from continual-learning.
Thanks a lot!
It is much clearer more me now.
from continual-learning.
Related Issues (20)
- Performance HOT 7
- Empirical Fisher Estimation HOT 3
- Datasets more complicated than MNIST HOT 1
- Just a request
- Grad in SI HOT 4
- Wrong dataset? HOT 2
- why batch_size has to be 1 when update fisher? HOT 1
- Lower/Upper Bound Experiments HOT 2
- one little confusion about the loss_fn_kd function HOT 1
- Suspicious Precision HOT 3
- Link error HOT 2
- Reproducing BI+SI method HOT 9
- about kafc fisher infromation matrix HOT 1
- How to create Resnet34 HOT 2
- Joint training results different for different types of incremental learning? HOT 3
- Task-IL evaluation HOT 2
- Single head or multihead task incremental HOT 1
- 0 accuracy values for task-free setting HOT 9
- Question about Online EWC HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from continual-learning.