Giter Site home page Giter Site logo

Comments (2)

GMvandeVen avatar GMvandeVen commented on May 29, 2024

This error is because iCaRL is only compatible with training according to the Class-IL scenario. The reason for this is that iCaRL uses distillation of current task data on the classes of all previous tasks using binary classification loss (in my code this is indicated by the flag --bce-distill, which is automatically selected when the flag --icarl is used), and this aspect of iCaRL does not have a straight-forward translation to the Task- or Domain-IL scenarios.
Two other aspects of iCaRL could however also be used for training according to the other scenarios: (1) the use of stored exemplars for classification (indicated by the flag --use-exemplars) and (2) the replay of stored exemplars during training (which can be selected with the option --replay=exemplars). In Appendix C of our latest preprint (https://arxiv.org/abs/1904.07734) we explore the use of these two aspects of iCaRL in the different scenarios. I should note that a third aspect of iCaRL that could be used in all scenarios is the use of binary (instead of multi-class) classification loss (indicated by the flag --bce).
Finally, another option could be to use iCaRL to train according to the Class-IL scenario, and then evaluate the performance according to the Task- or Domain-IL scenario. It could however be argued that this is not very fair on iCaRL as its performance won't be optimised for the scenario it is tested on. For this last option you would have to slightly modify the code.
Hope this helps!

from continual-learning.

hsqzzpf avatar hsqzzpf commented on May 29, 2024

Thanks a lot!
It is much clearer more me now.

from continual-learning.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.