Giter Site home page Giter Site logo

Comments (3)

yuwoyizhan avatar yuwoyizhan commented on June 2, 2024

@firestonelib

from passl.

firestonelib avatar firestonelib commented on June 2, 2024

@yuwoyizhan 第1、2个问题:图像分类可以看作视觉自监督预训练模型的一个下游子任务,视觉自监督任务的常见下游任务主要包含图像分类、目标检测、实例分割、语义分割以及姿态估计等。就图像分类而言,基于MIM的自监督模型发展火热并达到SOTA,比如 BEiT-LargeImageNet-1k 上的 top1 acc 为 88.60%,百度自研视觉 MIM 自监督算法 CAE-Large 在 ImageNet-1k 上的 Finetune 分类 top1 acc 达到 86.29%。
第3、4个问题:PASSL 里面的自监督算法都可以进行下游图像分类任务,比如 Linear Probing。 PASSL 文档在 PASSL docs 中。
使用流程:1.在无标签数据集上进行模型预训练;2.在有标签数据集上进行 Finetune 微调或 Linear Probing 线性评估。
飞桨 PASSL 技术交流群:
be2ff0e51395bd3d1d84f809ce1f9bc8 =50x50

from passl.

ChenjieXu avatar ChenjieXu commented on June 2, 2024

@yuwoyizhan 第1、2个问题:图像分类可以看作视觉自监督预训练模型的一个下游子任务,视觉自监督任务的常见下游任务主要包含图像分类、目标检测、实例分割、语义分割以及姿态估计等。就图像分类而言,基于MIM的自监督模型发展火热并达到SOTA,比如 BEiT-LargeImageNet-1k 上的 top1 acc 为 88.60%,百度自研视觉 MIM 自监督算法 CAE-Large 在 ImageNet-1k 上的 Finetune 分类 top1 acc 达到 86.29%。 第3、4个问题:PASSL 里面的自监督算法都可以进行下游图像分类任务,比如 Linear Probing。 PASSL 文档在 PASSL docs 中。 使用流程:1.在无标签数据集上进行模型预训练;2.在有标签数据集上进行 Finetune 微调或 Linear Probing 线性评估。 飞桨 PASSL 技术交流群: be2ff0e51395bd3d1d84f809ce1f9bc8 =50x50

你好,哪里可以使用CAE-Large算法。

from passl.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.