Comments (3)
from multiple-attention.
the batch size is set to 48 in the paper but 16 in the config code, because we use distributed data parallel. Learning rate set as 1e-4 is OK. And a little trick : after pretraining, train multi-attention with backbone froze and set AGDA loss to 0 for a few epochs. From: misscc320 Sent: Tuesday, August 10, 2021 10:58 AM To: yoctta/multiple-attention Cc: Subscribed Subject: [yoctta/multiple-attention] Inconsistent parameters between paper andcode (#8) Hi, thank you for your sharing code. I really appriciate your excellent work. I have read both the paper and your released code, but I found that some parameters described in the paper and that in the config setting of your code are inconsistent. For example, the batch size is set to 48 in the paper but 16 in the config code, the learning rate is start from 0.001 in the paper but 0.0001 in the config code, and so on. Since I want to correctly re-implement your method, I wonder which parameter I shoud use? By the way, I started the training from the pretrain() method of main.py, am I right? — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe. Triage notifications on the go with GitHub Mobile for iOS or Android.
Hi, thank you for your kind response. I read your response but also have some questions.
- Does the correct training process is call
pretrain()
first then callaexp()
? - If the first question holds, then the backbone is not frozen and the AGDA loss is not 0 with the configuration of
aexp()
. This is consistent with your replied trick. So which training process should I use? - According to the code of
pretrain()
, this function only train the Efficientnet-b4 without attention block, texture enhance block and AGDA. If follow the trick mentioned in your response, then when to use AGDA?
from multiple-attention.
hi, same confusions! Have you reimplemented this work successfully?
from multiple-attention.
Related Issues (20)
- What address does the url indicate? HOT 1
- minor mistake found in code
- dataset
- Json Decode Error
- meet a problem when running the code HOT 3
- About the tricks during the training HOT 5
- any guides to show how to use the code to train? HOT 1
- Help
- Anyone successfully run this ? HOT 9
- Training stuck for MAT HOT 4
- 关于AGDA的问题 HOT 3
- about evaluation. HOT 3
- dataset directory and requirement.txt
- Running evaluation on FF++,DFDC,Celeb-DF HOT 3
- Minor issue at efficientnet/utils.py
- Has anyone obtained the results shown in the paper?
- 模块代码
- multiple-attention-modify can run and train
- 关于multi-attention
- preprocess lack some files
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from multiple-attention.