Comments (3)
Hello, I tried to use author code, but ACC is stable to 50%, I want to know how you do the training.
from dual-contrastive-learning.
Hello, I tried to use author code, but ACC is stable to 50%, I want to know how you do the training.
Hi,When I reproduced the experiment, I did not modify other parameters. Basically, I used the parameters given by the author, and only modified the size of batch_size. I can reproduce the author's results and get good results on my own dataset, you may need to recheck the parameters or download a new code to try it out.
from dual-contrastive-learning.
Your work is very good and effective. But I have some questions about the baseline approach. I tried different hyperparameters to adjust supervised contrastivelearning or unsupervised contrastive learning to fine-tune BERT, and then to classify. But I've never been able to do anything better than just Cross-Entropy. I wonder what I didn't take into account? I've seen a lot of papers that contrastive learning can help improve classification results, but here I always get the opposite. Maybe I want to know the hyperparameters you set when you ran the comparison.
Hi, can you explicitly explain what your hyperparameters are when using supervised contrastive learning to fine tune the baseline? I get the same result with you. Thank you!
from dual-contrastive-learning.
Related Issues (12)
- FileNotFoundError: [Errno 2] No such file or directory: './datasets_manual/TREC_Train.json' HOT 1
- Why did the Dual gradient collapse on my own Chinese dataset? HOT 1
- For the labels containing multiple words, How to take the mean-pooling? HOT 1
- tSNE plot visualization
- about chinese dataset HOT 1
- Issue regarding to the evaluation procedure
- Problem when saving the model !
- There is no dataset HOT 1
- Some logical problems
- could you please upload the raw dataset?
- Why mess with the order of tags when using DualCL? HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dual-contrastive-learning.