Comments (9)
Not yet, I'm retraining the models.
from semeval22_structured_sentiment.
from semeval22_structured_sentiment.
Hey,
I just downloaded your submission and for me locally I get the same error, so it seems there are some differences in your processed MPQA data. There were some problems that came about from using different stanza versions. In the end, I had to add a requirements.txt for the data processing step as well, as there were several people who were having problems. You should have 2063 dev sentences, so maybe you can check if you have that or not?
from semeval22_structured_sentiment.
Seeing the requirements it's specified stanza=1.1.1
but some time ago I opened and issue #1 and the code was updated to use stanza >=1.2.3
so this is a regression?
Right now I have 2024 dev sentences.
from semeval22_structured_sentiment.
More than a regression, it seems there were some differences between 1.1.1 and 1.2.3 that came up when dealing with further issues. I think I've fixed some of the problems that gave the original error while using 1.1.1 in #1. Could you try with that and see if it helps? Sorry for the back and forth :/
from semeval22_structured_sentiment.
Installing an environment with stanza 1.1.1 gives me a dev.json with 2063 sentences.
from semeval22_structured_sentiment.
Great. Have you tried to resubmit?
from semeval22_structured_sentiment.
I have a question, now that I am using stanza 1.1.1 do I have to retrain all baseline models or just MPQA?
from semeval22_structured_sentiment.
Done, now it works.
from semeval22_structured_sentiment.
Related Issues (20)
- Accuracy of baseline values HOT 4
- Doubts about the cross-lingual task HOT 2
- problems in submitting zip file HOT 4
- Gaps between local evaluation and online evaluation HOT 7
- python evaluate_single_dataset.py dev.json dev.json does not result in 100% F1 HOT 2
- Request for requirements.txt for baseline codes HOT 2
- Missing samples in MPQA dataset HOT 12
- null values in MPQA dataset HOT 2
- Some details about data HOT 4
- About pytorch version HOT 2
- Intensity labels HOT 1
- the test set of norec HOT 2
- Miss sentences in test HOT 5
- Can we use the multilingual pretrained model (e.g. mBERT) in the two subtasks (Monolingual and Cross-lingual) ? HOT 2
- Conflicting data usage rules about crosslingual task HOT 2
- Difference in MPQA test set HOT 2
- Mistake in MPQA annotation
- Mistake in darmstadt_unis annotation
- Mistake in Multibooked_eu annotation
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from semeval22_structured_sentiment.