Comments (8)
Thanks for finding this one! The error came from trying to predict during training when we don't provide a prediction file. I've corrected this and checked that it works. If you confirm, I'll close this issue.
from semeval22_structured_sentiment.
Yes, now it works. Thanks!
from semeval22_structured_sentiment.
Looking at the output in the terminal I've seen an error:
2021-09-16 18:38:05 INFO: Loading these models for language: en (English):
=========================
| Processor | Package |
-------------------------
| tokenize | combined |
| pos | combined |
| lemma | combined |
| depparse | combined |
| sentiment | sstplus |
| ner | ontonotes |
=========================
2021-09-16 18:38:05 INFO: Use device: gpu
2021-09-16 18:38:05 INFO: Loading: tokenize
2021-09-16 18:38:05 INFO: Loading: pos
2021-09-16 18:38:08 INFO: Loading: lemma
2021-09-16 18:38:09 INFO: Loading: depparse
2021-09-16 18:38:09 INFO: Loading: sentiment
2021-09-16 18:38:10 INFO: Loading: ner
2021-09-16 18:38:11 INFO: Done loading processors!
Dataset: ../../data/darmstadt_unis
Setup: head_final
2021-09-16 18:40:37 INFO: Loading these models for language: en (English):
=========================
| Processor | Package |
-------------------------
| tokenize | combined |
| pos | combined |
| lemma | combined |
| depparse | combined |
| sentiment | sstplus |
| ner | ontonotes |
=========================
2021-09-16 18:40:37 INFO: Use device: gpu
2021-09-16 18:40:37 INFO: Loading: tokenize
2021-09-16 18:40:37 INFO: Loading: pos
2021-09-16 18:40:40 INFO: Loading: lemma
2021-09-16 18:40:40 INFO: Loading: depparse
2021-09-16 18:40:41 INFO: Loading: sentiment
2021-09-16 18:40:41 INFO: Loading: ner
2021-09-16 18:40:42 INFO: Done loading processors!
Dataset: ../../data/mpqa
Setup: head_final
Traceback (most recent call last):
File "convert_to_conllu.py", line 135, in <module>
tag_json_files(train)
File "convert_to_conllu.py", line 11, in stanza_tag_json_files
tagged_sent = nlp(sentence["text"])
File "/home/iago/.local/lib/python3.6/site-packages/stanza/pipeline/core.py", line 229, in __call__
doc = self.process(doc)
File "/home/iago/.local/lib/python3.6/site-packages/stanza/pipeline/core.py", line 223, in process
doc = process(doc)
File "/home/iago/.local/lib/python3.6/site-packages/stanza/pipeline/sentiment_processor.py", line 53, in process
labels = cnn_classifier.label_text(self._model, text, batch_size=self._batch_size)
File "/home/iago/.local/lib/python3.6/site-packages/stanza/models/classifiers/cnn_classifier.py", line 462, in label_text
labels = unsort(labels, orig_idx)
File "/home/iago/.local/lib/python3.6/site-packages/stanza/models/common/utils.py", line 204, in unsort
assert len(sorted_list) == len(oidx), "Number of list elements must match with original indices."
AssertionError: Number of list elements must match with original indices.
I'm using stanza 1.2.3
.
Inside the experiments
folder, for the norec
dataset there are no files saved.
Also, the logs
folder although it has folders for the different datasets, each folder it's empty.
from semeval22_structured_sentiment.
Super weird. It seems to be a problem with stanza 1.2.3 actually. I know that there is an issue with the sentiment module eating some tokens, so I just changed the code to avoid loading the sentiment and NER modules, which aren't needed anyway. Should work now with 1.2.3 also.
Regarding the experiments folder, do you get any error messages about running the graph parser on norec?
I just checked my logs folder and also don't have anything, so I'll see if I can fix that and update you.
from semeval22_structured_sentiment.
Searching for the nore, I have found more errors:
###########################
EXTERNAL EMBEDDINGS
###########################
using external embeddings: embeddings/18.zip
###########################
INPUT FILES
###########################
train data: sentiment_graphs/mpqa/head_final/train.conllu
###########################
OUTPUT DIR
###########################
saving experiment to experiments/mpqa/head_final/
/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser
Argument elmo_train not set
Restart and set argument elmo_train; I will try to continue for now...
Argument elmo_dev not set
Restart and set argument elmo_dev; I will try to continue for now...
Argument elmo_test not set
Restart and set argument elmo_test; I will try to continue for now...
Argument recycle not set
Restart and set argument recycle; I will try to continue for now...
Argument recycle_layers not set
Restart and set argument recycle_layers; I will try to continue for now...
Argument freeze not set
Restart and set argument freeze; I will try to continue for now...
Argument vocab not set
Restart and set argument vocab; I will try to continue for now...
Argument val not set
Restart and set argument val; I will try to continue for now...
Argument other_target_style not set
Restart and set argument other_target_style; I will try to continue for now...
Argument help_style not set
Restart and set argument help_style; I will try to continue for now...
Argument load not set
Restart and set argument load; I will try to continue for now...
Argument predict_file not set
Restart and set argument predict_file; I will try to continue for now...
cuda:0
(7, 5)
Traceback (most recent call last):
File "./src/main.py", line 400, in <module>
run_parser(get_args())
File "./src/main.py", line 362, in run_parser
_vocabs = make_vocabs(sentences, 0)
File "/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser/src/vocab.py", line 62, in make_vocabs
for sen in sentences:
File "/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser/src/col_data.py", line 198, in read_col_data
with open(fname) as fhandle:
FileNotFoundError: [Errno 2] No such file or directory: 'sentiment_graphs/mpqa/head_final/train.conllu'
Running multibooked_ca - head_final
mkdir: directory could not be created «experiments/multibooked_ca/head_final»: File already exists
###########################
EXTERNAL EMBEDDINGS
###########################
using external embeddings: embeddings/34.zip
###########################
INPUT FILES
###########################
train data: sentiment_graphs/multibooked_ca/head_final/train.conllu
###########################
OUTPUT DIR
###########################
saving experiment to experiments/multibooked_ca/head_final/
/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser
Argument elmo_train not set
Restart and set argument elmo_train; I will try to continue for now...
Argument elmo_dev not set
Restart and set argument elmo_dev; I will try to continue for now...
Argument elmo_test not set
Restart and set argument elmo_test; I will try to continue for now...
Argument recycle not set
Restart and set argument recycle; I will try to continue for now...
Argument recycle_layers not set
Restart and set argument recycle_layers; I will try to continue for now...
Argument freeze not set
Restart and set argument freeze; I will try to continue for now...
Argument vocab not set
Restart and set argument vocab; I will try to continue for now...
Argument val not set
Restart and set argument val; I will try to continue for now...
Argument other_target_style not set
Restart and set argument other_target_style; I will try to continue for now...
Argument help_style not set
Restart and set argument help_style; I will try to continue for now...
Argument load not set
Restart and set argument load; I will try to continue for now...
Argument predict_file not set
Restart and set argument predict_file; I will try to continue for now...
cuda:0
(7, 5)
Traceback (most recent call last):
File "./src/main.py", line 400, in <module>
run_parser(get_args())
File "./src/main.py", line 362, in run_parser
_vocabs = make_vocabs(sentences, 0)
File "/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser/src/vocab.py", line 62, in make_vocabs
for sen in sentences:
File "/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser/src/col_data.py", line 198, in read_col_data
with open(fname) as fhandle:
FileNotFoundError: [Errno 2] No such file or directory: 'sentiment_graphs/multibooked_ca/head_final/train.conllu'
Running multibooked_eu - head_final
mkdir: directory could not be created «experiments/multibooked_eu/head_final»: File already exists
###########################
EXTERNAL EMBEDDINGS
###########################
using external embeddings: embeddings/32.zip
###########################
INPUT FILES
###########################
train data: sentiment_graphs/multibooked_eu/head_final/train.conllu
###########################
OUTPUT DIR
###########################
saving experiment to experiments/multibooked_eu/head_final/
/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser
Argument elmo_train not set
Restart and set argument elmo_train; I will try to continue for now...
Argument elmo_dev not set
Restart and set argument elmo_dev; I will try to continue for now...
Argument elmo_test not set
Restart and set argument elmo_test; I will try to continue for now...
Argument recycle not set
Restart and set argument recycle; I will try to continue for now...
Argument recycle_layers not set
Restart and set argument recycle_layers; I will try to continue for now...
Argument freeze not set
Restart and set argument freeze; I will try to continue for now...
Argument vocab not set
Restart and set argument vocab; I will try to continue for now...
Argument val not set
Restart and set argument val; I will try to continue for now...
Argument other_target_style not set
Restart and set argument other_target_style; I will try to continue for now...
Argument help_style not set
Restart and set argument help_style; I will try to continue for now...
Argument load not set
Restart and set argument load; I will try to continue for now...
Argument predict_file not set
Restart and set argument predict_file; I will try to continue for now...
cuda:0
(7, 5)
Traceback (most recent call last):
File "./src/main.py", line 400, in <module>
run_parser(get_args())
File "./src/main.py", line 362, in run_parser
_vocabs = make_vocabs(sentences, 0)
File "/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser/src/vocab.py", line 62, in make_vocabs
for sen in sentences:
File "/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser/src/col_data.py", line 198, in read_col_data
with open(fname) as fhandle:
FileNotFoundError: [Errno 2] No such file or directory: 'sentiment_graphs/multibooked_eu/head_final/train.conllu'
Running norec - head_final
mkdir: directory could not be created «experiments/norec/head_final»: File already exists
###########################
EXTERNAL EMBEDDINGS
###########################
using external embeddings: embeddings/58.zip
###########################
INPUT FILES
###########################
train data: sentiment_graphs/norec/head_final/train.conllu
###########################
OUTPUT DIR
###########################
saving experiment to experiments/norec/head_final/
/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser
Argument elmo_train not set
Restart and set argument elmo_train; I will try to continue for now...
Argument elmo_dev not set
Restart and set argument elmo_dev; I will try to continue for now...
Argument elmo_test not set
Restart and set argument elmo_test; I will try to continue for now...
Argument recycle not set
Restart and set argument recycle; I will try to continue for now...
Argument recycle_layers not set
Restart and set argument recycle_layers; I will try to continue for now...
Argument freeze not set
Restart and set argument freeze; I will try to continue for now...
Argument vocab not set
Restart and set argument vocab; I will try to continue for now...
Argument val not set
Restart and set argument val; I will try to continue for now...
Argument other_target_style not set
Restart and set argument other_target_style; I will try to continue for now...
Argument help_style not set
Restart and set argument help_style; I will try to continue for now...
Argument load not set
Restart and set argument load; I will try to continue for now...
Argument predict_file not set
Restart and set argument predict_file; I will try to continue for now...
cuda:0
(7, 5)
Traceback (most recent call last):
File "./src/main.py", line 400, in <module>
run_parser(get_args())
File "./src/main.py", line 362, in run_parser
_vocabs = make_vocabs(sentences, 0)
File "/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser/src/vocab.py", line 62, in make_vocabs
for sen in sentences:
File "/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser/src/col_data.py", line 198, in read_col_data
with open(fname) as fhandle:
FileNotFoundError: [Errno 2] No such file or directory: 'sentiment_graphs/norec/head_final/train.conllu'
Running opener_es - head_final
mkdir: directory could not be created «experiments/opener_es/head_final»: File already exists
###########################
EXTERNAL EMBEDDINGS
###########################
using external embeddings: embeddings/68.zip
###########################
INPUT FILES
###########################
train data: sentiment_graphs/opener_es/head_final/train.conllu
###########################
OUTPUT DIR
###########################
saving experiment to experiments/opener_es/head_final/
/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser
Argument elmo_train not set
Restart and set argument elmo_train; I will try to continue for now...
Argument elmo_dev not set
Restart and set argument elmo_dev; I will try to continue for now...
Argument elmo_test not set
Restart and set argument elmo_test; I will try to continue for now...
Argument recycle not set
Restart and set argument recycle; I will try to continue for now...
Argument recycle_layers not set
Restart and set argument recycle_layers; I will try to continue for now...
Argument freeze not set
Restart and set argument freeze; I will try to continue for now...
Argument vocab not set
Restart and set argument vocab; I will try to continue for now...
Argument val not set
Restart and set argument val; I will try to continue for now...
Argument other_target_style not set
Restart and set argument other_target_style; I will try to continue for now...
Argument help_style not set
Restart and set argument help_style; I will try to continue for now...
Argument load not set
Restart and set argument load; I will try to continue for now...
Argument predict_file not set
Restart and set argument predict_file; I will try to continue for now...
cuda:0
(7, 5)
Traceback (most recent call last):
File "./src/main.py", line 400, in <module>
run_parser(get_args())
File "./src/main.py", line 362, in run_parser
_vocabs = make_vocabs(sentences, 0)
File "/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser/src/vocab.py", line 62, in make_vocabs
for sen in sentences:
File "/home/iago/Escritorio/SemEval-2022_Shared_Task_10/baselines/graph_parser/src/col_data.py", line 198, in read_col_data
with open(fname) as fhandle:
FileNotFoundError: [Errno 2] No such file or directory: 'sentiment_graphs/opener_es/head_final/train.conllu'
Running opener_en - head_final
mkdir: directory could not be created «experiments/opener_en/head_final»: File already exists
from semeval22_structured_sentiment.
I assume this arises from the first problem. There doesn't seem to be any converted train.conllu files for any of the datasets in the sentiment_graphs folders giving you a bunch of FileNotFoundErrors. The first step is to make sure that these files are actually created with convert_to_conllu.py
from semeval22_structured_sentiment.
I've also fixed the logging function, so the log files should appear now.
from semeval22_structured_sentiment.
Yes, the logs are saved now and the norec has the files inside the folder. Thank you.
from semeval22_structured_sentiment.
Related Issues (20)
- Accuracy of baseline values HOT 4
- Doubts about the cross-lingual task HOT 2
- problems in submitting zip file HOT 4
- Gaps between local evaluation and online evaluation HOT 7
- python evaluate_single_dataset.py dev.json dev.json does not result in 100% F1 HOT 2
- Request for requirements.txt for baseline codes HOT 2
- Missing samples in MPQA dataset HOT 12
- null values in MPQA dataset HOT 2
- Error when uploading the file with the predictions HOT 9
- Some details about data HOT 4
- About pytorch version HOT 2
- Intensity labels HOT 1
- the test set of norec HOT 2
- Miss sentences in test HOT 5
- Can we use the multilingual pretrained model (e.g. mBERT) in the two subtasks (Monolingual and Cross-lingual) ? HOT 2
- Conflicting data usage rules about crosslingual task HOT 2
- Difference in MPQA test set HOT 2
- Mistake in MPQA annotation
- Mistake in darmstadt_unis annotation
- Mistake in Multibooked_eu annotation
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from semeval22_structured_sentiment.