Accuracy of baseline values

[jerbarnes]

Accuracy of baseline values

[jerbarnes]

Hi Iago,

The values look pretty normal, except for Darmstadt with the Graph Parsing approch. The OpeNER/Multibooked datasets are right where I would expect, Norec is always a bit lower because it's a more diverse dataset and MPQA is quite hard because of the ambiguity of many of the polar expressions and size of the holders and targets. But Darmstadt using the graph parser should be higher than MPQA.

[MinionAttack]

Thanks for the clarification, the issue could be because of this change? #9

[jerbarnes]

I doubt it. These issues aren't so common as to cause a large drop in performance, and the original paper where we take the baseline from (https://aclanthology.org/2021.acl-long.263/) used the same data. Perhaps it's the effect of a particularly poor random seed, as there is a bit of variance (+-2.0 in the paper)??

[MinionAttack]

Ah, ok, I'll try to train it again. Thank you.