Comments (2)
txy960427
commented on July 29, 2024
从您与其他提问者的回答中看到了补充，您在计算指标的时候是只对预测事件类型非None的进行了计算，这样我上述的计算中应该改为TP=1，FP=1 FN=2，这样R=1/3，P=1/2 。
如果我理解的没错，您使用的指标是针对预测出事件类型非None的trigger-argument对，这样确实结果会比较高，我在复现中也使用过这样的计算方式，但是我还是觉得不太合理，一方面我认为测试集中的正样本数量是固定的，应当做个整体的评判，第二方面您呈现的DMCNN的结果和论文相比，似乎是Recall比较高。
还是感谢您的耐心解答和分享~
from hmeae.
Bakser
commented on July 29, 2024
我们的考虑是这样。一方面EAE是ED的后续任务，只有给出非None的trigger才能进行EAE，因此单独评测这一阶段的表现也是合理的。另一方面我们发现在之前一些经典工作的复现中同样只有采用这种方式才能得到合理的结果，出于与之前方法公平比较的考虑我们保持了这种方法。如果您有不同的发现，欢迎再交流～
from hmeae.
Related Issues (13)
- question about data format HOT 6
- Confusion about argument detection evaluation HOT 5
- Confusion about the output (role type) HOT 4
- Question about performance HOT 3
- Could you release HMEAE(BERT) model ? HOT 2
- Question about the special token which indicates event type. Thank you HOT 1
- Question about TAC KBP HOT 2
- Question about extracting information of ACE 2005
- json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) HOT 3
- Tips: only support stanford-corenlp-full-2018-10-05 HOT 1
- stanford-english-corenlp-2018-10-05-models.jar HOT 2
- TypeError: word_tokenize() takes 2 positional arguments but 3 were given HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hmeae.