Code for the EMNLP2023 Findings paper: CAR: Conceptualization-Augmented Reasoner for Zero-Shot Commonsense Question Answering (https://aclanthology.org/2023.findings-emnlp.902.pdf).
Hi!
I evaluated the best QA model (DeBERTa-v3-Large) you provided, but the scores are slightly different from the paper's scores.
(ex. 61.2(best_model) vs. 64.0(paper) on SIQA)
I use "evaluate_all.py" code for evaluating.
What is the right way to evaluate?