mathpix/spectra-review-paper-competition

Competition for best expository article on cutting-edge ML research

spectra-review-paper-competition's Issues

I must have done something wrong when submitting (PR #37)

I have submitted a pull request by the deadline but it hasn't been merged. I did an initial mistake of not pulling changes before the pull requests, but it seems to be clean now.

Is something still wrong?

Thank you

One of these essays has a huge number of sentences copied *exactly* from other papers: Demystifying Post-hoc Explainability for ML models

Demystifying Post-hoc Explainability for ML models

These are just some example:

Section 3 First sentence of Rule-based Explanations is copied from: https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/16982

Section 3 - Last Sentence of Counterfactual Explanations is copy from https://arxiv.org/abs/1909.09369

Section 3 - Last Sentence of Representation-Based Explanations copied from https://papers.nips.cc/paper/2020/file/c74956ffb38ba48ed6ce977af6727275-Paper.pdf

Section 3 -  Summaries of Counterfactuals is copied from https://arxiv.org/abs/2009.07165

Section 4 - Last Sentence of Feature Importance Based Explanations is copied from https://paperswithcode.com/method/nam

Section 4 – Last sentence of Shapley Value Importance is copied fromhttps://arxiv.org/pdf/2002.09815.pdf

Section 4 - Patch-based Classification First Sentence is copied from https://arxiv.org/pdf/2102.05917.pdf

Section 6 - Adversarial attacks: sentence copied from https://arxiv.org/pdf/1911.02508.pdf

Section 6 - First sentence of Unjustified Counterfactual Explanations is copied from:https://arxiv.org/pdf/1907.09294.pdf

Section 6 - Last sentence of Faithfulness is copied from: https://www.nature.com/articles/s42256-019-0048-x?proof=t

Section 6 - Last sentence of Robustness is copied from https://www.groundai.com/project/on-the-robustness-of-interpretability-methods/1

When will the winner be announced?

Hi, I'm wondering when the winner will be announced to determine whether I need to consider participating the competition.

Exact Deadline Time

I wanted to know when is the exact deadline time -- Is it March 15, 2021 (Anywhere on Earth)?

Deadline

Will the Deadline be extended again?

Had pushed my submssion before the dealine yesterday. Could not merge the pull request

Can anything be done about the submission? The pull request says only people with write access can merge the pull request!

Question relative to the contest

Hello!

Thank you for this initiative and the contest
Some questions relative to the contest:

• Is it possible to review cutting edge applications of ML current research in a particular field?
• Who are the judges of the contest?
• Is anyone allowed to compete?

Thank you!

Possible fraud for the winning paper

The winning paper had support on twitter, more than other papers. But it was subtentially suported by users which account were created in march 2021 with between 1 or 2 followers. @nicodjimenez, @kaitlinmcunningham1 was the competition designed to favor this kind of behavior? How was this taken into account? @mccaffary would you like to answer something about this?

set of profile :
https://twitter.com/PaulSpe49628373
https://twitter.com/jiali921
https://twitter.com/luppi_dario
https://twitter.com/DamianLyter

As they have no follower, these profile did not help gather more people on the spectra website...
On comparison, the second more backup on twitter was Information Theory in Machine Learning ; its absence on the Podium is troubling and some arbitrary decision seem to have been made. Am I missing something?

• The second best article was a summary of a previous work presented at NeurIPS . From the exact rules of the contest:
  " - The review paper, however must be original writing and in English
• The goal of the paper should be to summarize/explain cutting edge approaches in a particular subfield of ML (for example machine translation, text summarization, and image segmentation)"
  This article reused figures from the original paper, which as far as I can understand the rules above is not an original writing and therefore forbidden.

The sudden change of deadlines, lacks of transparency in the results statistics and clear non-highlighted frauds in 2 article (see second issue in this thread) makes me a bit worried about the future of the contests, while I still find it a great idea and a great manner for students to train at writing!

Does the competition have started?

I'm about to write a review for my paper, only to find that there are few participants. Do I get to the right place for the competition? Only 8 forks and 1 pull requests :)

Help needed to submit review paper for the competition

We tried to submit our paper but failed. Please help. Submission files are available @ https://github.com/indrajitg-r/SPECTRA

deadline

what time (and timezone) specifically is the deadline?