taesiri/arxivqa

WIP - Automated Question Answering for ArXiv Papers with Large Language Models (https://arxiv.taesiri.xyz/)

arxivqa's Issues

.

sorry. please delete this issue

Dartsformer Code

Hello, excuse me, do you have the code of Dartsformer algorithm here

Excellent work! I'm wondering how the context is fed into LLM. Do you input the whole paper directly into LLM? Or do you just input the abstract section of the paper into LLM?

Awesome repo

Removing faulty answers.

It seems that either the Latex flattening code or the Claude-2.0 API (which one is unclear) is doing something strange, and some answers are generated without the body of the paper. For instance, for this question, the answer clearly states that it does not have access to the paper material. We should investigate this and find a filtering process to remove bad answers.

Without having access to the full paper, it's difficult to provide an accurate 1-sentence summary. However, academic papers often have an abstract at the beginning that summarizes the key points and contributions. The abstract would be a good starting point to understand the main idea of the paper in a concise way. If a 1-sentence summary is still needed, it would require looking at the introduction and conclusion sections to identify the overarching theme and outcomes of the research. Having access to key sections like these would help generate a very brief summary statement.

New papers are replacing old papers, the dataset is being deleted?

Hi, in the papers direcctory, its mentioned that the directory is truncated to the last 1000 files, with 5700 omitted. The huggingface directory simply times out.

Is the data even accessible anymore?