adalogics/paper-analyser

Ada Logics

We provide online education, R&D and services in the software security space.

High-quality online courses in:

• Applied Source Code Fuzzing
• Foundations of Reverse Engineering
• LLVM In-Depth For Security Engineering And Program Analysis (to-be online soon) and many more at our Training page
• Understanding Code Injections From Beginner To Advanced
• Automating RE With Outside-The-Box Full-System Dynamic Analysis

We run a blog called Program Analysis Corner that covers in-depth about program analysis

We share in-depth technical videos on YouTube

paper-analyser's Issues

Package(s)

At some point it'd be good to refactor the code base and convert it into a Python package (or multiple packages). I'd suggest we do this at a later stage, when we have a better idea of the overall structure.

Avoid duplicate work effort

Grobid: A machine learning software for extracting information from scholarly documents

https://github.com/kermitt2/grobid

We should avoid doing double work with other projects and instead focus on collaborating and solving new problems. Grobid seems to be a super relevant project to paper-analyser. This issue is to keep track of clarifying overlap between the projects and may have an effect on how we progress with paper-analyser.

@gchers

Automated extraction of topics

We should see if we can leverage https://github.com/ddangelov/Top2Vec

"Top2Vec learns jointly embedded topic, document and word vectors."

This issue keeps track of details about how we can use Top2Vec to extract interesting insights from academic papers.

@gchers

Unclear how to reproduce Alexandria

The steps to reproduce alexandria is not entirely clear. Could this be added? We are using some grobid_client although it's not clear which module this is (https://github.com/kermitt2/grobid_client_python ?).

Could we perhaps add a script/doc to reproduce?

I think it should be something along the lines of:

git clone https://github.com/AdaLogics/paper-analyser
cd paper-analyser/alexandria
python3 -m venv venv
. venv/bin/activate

docker pull lfoppiano/grobid:0.6.2
docker run -t --rm --init lfoppiano/grobid:0.6.2
pip install pymongo bs4 pygrobid
git clone https://github.com/kermitt2/grobid_client_python
python ./runner.py ../example-papers

Grobid doc for reference:
https://grobid.readthedocs.io/en/latest/Grobid-docker/

I believe the above steps should be close to enough, but they didn't do it entirely for me.

@gchers ?

Set up CI

Tasks:

• verify that every PR adheres to coding standards (e.g., use black).
• run tests to verify that every PR doesn't break stuff.