christoskaparakis/irtm_bible

Text Mining the Bible

What's in this repository?

The code for the following project Text Mining the Bible

Authors

• Christos Kaparakis
• Francesca Battipaglia

Summary

The goal of this project is to analyze the text of the Bible’s books and answer some questions that arise for two topics.

• How does the text evolve through the years?
• Which are the differences between the Old and New Testament?

The above-mentioned questions led the whole development of the project. We used different techniques to try to answer these questions, and the most interesting ones turned out to be Classification, Sentiment Analysis and Named Entity Recognition.

Results

Classification using BERT

Classification of Old and New Testament

Classification of Books

Sentiment Analysis

Named Entity Recognition

How do I run these scripts?

You can run this classifier code by installing the requirements

pip install requirements.txt

and running:

• python main.py to perform Preprocessing, Sentiment Analysis, NER and produce some predefined plots.

• python clustering.py to perform SVD and plot the first two principal components.

• python classification_book.py and testament_class.py to train the BERT classifier for classifying verses to their respective books and testaments.

Data

Source: https://www.kaggle.com/oswinrh/bible (Author: Oswin Rahadiyan Hartono)