antocat93/hw3_g24

Homework 3 - What movie to watch tonight?

A search engine over a list of movies that have a dedicated page on Wikipedia.

Script description

• README.md: the Markdown file that explains the content of your repository.

• collector.py: a python file that contains the line of code needed to collect data from the html page and Wikipedia.

• collector_utils.py: a python file that stores the functions used in collector.py.

• parser.py: a python file that contains the line of code needed to parse the entire collection of html pages and save those in tsv files.

• parser_utils.py: a python file that gathers the functions used in parser.py.

• index.py: a python file that once executed generate the indexes of the Search engines.

• index_utils.py: a python file that contains the functions used for creating indexes.

• utils.py: a python file that gather functions you need in more than one of the previous files like (collector, parser, etc.)

• main.py: a python file that once executed build up the search engine.

• exercise_4.py: python file that contains the implementation of the algorithm that solves problem 4.

• main.ipynb: a notebook file where search functions should be tested

Json files required

• document_norm.json,
• inverted_index_2.json,
• inverted_index.json,
• name_index.json,
• name_norm.json,
• vocabulary.json