This repository contains crawler which crawls the UNT domain pages, implements vector space model to index and retrieve the pages for any query given to the engine. The key components involved in the implementation are crawler, text preprocessor & indexing, retrieval & ranking system and web user interface. The paper also includes the experiments, results and evaluation of the performance of search engine.
This repository contains the following sub-directories:
This directory contains crawler code, text preprocessor & indexing code. Also it contains code to serialize the inverted index created.
This directory contains the web application code of search engine. I have used web2py framework to develop the application.
All the details of the project is presented in the project report.