kashishsinghyadav/log-ingestor-and-query-interface-in-django

Develop a log ingestor system that can efficiently handle vast volumes of log data, and offer a simple interface for querying this data using full-text search or specific field filters.

Log-Ingestor-and-Query-Interface-in-django

Develop a log ingestor system that can efficiently handle vast volumes of log data, and offer a simple interface for querying this data using full-text search or specific field filters.

Table of Contents

1. About The Project

     <ul>
       <li><a href="#built-with">Built With</a></li>
     </ul>
   </li>
   <li>
     <a href="#getting-started">Getting Started</a>
     <ul>
       <li><a href="#prerequisites">Prerequisites</a></li>
       <li><a href="#installation">Installation</a></li>
     </ul>
   </li>
   <li><a href="#usage">Usage</a></li>
   <li><a href="#roadmap">Roadmap</a></li>
   <li><a href="#contributing">Contributing</a></li>
   <li><a href="#license">License</a></li>
   <li><a href="#contact">Contact</a></li>
   <li><a href="#acknowledgments">Acknowledgments</a></li>
   

About The Project

we Develop a log ingestor system that can efficiently handle vast volumes of log data, and offer a simple interface for querying this data using full-text search or specific field filters.

the database saved the data realted to field

• level
• message
• resourceId
• timestamp
• traceId
• spanId
• commit
• metadata.parentResourceId

this is how database look like click on '+' add log icon you can add the log details and if you 'http://localhost:8000/query' type this url you can -

• search within specific date ranges.
• Utilize regular expressions for search.
• Allow combining multiple filters.
• Provide real-time log ingestion and searching capabilities.
• Implement role-based access to the query interface.

Built With

• [Python-Django]
• [Html/css]]
• sqlite

Getting Started

This is an example of how you may give instructions on setting up your project locally. To get a local copy up and running follow these simple example steps.

Prerequisites

This is an example of how to list things you need to use the software and how to install them.

• Django project

  cd ./log_ingestor_project/
  

  python manage.py runserver 
  

• Django adminpanel

  http://localhost:8000/admin/

Password=kashish username=loginadmin

Installation

Below is an example of how you can instruct your audience on installing and setting up your app. This template doesn't rely on any external dependencies or services.

1. install python in your system it will also download djnago locally
2. create django project

   django-admin startproject log_ingestor_project

3. Install app realted to project

   python manage.py startapp log_ingestor

   python manage.py startapp query_interface

4. Run your server

5. localhost:8000/urlname