Giter Site home page Giter Site logo

not-duckie / jatayu-searchengine Goto Github PK

View Code? Open in Web Editor NEW
1.0 2.0 0.0 7.61 MB

Jatayu is an open source federated search engine that respects your privacy and takes no personal data from your machine. The search engine is implemented using golang and elastic search. The search engine further employs a custom written crawler that crawlers all the links present on the given webpage/website, that can later be used to search through.

Go 20.89% Makefile 0.08% HTML 29.17% JavaScript 20.02% CSS 29.84%

jatayu-searchengine's Introduction

Jatayu Search Engine

Jatayu is an open source federated search engine that respects your privacy and takes no personal data from your machine. The search engine is implemented using golang and elastic search.

The search engine further employs a custom written crawler that crawlers all the links present on the given webpage/website, that can later be used to search through.

Searching

The search page provides enhanced search results that are related to the searched query via phrase matching and Natural Language Processing. The matched results are structured to be displayed 10 at time and distributed with page numbers.

The user can visit different page numbers by clicking on the page numbers at the bottom and relevant results will be shown.

Image Search

Jatayu also provides an image search feature that allows users to search through the images in the database and get relevant results.

Users can search images via file format such as jpg

Further users can search through images via search query ex  samsung

Did You Mean

The did you mean feature comes in handy when the input data is close to the search result but not exactly the same. In that case Jatayu suggests the closed matching term and clicking the term will fetch the users the related results.

Suggestions

Jatayu uses Phrase Matching and NLP to suggest searches based on real time input from the user.

This works by using jquery to send input data to a backend api called /autocomplete to get top 10 suggestions.

Crawler

Jatayu contains a custom crawler that can crawl any website by visiting all the links present on the website. The crawler further categorizes the crawled data in text and images to further enhance the raw data.

In order to use the crawler just input any website into the input box and the crawler will start its work. The crawler work load is distributed thus you can use other features of Jatayu while the website is being crawled.

User can provide custom number of threads for crawler to work with :D

Why use Jatayu Over Others ?

Ever notice ads constantly following you around? That’s in part because Google tracks your searches and hides trackers on millions of websites. They make money off the private data stolen from you. Showing ads is just one way of exploiting that stolen private data.

By contrast, our private search engine doesn’t track your searches and  help you to keep your browsing history more private, as it should be. And that’s just the beginning — by using Jatayu you also escape the manipulation of the filter bubble and can use the Internet faster (after all that tracking code is disabled).

Getting Started

Downloading and getting started with Jatayu is very easy. All you need is working docker setup and a browser.

Installing From Docker

  1. Download the Docker Image off the Docker Hub
docker pull notduckie/jatayu-searchengine
  1. Run the installed image with the following command

This is open a port 443 on your localhost. Visit the thatport with any browser and you will be able to access jatayu search engine.

docker run -p443:443 -it notduckie/jatayu-searchengine /opt/setup.sh

Visit URL := https://127.0.0.1/

Note

Since the server is running self signed ssl certificate so you will require to accept on the following page.

  1. Click on Advanced
  2. Click on Proceed to 127.0.0.1

jatayu-searchengine's People

Contributors

not-duckie avatar

Stargazers

 avatar

Watchers

James Cloos avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.