Giter Site home page Giter Site logo

visva-dev / ruby-web-scraper-project Goto Github PK

View Code? Open in Web Editor NEW
3.0 1.0 0.0 123 KB

This project demonstrates an example of Web scraping by retrieving data from the info.lt webpage and presenting it to the user.

Ruby 100.00%
scraper ruby rspec retrieving-data web-scrape

ruby-web-scraper-project's Introduction

Ruby web scraper project

Web scraper project for Microverse Ruby Capstone

Description

This project demonstrates an example of Web scraping by retrieving data from the info.lt webpage and presenting it to the user.

The Scraper presents retrieved data to the user depended on their selection or response :

  • Choice 1 : User need's to choose to run scraper or not

  • Choice 2 : Choose what info they want to get - All lawyers info or just a names, addresses, website links or working times.

    Choices
    Choice to show lawyers names

    How to run this Scraper

    This scraper can run on your computer or online.

Run it On your computer

Pre-requisites

  1. You should have Ruby installed on your computer.
  2. Your computer should be able to run terminal or command prompt or bash or Powershell commands.

Using a Repository

  1. Run this command git clone https://github.com/visva-dev/Microverse-Ruby-Capstone.git in the desired folder to clone the repository on to your local machine. After cloning the project, you should cd into the directory where the code is stored & nevigate into bin older using cd bin

  2. Then run to following command install the necessary dependencies

    bundle install
  1. And last command to run the scraper
    ruby bin/main.rb
  1. And you should see a welcome message indicating the scraper has opened and ready for work, follow the instructions and you will get data which you need.

B. Online

  1. click the following link Scraper's link
  2. When the link has been opened, click the green run button you will see at the top to run the Scraper.

Demo Video

Click the following link to see Video presentation of the project.

How to run Rspec tests:

When you are in Microverse-Ruby-Capstone folder, open your terminal & run rspec program will run tests for this project.

Built With

  • Ruby
  • Nokogiri Gem

Tested With

  • Rspec

Authors

๐Ÿ‘ค Visvaldas Rapalis

Show your support

Give a โญ๏ธ if you like this project!

Acknowledgments

  • This project was inspired by the Microverse program

๐Ÿ“ License

This project is MIT licensed.

ruby-web-scraper-project's People

Contributors

visva-dev avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar

ruby-web-scraper-project's Issues

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.