ruby_capstone_scraper

This is a simple web scraper that basically crawls a website and retrieve specific data from the site. Built with Ruby and Nokogiri.

2
0
Ruby

Webscrapper Built With Ruby

This is a simple web scrapper that basically crawls a website and retrives specific data from the site.

For this particular project, we will be scrapping https://remotive.io/ which is a website that provides information on different remote jobs and we will be retrieving the following data:

  • Position of the job
  • Location of the job
  • Company

Built With

  • Ruby
  • Nokogiri gem

Prerequisites

Since all the code is written using ruby Ruby Runtime >= 1.9 ruby is required to interpret the code. if you don’t have ruby runtime installed on your computer follow the instruction for your specific operating system on the official installation guide

Getting started

To get a local copy up and running follow these simple example steps.

  • Clone or download this repository to your local workstation.
  • enter the directory of the cloned project
  • bundle install all gems
  • run bin/controller.rb to execute the scrapper script and print out the data retrieved to the console.

Testing

For testing RSpec is used. To run test run the following command line.

rspec

Author

πŸ‘€ Ignatius Sani

🀝 Contributing

Contributions, issues and feature requests are welcome!

Feel free to check the issues page.

Show your support

Give a ⭐️ if you like this project!

πŸ“ License

This project is MIT licensed.