Skip to content

A web scraper app using Nokogiri that extracts relevant data from Google Search.

License

Notifications You must be signed in to change notification settings

shirishkz/nimble-scraper-app

Repository files navigation

Nimble Scraper App 🛰

A web scraper app using Nokogiri that extracts relevant data from Google Search.

Prerequisites

  • Ruby version: 2.6.4

  • Rails version: 6.0.0

  • Database: PostgresSQL 11.4

  • Frontend UI: Bootstrap 3 w/ Sass

  • Linter: RuboCop

  • Test Framework: RSpec w/ SimpleCov

  • App URL: Nimble Scraper App

Dataset Example

CSV layout to feed data into the app

id,query
1,lazada
2,11street
3,samsung
4,apple
5,dtac
6,ais
7,truemove

Setup

Clone the repository

git clone [email protected]:shirishkz/nimble-scraper-app.git
cd project

Install dependencies

bundle install

Set environment variables

Use Figaro or setup API and Secret keys on a .env file

Usage

Initialize database

rails db:setup

Serve app

rails server

Run tests

rspec

Author

👤 Shirish Kayastha

Contributing

Contributions, issues and feature requests are welcome!
Feel free to check issues page.

License

Copyright © 2019 Shirish Kayastha.
This project is MIT licensed.

Acknowledgments


This README was generated with ❤️ by readme-md-generator

About

A web scraper app using Nokogiri that extracts relevant data from Google Search.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published