coinmarketcap-historical-data-crawler

Command-line interface to fetch historical snapshots from coinmarketcap.com with puppeteer. This script was built to get into and test puppeteer as a crawler and to substitute the missing API for historical data/snapshots from coinmarketcap.com.

Install

git clone [email protected]:roNn23/coinmarketcap-historical-data-crawler.git
cd coinmarketcap-historical-data-crawler
yarn

Usage

To run the crawler, run the following command. Please be sure to run node > 8.

yarn start

After that, the data is saved in data.json.

Data Structure

{
  "historical-snapshots": [
    {
      "date": "20130428",
      "currencies": [
        {
          "sorting": "1",
          "symbol": "BTC",
          "name": "Bitcoin",
          "price": "$135.58",
          "percent24h": "",
          "logo": "https://files.coinmarketcap.com/static/img/coins/128x128/bitcoin.png"
        },
        ...
      ]
    },
    {"date": "20130505" ...}
  ]
}

License

MIT