Skip to content

This is a simple script that scrapes your favorites from furry sites and stores them in a local FileSystem. Submission metadata is stored into the local MongoDB database.

Notifications You must be signed in to change notification settings

webstory/mirma.cc-scrapbook-utils

Repository files navigation

Furry site favorite scraper

This is a simple script that scrapes your favorites from furry sites and stores them in a local FileSystem. Submission metadata is stored into the MongoDB database.

See also Furry site favorite browser and Furry site favorite server for a web-based viewer.

Supported sites

  • Inkbunny
  • FurAffinity

Installation

Before installing, make sure your MongoDB server is running.

Using MongoDB Atlas

Visit https://www.mongodb.com/atlas/database and create your Database

Copy connection string into the config.toml file. See config.toml.example for example.

[db]
mongodb = "mongodb+srv://<username>:<password>@my-serverlessinst.mongodb.net/"
dbname = "scrapbook"

Database Deployments Cloud Atlas

Initializing the database

To create Index, run this command

npm install
npm run init

Usage

Common

  1. Create a file named config.toml in the root directory of this project.
  2. Copy the contents of config.toml.example into config.toml.
  3. Edit [db] section of config.toml
    • mongodb: Your MongoDB connection string
    • dbname: Your MongoDB database name
  4. Edit [files] section of config.toml
    • dir: The root directory to store your files

Inkbunny

Configuration

Edit [ib] section of config.toml

  • username: Your IB username
  • password: Your IB password

Running

npm run ib

FurAffinity

Configuration

Edit [fa] section of config.toml

  • username: Your FA username
  • cookie: Your FA cookie
    • You can get this by logging into FA, opening the developer tools, and copying the value of the a and b cookie.
    • FA cookie

Running

npm run fa

Bulk create thumbnails

You can create missing thumbnails by running this command

npm run create-thumbnails

You do not have to run this command separatly. Thumbnail creation process is already embedded into the fetcher.

Change log

  • 2023-12-09: v3.0.0
    • Migrated to TypeScript

License

MIT

About

This is a simple script that scrapes your favorites from furry sites and stores them in a local FileSystem. Submission metadata is stored into the local MongoDB database.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published