Skip to content

Gerapy/GerapyItemPipeline

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Sep 20, 2023
217a8dd · Sep 20, 2023

History

7 Commits
Aug 9, 2023
Jul 26, 2020
Sep 20, 2023
Jul 26, 2020
Jan 17, 2021
Jul 26, 2020
Jul 26, 2020
Jul 26, 2020

Repository files navigation

Gerapy Item Pipeline

This is a package for supporting Item Pipelines in Scrapy, also this package is a module in Gerapy.

Installation

pip3 install gerapy-item-pipeline

Usage

These are all kinds of the storage implemented.

MongoDB

MONGODB_CONNECTION_STRING = 'localhost'
MONGODB_DATABASE_NAME = 'default'
MONGODB_UPSERT = True
MONGODB_COLLECTION_NAME_FIELD = 'mongodb_collection_name'
MONGODB_COLLECTION_NAME_DEFAULT = 'default'
MONGODB_ITEM_PRIMARY_KEY_FIELD = 'primary_key'
MONGODB_ITEM_PRIMARY_KEY_DEFAULT = 'id'

About

Item Pipeline Components for Gerapy & Scrapy

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages