Home
Softono
spidermon

spidermon

Open source BSD-3-Clause Python
558
Stars
102
Forks
50
Issues
68
Watchers
2 weeks
Last Commit

About spidermon

Scrapy Extension for monitoring spiders execution.

Platforms

Web Self-hosted

Languages

Python

========= Spidermon

.. image:: https://github.com/scrapinghub/spidermon/workflows/CI/badge.svg?branch=master :target: https://github.com/scrapinghub/spidermon/actions?workflow=CI :alt: CI Status

.. image:: https://img.shields.io/codecov/c/github/scrapinghub/spidermon.svg :target: http://codecov.io/github/scrapinghub/spidermon?branch=master :alt: Coverage report

.. image:: https://img.shields.io/pypi/v/spidermon.svg :target: https://pypi.python.org/pypi/spidermon :alt: pypi version

.. image:: https://img.shields.io/pypi/l/spidermon.svg :target: https://github.com/scrapinghub/spidermon/blob/master/LICENSE :alt: licence

.. image:: https://img.shields.io/pypi/pyversions/spidermon.svg :target: https://pypi.python.org/pypi/spidermon :alt: python versions

.. image:: https://img.shields.io/badge/code%20style-black-000000.svg :target: https://github.com/ambv/black :alt: Code style: black

Overview

Spidermon is a Python 3.10+ Scrapy extension.

The package provides useful tools for data validation, stats monitoring, and notification messages. This way you leave the monitoring task to Spidermon and just check the reports/notifications.

Install

The quick way::

pip install spidermon

For more details see the install section in the documentation: https://spidermon.readthedocs.io/en/latest/installation.html

Documentation

Documentation is available online at https://spidermon.readthedocs.io/ and in the docs directory.