This project can be used to receive notifications in Telegram when a new product will be listed for some category (https://reverb.com)
Install pre-commit hooks to ensure code quality checks and style checks
$ make install_hooks
Then see Configuration section
You can also use these commands during dev process:
-
To run mypy checks
$ make types -
To run flake8 checks
$ make style -
To run black checks:
$ make format -
To run together:
$ make lint
Replace .env.example with real .env, changing placeholders
TELEGRAM_BOT_TOKEN=<token>
TELEGRAM_CHAT_ID=<public/group-id>
MONGO_URI=<mongo-uri>
MONGO_DB=<mongo-collection>
MONGO_PRODUCT_COLLECTION=<mongo-collection>
MONGO_SCRAPING_LINKS_COLLECTION=<mongo-collection>
Setup and activate a python3 virtualenv via your preferred method. e.g. and install production requirements:
$ make ve
For remove virtualenv:
$ make clean
Run spider locally:
$ scrapy crawl reverb.com
Run docker containers:
$ make docker_up