- Add Python 3 support #42
- Store items from different spiders in different collections #36
- Fix a number of deprecation warnings #34
- Update
scrapy
version to 1.4.0
- Fix typo
- #28 Allow per-spider configuration. Thanks @thiagof for the pull request
- #26 Unicode log message. Thanks @italomaia for the pull request
- #25 Add unicode shebang. Thanks @italomaia for the pull request
- #22 Call serializer before inserting. Thanks @italomaia for the pull request
- #18 Enable multiple value index for collection. Thanks @sherzberg for the pull request
- Fixed bad log messages when duplicate keys were found
- Add the MONGODB_STOP_ON_DUPLICATE option which allows to close the spider when a certain amount of duplicated insertion threshold is reached.
- Syncing all items not previously synced from the local buffer to MongoDB when the spider finishes
- #6 ScrapyDeprecationWarning: crawler.settings
- #7 Use Python format() for output
- #8 Bug when upserting items with a unique key
- Updated docstrings
- Implemented feature #5 Add flag for setting timestamps in the database
- Implemented feature #4 Implement support for MongoDB authentication
- Implemented feature #3 Add support for MongoDB URIs when connecting
- Implemented feature #2 Support buffered data
- Added support for MongoDB replica set host strings
- Minor supportive updates
- Fixed connection problem for MongoDB replica sets
- Fixed bad default parameter handling
- Initial release of the
scrapy-mongodb
pipeline module - Support for MongoDB replica sets and standalone databases