Release 2.6.0

This will change how clowder sees the extractors. If you have an extractor, and you specify the queue name (either as command line argument or environment variable) the name of the extractor shown in clowder, will be the name of the queue.

Fixed

• both heartbeat and max_retry need to be converted to in, not string

Changed

• when you set the RABBITMQ_QUEUE it will change the name of the extractor as well in the extractor_info document. #47
• environment variable CLOWDER_MAX_RETRY is now MAX_RETRY

Release 2.5.1

Changed

• updated pypi documentation

Release 2.5.0

Fixed

• extractor would fail on empty dataset download #36

Added

• ability to set the heartbeat for an extractractor #42

Changed

• update wordcount extractor to not use docker image
• using piptools for requirements

Release 2.4.1

Added

• Add --max_retry CLI flag and CLOWDER_MAX_RETRY environment variable.

Changed

• updated all of the requirements to latest versions
• updated github actions to automatically create releases
• use thread.daemon = True to fix python 3.10

v2.4.0: Merge pull request #22 from clowder-framework/no-bindings

Changed

• clowder is no longer the default exchange. Exchanges are no longer used and
  this is deprecated.
• fix check for thread is_alive, fixes warning in python 3.9

Removed

• Removed the extractors.<queue_name> since it was not used.

pyclowder release 2.3.4

Fixed

Extractor would not run in case clowder_url was ""

pyclowder release 2.3.3

The fix of the heartbeat in 2.3.2 introduced a new error that was not discovered until later. This will potentially cause your extractor to go in a crash loop.

Fixed

• Thread of heartbeat was set as daemon after start

pyclowder release 2.3.2

Fixed

• When rabbitmq restarts the extractor would not stop and restart, resulting
  in the extractor no longer receiving any messages. #17

Added

• Can specify url to use for extractor downloads, this is helpful for instances
  that have access to the internal URL for clowder, for example in docker/kubernetes.

Removed

• Removed ability to run multiple connectors in the same python process. If
  parallelism is needed, use multiple processes (or containers).

pyclowder release 2.3.1

This fixes a critical bug in version 2.3.0

With this version we no longer gurantee support for versions of python below 3.

Fixed

• There was an issue where status messages could cause an exception. This would prevent most extractors from running correctly.

pyclowder release 2.3.0

IMPORTANT

Removed develop branch, all pull requests will need to be against master from now forward. Please update version number in setup.py in each PR.

From this version no more docker images are build, please use pip install to install pyclowder.

Added

• Simple extractors now support datasets, can also create new datasets.
• Ability to add tags from simple extractor to files and datasets.
• Ability to add additional files (outputs) to dataset in simple extractor.
• Use pipenv to manage dependencies.
• Add job_id to each status message returned by pyclowder.
• PyClowderExtractionAbort to indicate the message shoudl not be retried.

Changed

• Better handling of status messages