Skip to content

Releases: hubmapconsortium/ingest-pipeline

v2.0.8

07 Feb 21:06
74bf63d
Compare
Choose a tag to compare
  • Bump portal-containers
  • Trigger file reindex DAG
  • Bugfix Launch multi analysis DAG

v2.0.7

03 Feb 22:20
1ac78fd
Compare
Choose a tag to compare
  • Bump ingest-validation-tools to c518dd5
  • Bugfix Airflow DAG max active runs not respected

v2.0.5

01 Feb 20:08
Compare
Choose a tag to compare
  • Bump ingest-validation-tools to [3dde26f]

v2.0.4

01 Feb 15:06
a183ef9
Compare
Choose a tag to compare
  • Bump sc-atac-seq-pipeline submodule to v2.0.2
  • Update portal-containers
  • Add an auto-deployment script to be used to sync changes to files/environment from VMs

v2.0.3

18 Jan 19:12
23c3d84
Compare
Choose a tag to compare
  • Updated scripts to make use of conda environment
  • Bump codex-pipeline submodule to v2.4.3
  • Handle 10X multiome ATAC-seq datasets

v2.0.2

04 Jan 16:04
0ca2004
Compare
Choose a tag to compare

Bump ingest-validation-tools -> 2c3c57
Bump salmon-rnaseq submodule to v2.1.11
Updated system/config scripts for Airflow 2

v2.0.1

04 Jan 15:49
b048365
Compare
Choose a tag to compare

Bump ingest-validation-tools -> 2c3c57
Bump salmon-rnaseq submodule to v2.1.11
Updated system/config scripts for Airflow 2

v2.0.0

14 Dec 19:39
Compare
Choose a tag to compare
  • Change to Airflow 2.2.5, with associated changes in everything else
  • modify new_dataset_survey.py to directly update the Google sheet
  • limit java thread spawning in docker containers invoked from CWL
  • add a DAG to do diagnostics of failed runs, including:
    • scan for certain keywords indicating errors in the session.log of the failed run
    • run inexpensive validation plugin tests against the parents used in the failed run
  • remove old auth globus plugin
  • add support for launching ingestion of new datasets from the launch_multi_analysis DAG
  • add script to regenerate conda environments
  • fix URL parsing for search-api v3
  • additional airflow_wrapper configs
  • bump codex-pipeline -> 0514dc6953 (v2.4.2)
  • bump py-hubmapbags -> 09665dde
  • bump ingest-validation-tools -> 794967cc
  • bump ingest-validation-tests -> d0c6590c
  • bump manual-data-ingest -> 478d29906

v1.9.6

14 Dec 19:28
Compare
Choose a tag to compare

This release is identical to Release 2.0.0 . Please use that release.

  • Change to Airflow 2.2.5, with associated changes in everything else
  • modify new_dataset_survey.py to directly update the Google sheet
  • limit java thread spawning in docker containers invoked from CWL
  • add a DAG to do diagnostics of failed runs, including:
    • scan for certain keywords indicating errors in the session.log of the failed run
    • run inexpensive validation plugin tests against the parents used in the failed run
  • remove old auth globus plugin
  • add support for launching ingestion of new datasets from the launch_multi_analysis DAG
  • add script to regenerate conda environments
  • fix URL parsing for search-api v3
  • additional airflow_wrapper configs
  • bump codex-pipeline -> 0514dc6953 (v2.4.2)
  • bump py-hubmapbags -> 09665dde
  • bump ingest-validation-tools -> 794967cc
  • bump ingest-validation-tests -> d0c6590c
  • bump manual-data-ingest -> 478d29906

v1.9.5.2

03 Nov 21:17
Compare
Choose a tag to compare

Small bugfix on search api new v3 url, to be correctly parsed inside the pipelines