Code

Identity-based provenance tracking#5639

Code

Draft

pditommaso wants to merge 71 commits intomasternextflow-io/nextflow:masterfrom task-tracker-v2nextflow-io/nextflow:task-tracker-v2Copy head branch name to clipboard

+6,135-2,655

Commits

Commits on Jan 3, 2025

• wip

  Show description for b5d423b
  pditommaso

  committed
  b5d423b

  Copy full SHA for b5d423b

Commits on Jan 4, 2025

• Task provenance - poc #1

  Show description for ca9fe88
  pditommaso

  committed
  ca9fe88

  Copy full SHA for ca9fe88

Commits on Jan 5, 2025

• Task provenance - poc #2

  Show description for 494bbb0
  pditommaso

  committed
  494bbb0

  Copy full SHA for 494bbb0

Commits on Jan 6, 2025

• Add toList and toSortedList operators

  Show description for ddeee05
  pditommaso

  committed
  ddeee05

  Copy full SHA for ddeee05

Commits on Jan 7, 2025

• Refactor redice operator as its own class

  Show description for e4e505a
  pditommaso

  committed
  e4e505a

  Copy full SHA for e4e505a

• Fix tests

  Show description for e613123
  pditommaso

  committed
  e613123

  Copy full SHA for e613123

• Fix tests

  Show description for 1f49d92
  pditommaso

  committed
  1f49d92

  Copy full SHA for 1f49d92

• Fix tests

  Show description for 2ab3a6b
  pditommaso

  committed
  2ab3a6b

  Copy full SHA for 2ab3a6b

• Fix tests

  Show description for 1826cfd
  pditommaso

  committed
  1826cfd

  Copy full SHA for 1826cfd

• Fix more tests

  Show description for e7c8722
  pditommaso

  committed
  e7c8722

  Copy full SHA for e7c8722

Commits on Jan 8, 2025

• Add chain operator

  Show description for 88ae57e
  pditommaso

  committed
  88ae57e

  Copy full SHA for 88ae57e

• Fix tests

  Show description for c96d573
  pditommaso

  committed
  c96d573

  Copy full SHA for c96d573

Commits on Jan 9, 2025

• Fix and improvements

  Show description for f727005
  pditommaso

  committed
  f727005

  Copy full SHA for f727005

• Fix OperatorRun allocation

  Show description for f06256f
  pditommaso

  committed
  f06256f

  Copy full SHA for f06256f

• Add distinc + unique operators

  Show description for 7848791
  pditommaso

  committed
  7848791

  Copy full SHA for 7848791

• Add first operator

  Show description for 0014db9
  pditommaso

  committed
  0014db9

  Copy full SHA for 0014db9

• Add take and last operator

  Show description for 2b4c5b3
  pditommaso

  committed
  2b4c5b3

  Copy full SHA for 2b4c5b3

• Add count operator

  Show description for 17fced9
  pditommaso

  committed
  17fced9

  Copy full SHA for 17fced9

Commits on Jan 10, 2025

• Add sum and mean ops

  Show description for e449538
  pditommaso

  committed
  e449538

  Copy full SHA for e449538

Commits on Jan 11, 2025

• Improve run operator allocation

  Show description for ba69632
  pditommaso

  committed
  ba69632

  Copy full SHA for ba69632

• Bind many

  Show description for fee34c7
  pditommaso

  committed
  fee34c7

  Copy full SHA for fee34c7

• Add support for buffer operator

  Show description for bf06bf6
  pditommaso

  committed
  bf06bf6

  Copy full SHA for bf06bf6

• Add mix operator

  Show description for 6d13fbc
  pditommaso

  committed
  6d13fbc

  Copy full SHA for 6d13fbc

Commits on Jan 12, 2025

• Add join operator

  Show description for 980cf32
  pditommaso

  committed
  980cf32

  Copy full SHA for 980cf32

• Add combine op

  Show description for 940b3fb
  pditommaso

  committed
  940b3fb

  Copy full SHA for 940b3fb

• Cleanup and fix tests

  Show description for d85702b
  pditommaso

  committed
  d85702b

  Copy full SHA for d85702b

• Refactor core operator

  Show description for 7183131
  pditommaso

  committed
  7183131

  Copy full SHA for 7183131

• Refactor opertors

  Show description for b26c023
  pditommaso

  committed
  b26c023

  Copy full SHA for b26c023

• Add concat operator

  Show description for 8639e4d
  pditommaso

  committed
  8639e4d

  Copy full SHA for 8639e4d

• Add mix operator

  Show description for c2a3e95
  pditommaso

  committed
  c2a3e95

  Copy full SHA for c2a3e95

Commits on Jan 13, 2025

• Remove chain operator + refactor

  Show description for 4d0379b
  pditommaso

  committed
  4d0379b

  Copy full SHA for 4d0379b

Commits on Jan 14, 2025

• Dump threads only with trace log level [ci fast]

  Show description for a056f8a
  pditommaso

  committed
  a056f8a

  Copy full SHA for a056f8a

• Fix tests

  Show description for e1d3346
  pditommaso

  committed
  e1d3346

  Copy full SHA for e1d3346

• Fix tests

  Show description for f87036a
  pditommaso

  committed
  f87036a

  Copy full SHA for f87036a

• Fix tests

  Show description for dbd42ae
  pditommaso

  committed
  dbd42ae

  Copy full SHA for dbd42ae

• Refactor flatMap op [ci fast]

  Show description for 4e154bb
  pditommaso

  committed
  4e154bb

  Copy full SHA for 4e154bb

• Refactor [ci fast]

  Show description for 2f643f9
  pditommaso

  committed
  2f643f9

  Copy full SHA for 2f643f9

• Add flatten operator [ci fast]

  Show description for 84f7806
  pditommaso

  committed
  84f7806

  Copy full SHA for 84f7806

• Refactor

  Show description for c139bec
  pditommaso

  committed
  c139bec

  Copy full SHA for c139bec

• Minor change

  Show description for 8f8ff02
  pditommaso

  committed
  8f8ff02

  Copy full SHA for 8f8ff02

Commits on Jan 15, 2025

• Add sum and mean operators

  Show description for 702705f
  pditommaso

  committed
  702705f

  Copy full SHA for 702705f

• Add multimap operator [ci fast]

  Show description for 5750f71
  pditommaso

  committed
  5750f71

  Copy full SHA for 5750f71

• Fix tests [ci fast]

  Show description for 14484a5
  pditommaso

  committed
  14484a5

  Copy full SHA for 14484a5

• Minor [ci fast]

  Show description for ff74318
  pditommaso

  committed
  ff74318

  Copy full SHA for ff74318

• Add collate operator

  Show description for 9e5bc10
  pditommaso

  committed
  9e5bc10

  Copy full SHA for 9e5bc10

Commits on Jan 18, 2025

• Update docs [ci skip]

  Show description for 6b926f9
  pditommaso

  committed
  6b926f9

  Copy full SHA for 6b926f9

• Use a set object in place of list for operator inputs [ci fast]

  Show description for 8637aee
  pditommaso

  committed
  8637aee

  Copy full SHA for 8637aee

• Add groupTuple operator

  Show description for 787349f
  pditommaso

  committed
  787349f

  Copy full SHA for 787349f

• Add compile static to GroupTupleOp class [ci fast]

  Show description for 08ac37f
  pditommaso

  committed
  08ac37f

  Copy full SHA for 08ac37f

Commits on Jan 19, 2025

• Merge branch 'master' into task-tracker-v2

  Show description for b8763c1
  pditommaso

  committed
  b8763c1

  Copy full SHA for b8763c1

• Add bare minimal docs [ci skip]

  Show description for 61c153c
  pditommaso

  committed
  61c153c

  Copy full SHA for 61c153c

Commits on Jan 20, 2025

• Merge branch 'master' into task-tracker-v2

  pditommaso

  committed
  c2efcdc

  Copy full SHA for c2efcdc

• Add until operator [ci fast]

  Show description for fadab20
  pditommaso

  committed
  fadab20

  Copy full SHA for fadab20

• Add ifEmpty operator [ci fast]

  Show description for 0e30a8f
  pditommaso

  committed
  0e30a8f

  Copy full SHA for 0e30a8f

Commits on Jan 31, 2025

• Merge branch 'master' into task-tracker-v2

  pditommaso

  committed
  5c275d0

  Copy full SHA for 5c275d0

Commits on Feb 1, 2025

• split wip

  Show description for 213e1da
  pditommaso

  committed
  213e1da

  Copy full SHA for 213e1da

Commits on Feb 2, 2025

• wip

  Show description for d8625d1
  pditommaso

  committed
  d8625d1

  Copy full SHA for d8625d1

Commits on Feb 8, 2025

• Allow Azure Batch tasks to be submitted to different pools (#5766) [ci fast]

  Show description for 8ff5caa
  

  adamrtalbot

  and

  pditommaso

  authored
  8ff5caa

  Copy full SHA for 8ff5caa

• Disable cleanup on remote work dir (#5742)

  Show description for a4687c4
  

  3 peopleauthored
  a4687c4

  Copy full SHA for a4687c4

• Merge branch 'master' into task-tracker-v2

  pditommaso

  committed
  7c7d435

  Copy full SHA for 7c7d435

• Fix tests

  Show description for 996f557
  pditommaso

  committed
  996f557

  Copy full SHA for 996f557

Commits on Feb 9, 2025

• Add splitFastq operator

  Show description for d24da76
  pditommaso

  committed
  d24da76

  Copy full SHA for d24da76

• Remove unused chain operator

  Show description for 63c5440
  pditommaso

  committed
  63c5440

  Copy full SHA for 63c5440

• Into op cleanup

  Show description for 662b467
  pditommaso

  committed
  662b467

  Copy full SHA for 662b467

• Remove deprecated code

  Show description for 40b900f
  pditommaso

  committed
  40b900f

  Copy full SHA for 40b900f

• Name refactor

  Show description for b83e15f
  pditommaso

  committed
  b83e15f

  Copy full SHA for b83e15f

• Merge branch 'master' into task-tracker-v2 [ci fast]

  Show description for 821f643
  pditommaso

  committed
  821f643

  Copy full SHA for 821f643

• Add view operator [ci fast]

  Show description for 2aed5e9
  pditommaso

  committed
  2aed5e9

  Copy full SHA for 2aed5e9

• Add random sample [ci fast]

  Show description for c7fee46
  pditommaso

  committed
  c7fee46

  Copy full SHA for c7fee46

• Add tap operator

  Show description for 7ff6544
  pditommaso

  committed
  7ff6544

  Copy full SHA for 7ff6544

• Add countLines and countFasta

  Show description for 06a2ac3
  pditommaso

  committed
  06a2ac3

  Copy full SHA for 06a2ac3