Pipeline Command

[verdverm]

Implement a pipeline command

• enables writing DAGs for ETL like processes, use cue/tools/flow
• attributes to reference operators, so we can use Go implementations
  • @pick() ... @op()
  • @print() and @write()
• Need to figure out how to reference inputs/outputs between tasks
• Ability to print DAG with something like https://github.com/silas/dag
• Process each glob/file arg with pipeline
• Some way to support single, inline pipeline at CLI cuetils pipeline '{ @extact() a: b: _ } ~ { @mask() c: _ } ~ { @canonical _ }' *.json. What should the separator be? (~, ;), should not be an existing token used ambiguously in that context (like |). Will have to do some processing to make each segment valid CUE (like line break after @op(), first { and last } should be sufficient?