Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Fan-In/Fan-Out workflow process execution #105

Closed
fmigneault opened this issue Apr 24, 2020 · 0 comments · Fixed by #462
Closed

Support Fan-In/Fan-Out workflow process execution #105

fmigneault opened this issue Apr 24, 2020 · 0 comments · Fixed by #462
Labels
feature/CWL Issue related to CWL support project/OGC Related to OGC testbeds or relavant projects. triage/experimental Something related to experimental features and/or package version triage/feature New requested feature.

Comments

@fmigneault
Copy link
Collaborator

fmigneault commented Apr 24, 2020 •
edited
Loading

Implement and validate functionalities revolving around parallelized process execution.

OGC Pilot EO Apps brought the idea of using the ScatterFeatureRequirement in order to define whether an input array should be parallelized over multiple process execution. Needs to be investigated.

cwl reference:
https://www.commonwl.org/user_guide/topics/workflows.html#scattering-steps

Examples could be taken from EO-App Best Practice report:
https://gitlab.ogc.org/ogc/eoap-best-practice/-/blob/master/document.pdf
see also #294
@fmigneault fmigneault added triage/feature New requested feature. triage/experimental Something related to experimental features and/or package version project/OGC Related to OGC testbeds or relavant projects. labels Apr 24, 2020
@fmigneault fmigneault added the feature/CWL Issue related to CWL support label May 10, 2021
@fmigneault fmigneault mentioned this issue Aug 25, 2021
Open
18 tasks
fmigneault added a commit that referenced this issue Dec 21, 2021
@fmigneault
add reference to tmp test for scatter (relates to #105)
b08c334
fmigneault added a commit that referenced this issue Mar 24, 2022
@fmigneault
conformance api can return references by category + add CWL / OGC-Bes…
3388b78 
…t-Practices EO App Pkg conformance items (relates to #56, #103, #105, #294, #399)
@fmigneault fmigneault mentioned this issue Mar 24, 2022
Merged
fmigneault added a commit that referenced this issue Aug 23, 2022
@fmigneault
[WIP] workflows ScatterFeatureRequirement (relates to #105) + func wo…
e0b406f 
…rkflow tests (relates to #11) + OGC Media-Types format for CWL
@fmigneault fmigneault mentioned this issue Aug 24, 2022
Merged
fmigneault added a commit that referenced this issue Sep 12, 2022
@fmigneault
[WIP] workflows ScatterFeatureRequirement (relates to #105) + func wo…
52720e2 
…rkflow tests (relates to #11) + OGC Media-Types format for CWL
fmigneault added a commit that referenced this issue Sep 14, 2022
@fmigneault
working CWL ScatterFeatureRequirement with dispatched WPS-1/OGC-API p…
41e7c56 
…rocesses (fixes #105)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature/CWL Issue related to CWL support project/OGC Related to OGC testbeds or relavant projects. triage/experimental Something related to experimental features and/or package version triage/feature New requested feature.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

functional tests crim-ca/weaver
1 participant
@fmigneault