Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add base resource update #165

Merged
merged 11 commits into from
Jun 28, 2024
Merged

Conversation

Faizal-Eeman
Copy link
Contributor

@Faizal-Eeman Faizal-Eeman commented Jun 28, 2024

Description

Add base resource update feature.

Closes #163

Testing Results

NFTest Manta was run with twice the default CPU and memory allocation and the run time was significantly reduced to 1m on A-mini sample indicating a successful integration of the base resource update feature. The same NFTest without any base resource updates had a runtime of 7m.

NFTest log:

  • without base resource update - /hot/software/pipeline/pipeline-call-gSV/Nextflow/development/unreleased/dependabot/submodules/pipeline-submodules-897d4a3787/gsv_discovery-manta-std-input/call-gSV-5.1.0/HG002.N/log-call-gSV-5.1.0-20240617T182917Z/nextflow-log/trace.txt
  • with base resource update - /hot/software/pipeline/pipeline-call-gSV/Nextflow/development/unreleased/mmootor-add-base-resource-update/base-resource-update-std-input/call-gSV-5.1.0/HG002.N/log-call-gSV-5.1.0-20240628T235035Z/nextflow-log/trace.txt

Checklist

  • I have read the code review guidelines and the code review best practice on GitHub check-list.

  • I have reviewed the Nextflow pipeline standards.

  • The name of the branch is meaningful and well formatted following the standards, using [AD_username (or 5 letters of AD if AD is too long)]-[brief_description_of_branch].

  • I have set up or verified the branch protection rule following the github standards before opening this pull request.

  • I have added my name to the contributors listings in the manifest block in the nextflow.config as part of this pull request, am listed
    already, or do not wish to be listed. (This acknowledgement is optional.)

  • I have added the changes included in this pull request to the CHANGELOG.md under the next release version or unreleased, and updated the date.

  • I have updated the version number in the metadata.yaml and manifest block of the nextflow.config file following semver, or the version number has already been updated. (Leave it unchecked if you are unsure about new version number and discuss it with the infrastructure team in this PR.)

  • I have tested the pipeline on at least one A-mini sample with run_delly = true, run_manta = true, run_qc = true. For run_delly = true, I have tested 'variant_type' set to gSV, gCNV, and both. The paths to the test config files and output directories are captured above in the Testing Results section.

@Faizal-Eeman Faizal-Eeman requested a review from a team as a code owner June 28, 2024 22:30
Copy link
Contributor

@yashpatel6 yashpatel6 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor comment but otherwise looks good!

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggestion (non-blocking): I'd suggest adding a separate test case for running with the resource updater

Copy link
Contributor Author

@Faizal-Eeman Faizal-Eeman Jun 28, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done!
/hot/software/pipeline/pipeline-call-gSV/Nextflow/development/unreleased/mmootor-add-base-resource-update/20240628T234620Z.log

@Faizal-Eeman Faizal-Eeman merged commit 76b343d into main Jun 28, 2024
7 checks passed
@Faizal-Eeman Faizal-Eeman deleted the mmootor-add-base-resource-update branch June 28, 2024 23:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add base resource updater
2 participants