Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/mdolce metadata #73

Draft
wants to merge 9 commits into
base: develop
Choose a base branch
from
Draft

Feature/mdolce metadata #73

wants to merge 9 commits into from

Conversation

mdolce8
Copy link
Member

@mdolce8 mdolce8 commented Feb 1, 2025

This is a working state of the dump_metadata.sh script. Metadata was created, using this script, on the DUNE GPVMs, on run-spill-build output files for the TMS group to run reconstruction on for their geometry studies.

To run this script:

  1. copy the files to DUNE GPVMs.
  2. cd <dune-tms/repo/dir> ; source setup_FNAL.sh
  3. python /path/to/repo/2x2_sim/admin/dump_metadata.sh <metadata args>

It is advised to do this in a screen session currently, as this can take a while. Also a drain is likely needed, especially if you have large files.

Currently in draft state -- I handed the json and ROOT files of the spill build to Steve Timm for him to declare the files to metacat and rucio. I am waiting to hear back from Steve Timm on the status, just to be 100% sure it all succeeded. Once it does, I will make PR

…, tms event stats, data_stream), and modify how the bulk of the metadata gets saved. Most should be under the 'metadata' field.
… '_' . make genie tune the default AR23_20i_00_000
…ight now), and lets punt on parents. And namespace should always be 'ndprod'
…w. We'll get this info once we're at the stage of running this script at the end of the nersc job.
…nd print out the args, was helpful now and should also be in future too
@mdolce8 mdolce8 requested a review from alexbooth92 February 1, 2025 00:57
…pe' must be the same. So far Steve T has only made 'near-det-lar' , so that's the only valid option for args.namespace at the moment. WHen we have more samples, we should ask him to make more namespaces...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant