Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing intermediate output files for TC/grid analysis #182

Open
thomas-fred opened this issue May 30, 2024 · 0 comments
Open

Missing intermediate output files for TC/grid analysis #182

thomas-fred opened this issue May 30, 2024 · 0 comments

Comments

@thomas-fred
Copy link
Contributor

Three kinds of output file for the TC/grid analysis are not being produced for a subset of marginal (seldom hit) countries. The files are:

  • length_m_by_edge
  • length_m_by_event
  • pop_affected_by_event

e.g. results/power/by_country/AND/exposure/STORM-HadGEM3-GC31-HM/length_m_by_event.pq which is required by the rule exposure_by_admin_region. If it's not present, snakemake will error.

We should either:

  1. Produce these missing, empty files
  2. Modify the upstream rules to be robust to them missing

Option 1) is probably easier, given how snakemake works

Rather than solve this when running the TC/grid analysis, I used some hacky scripts to write empty files where necessary. For more details see this file and the scripts next to it on the linux cluster: /soge-home/projects/mistral/archive/tc_grid_2024/2024-04-12T155923+0100/handle_missing_outputs/README.md

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant