Update heavy-ion eras for 2024 + add MC RelVal workflows #45307

mandrenguyen · 2024-06-26T02:18:18Z

Sets up heavy-ion eras for 2024:

Implements HI reco, i.e.,pp_on_PbPb type eras and their corresponding MC relval workflows (161,161.2,161.02, etc)
Updates the UPC eras to be based on Run3_2024, rather than just Run3, although I think for the moment they're equivalent

Note that certain sim customizations for the ZDC and HF fine-grained bit are for now just copied from the 2023 era. They are extended to the UPC era, although this era is so far only used for the reco step, not for the digi one. In case the UPC era is used for digi at some point, it's better to change this now.

The heavy-ion embedding (event overlay) workflows are not extended to 2024 yet. This will be done in a subsequent PR.

No backport will be needed.

cmsbuild · 2024-06-26T02:18:46Z

cms-bot internal usage

mandrenguyen · 2024-06-26T02:23:48Z

test parameters:

workflows = 161, 161.02, 161.03, 161.1, 180, 180.1, 181, 181.1, 142.901, 142.902

cmsbuild · 2024-06-26T02:25:41Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-45307/40717

This PR adds an extra 92KB to repository
There are other open Pull requests which might conflict with changes you have proposed:
- File Configuration/PyReleaseValidation/python/relval_standard.py modified in PR(s): 2024 Data RelVals and InputInfo Events Skimming (actually) Working #45055
- File Configuration/PyReleaseValidation/python/relval_steps.py modified in PR(s): 2024 Data RelVals and InputInfo Events Skimming (actually) Working #45055
- File Configuration/StandardSequences/python/Eras.py modified in PR(s): Add run3 tracking low pu era #33532, Cleanup MINI/NANO modifiers #45240

cmsbuild · 2024-06-26T02:26:04Z

A new Pull Request was created by @mandrenguyen for master.

It involves the following packages:

Configuration/Eras (operations)
Configuration/PyReleaseValidation (pdmv, upgrade)
Configuration/StandardSequences (operations)
SimCalorimetry/HcalTrigPrimProducers (l1)
SimG4Core/Application (simulation)

@srimanob, @subirsarkar, @aloeliger, @civanch, @rappoccio, @fabiocos, @davidlange6, @kskovpen, @mdhildreth, @miquork, @cmsbuild, @AdrianoDee, @sunilUIET, @antoniovilela, @epalencia can you please review it and eventually sign? Thanks.
@missirol, @VinInn, @rovere, @mmusich, @GiacomoSguazzoni, @AnnikaStein, @VourMa, @dgulhan, @slomeo, @bsunanda, @fabiocos, @Martin-Grunewald, @sameasy, @abdoulline, @JanFSchulte, @mtosi, @makortel, @felicepantaleo this is something you requested to watch as well.
@antoniovilela, @sextonkennedy, @rappoccio you are the release manager for this.

cms-bot commands are listed here

mandrenguyen · 2024-06-26T02:32:14Z

please test

cmsbuild · 2024-06-26T03:29:17Z

-1

Failed Tests: UnitTests RelVals RelVals-INPUT AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a0d7d8/40078/summary.html
COMMIT: a0ea6a0
CMSSW: CMSSW_14_1_X_2024-06-25-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/45307/40078/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 4 errors in the following unit tests:

---> test test_MC_22_crosscheck had ERRORS
---> test test_MC_23_crosscheck had ERRORS
---> test test_MC_22_setup had ERRORS
and more ...

RelVals

139.001

----- Begin Fatal Exception 26-Jun-2024 04:57:39 CEST-----------------------
An exception of category 'PluginLibraryLoadError' occurred while
   [0] Constructing the EventProcessor
   [1] While attempting to load plugin L1TRawToDigi
Exception Message:
unable to load /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02843/el8_amd64_gcc12/cms/cmssw-patch/CMSSW_14_1_X_2024-06-25-2300/lib/el8_amd64_gcc12/poisoned/plugin-poisoned-EventFilterL1TRawToDigiAuto.so because /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02843/el8_amd64_gcc12/cms/cmssw-patch/CMSSW_14_1_X_2024-06-25-2300/lib/el8_amd64_gcc12/poisoned/plugin-poisoned-EventFilterL1TRawToDigiAuto.so: cannot open shared object file: No such file or directory
----- End Fatal Exception -------------------------------------------------

136.731

----- Begin Fatal Exception 26-Jun-2024 04:57:39 CEST-----------------------
An exception of category 'PluginLibraryLoadError' occurred while
   [0] Constructing the EventProcessor
   [1] While attempting to load plugin L1TRawToDigi
Exception Message:
unable to load /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02843/el8_amd64_gcc12/cms/cmssw-patch/CMSSW_14_1_X_2024-06-25-2300/lib/el8_amd64_gcc12/poisoned/plugin-poisoned-EventFilterL1TRawToDigiAuto.so because /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02843/el8_amd64_gcc12/cms/cmssw-patch/CMSSW_14_1_X_2024-06-25-2300/lib/el8_amd64_gcc12/poisoned/plugin-poisoned-EventFilterL1TRawToDigiAuto.so: cannot open shared object file: No such file or directory
----- End Fatal Exception -------------------------------------------------

140.023

----- Begin Fatal Exception 26-Jun-2024 04:57:39 CEST-----------------------
An exception of category 'PluginLibraryLoadError' occurred while
   [0] Constructing the EventProcessor
   [1] While attempting to load plugin L1TRawToDigi
Exception Message:
unable to load /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02843/el8_amd64_gcc12/cms/cmssw-patch/CMSSW_14_1_X_2024-06-25-2300/lib/el8_amd64_gcc12/poisoned/plugin-poisoned-EventFilterL1TRawToDigiAuto.so because /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02843/el8_amd64_gcc12/cms/cmssw-patch/CMSSW_14_1_X_2024-06-25-2300/lib/el8_amd64_gcc12/poisoned/plugin-poisoned-EventFilterL1TRawToDigiAuto.so: cannot open shared object file: No such file or directory
----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

RelVals-INPUT

134.801134.801_RunHLTPhy2015C/step2_RunHLTPhy2015C.log
134.802134.802_RunDoubleEG2015C/step2_RunDoubleEG2015C.log
134.803134.803_RunDoubleMuon2015C/step2_RunDoubleMuon2015C.log

Expand to see more relval errors ...

AddOn Tests

fastsim1

----- Begin Fatal Exception 26-Jun-2024 04:55:28 CEST-----------------------
An exception of category 'PluginLibraryLoadError' occurred while
   [0] Constructing the EventProcessor
   [1] While attempting to load plugin L1TDigiToRaw
Exception Message:
unable to load /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02843/el8_amd64_gcc12/cms/cmssw-patch/CMSSW_14_1_X_2024-06-25-2300/lib/el8_amd64_gcc12/poisoned/plugin-poisoned-EventFilterL1TRawToDigiAuto.so because /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02843/el8_amd64_gcc12/cms/cmssw-patch/CMSSW_14_1_X_2024-06-25-2300/lib/el8_amd64_gcc12/poisoned/plugin-poisoned-EventFilterL1TRawToDigiAuto.so: cannot open shared object file: No such file or directory
----- End Fatal Exception -------------------------------------------------

fastsim2

----- Begin Fatal Exception 26-Jun-2024 04:55:29 CEST-----------------------
An exception of category 'PluginLibraryLoadError' occurred while
   [0] Constructing the EventProcessor
   [1] While attempting to load plugin L1TDigiToRaw
Exception Message:
unable to load /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02843/el8_amd64_gcc12/cms/cmssw-patch/CMSSW_14_1_X_2024-06-25-2300/lib/el8_amd64_gcc12/poisoned/plugin-poisoned-EventFilterL1TRawToDigiAuto.so because /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02843/el8_amd64_gcc12/cms/cmssw-patch/CMSSW_14_1_X_2024-06-25-2300/lib/el8_amd64_gcc12/poisoned/plugin-poisoned-EventFilterL1TRawToDigiAuto.so: cannot open shared object file: No such file or directory
----- End Fatal Exception -------------------------------------------------

hlt_mc_Fake1

----- Begin Fatal Exception 26-Jun-2024 04:55:03 CEST-----------------------
An exception of category 'PluginLibraryLoadError' occurred while
   [0] Constructing the EventProcessor
   [1] While attempting to load plugin L1TDigiToRaw
Exception Message:
unable to load /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02843/el8_amd64_gcc12/cms/cmssw-patch/CMSSW_14_1_X_2024-06-25-2300/lib/el8_amd64_gcc12/poisoned/plugin-poisoned-EventFilterL1TRawToDigiAuto.so because /cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02843/el8_amd64_gcc12/cms/cmssw-patch/CMSSW_14_1_X_2024-06-25-2300/lib/el8_amd64_gcc12/poisoned/plugin-poisoned-EventFilterL1TRawToDigiAuto.so: cannot open shared object file: No such file or directory
----- End Fatal Exception -------------------------------------------------

Expand to see more addon errors ...

mandrenguyen · 2024-06-26T14:53:50Z

please test
These tests seem to run file locally. I'm not sure what this poisoned plugin error mentioned in the logs is about.
For lack of a better idea, I'm just gonna try to the tests again and see if this was transient.
If anyone has some insight please enlighten me.

mmusich · 2024-06-26T14:56:05Z

For lack of a better idea, I'm just gonna try to the tests again and see if this was transient.

this issue was caused by a severely broken IB CMSSW_14_1_X_2024-06-25-2300 due to this PR. See discussion there for a rationale. It was fixed in CMSSW_14_1_X_2024-06-26-1200

civanch · 2024-07-02T15:41:20Z

+1

mandrenguyen · 2024-07-08T19:48:58Z

ping @cms-sw/pdmv-l2 @cms-sw/upgrade-l2

srimanob · 2024-07-08T20:59:51Z

+Upgrade

srimanob · 2024-07-08T21:01:00Z

@cmsbuild please test

Retrigger the test after 2 weeks, before merging.

cmsbuild · 2024-07-09T00:29:02Z

+1

Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-a0d7d8/40287/summary.html
COMMIT: de91238
CMSSW: CMSSW_14_1_X_2024-07-08-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/45307/40287/install.sh to create a dev area with all the needed externals and cmssw changes.

DAS Queries: The DAS query tests failed, see the summary page for details.

Comparison Summary

Summary:

You potentially added 2 lines to the logs
Reco comparison results: 11 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3345088
DQMHistoTests: Total failures: 6
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3345062
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 202 log files, 165 edm output root files, 48 DQM output files
TriggerResults: no differences found

AdrianoDee · 2024-07-09T07:27:07Z

+pdmv

rappoccio · 2024-07-16T15:17:59Z

+1

cmsbuild · 2024-07-16T15:18:19Z

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will be automatically merged.

mandrenguyen added 4 commits June 25, 2024 22:16

Added and made explicit HI 2024 eras

fd7a29b

Add 2024 HI era + MB relval wfs

4ef2727

set sim settings for 2024 HI MC

75b58ed

various bug fixes

a0ea6a0

cmsbuild added this to the CMSSW_14_1_X milestone Jun 26, 2024

cmsbuild added simulation-pending l1-pending operations-pending pending-signatures tests-pending orp-pending pdmv-pending upgrade-pending code-checks-pending labels Jun 26, 2024

cmsbuild added code-checks-approved and removed code-checks-pending labels Jun 26, 2024

cmsbuild added tests-started and removed tests-pending labels Jun 26, 2024

cmsbuild added tests-rejected and removed tests-started labels Jun 26, 2024

cmsbuild added tests-started and removed tests-rejected labels Jun 26, 2024

cmsbuild added simulation-approved and removed simulation-pending labels Jul 2, 2024

This was referenced Jul 3, 2024

Cleanup MINI/NANO modifiers #45240

Merged

New SimBeamSpotHLLHC tags in Phase-2 MC GT and make Phase-2 workflows consume it #45387

Merged

cmsbuild added upgrade-approved and removed upgrade-pending labels Jul 8, 2024

cmsbuild added tests-started and removed tests-approved labels Jul 8, 2024

cmsbuild added tests-approved and removed tests-started labels Jul 9, 2024

cmsbuild added pdmv-approved and removed pdmv-pending labels Jul 9, 2024

This was referenced Jul 10, 2024

Update nano relval matrix #45419

Merged

PPS tests updated with 2024 data #45456

Merged

cmsbuild added operations-approved fully-signed orp-approved and removed operations-pending pending-signatures orp-pending labels Jul 16, 2024

cmsbuild merged commit 702ffcd into cms-sw:master Jul 16, 2024
12 checks passed

makortel mentioned this pull request Jul 19, 2024

Added TestSourceProcessor helper #45443

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update heavy-ion eras for 2024 + add MC RelVal workflows #45307

Update heavy-ion eras for 2024 + add MC RelVal workflows #45307

mandrenguyen commented Jun 26, 2024

cmsbuild commented Jun 26, 2024 •

edited

Loading

mandrenguyen commented Jun 26, 2024

cmsbuild commented Jun 26, 2024

cmsbuild commented Jun 26, 2024

mandrenguyen commented Jun 26, 2024

cmsbuild commented Jun 26, 2024

mandrenguyen commented Jun 26, 2024 •

edited

Loading

mmusich commented Jun 26, 2024

civanch commented Jul 2, 2024

mandrenguyen commented Jul 8, 2024

srimanob commented Jul 8, 2024

srimanob commented Jul 8, 2024

cmsbuild commented Jul 9, 2024

AdrianoDee commented Jul 9, 2024

rappoccio commented Jul 16, 2024

cmsbuild commented Jul 16, 2024

Update heavy-ion eras for 2024 + add MC RelVal workflows #45307

Update heavy-ion eras for 2024 + add MC RelVal workflows #45307

Conversation

mandrenguyen commented Jun 26, 2024

cmsbuild commented Jun 26, 2024 • edited Loading

mandrenguyen commented Jun 26, 2024

cmsbuild commented Jun 26, 2024

cmsbuild commented Jun 26, 2024

mandrenguyen commented Jun 26, 2024

cmsbuild commented Jun 26, 2024

Unit Tests

RelVals

RelVals-INPUT

AddOn Tests

mandrenguyen commented Jun 26, 2024 • edited Loading

mmusich commented Jun 26, 2024

civanch commented Jul 2, 2024

mandrenguyen commented Jul 8, 2024

srimanob commented Jul 8, 2024

srimanob commented Jul 8, 2024

cmsbuild commented Jul 9, 2024

Comparison Summary

AdrianoDee commented Jul 9, 2024

rappoccio commented Jul 16, 2024

cmsbuild commented Jul 16, 2024

cmsbuild commented Jun 26, 2024 •

edited

Loading

mandrenguyen commented Jun 26, 2024 •

edited

Loading