ESMValCore v2.10.0 release

[zklaus]

Dear @ESMValGroup/esmvaltool-developmentteam,

today we are kicking off the release process for release 2.10.0.
Over the next four weeks, we'll prepare the release of ESMValTool v2.10.0, starting with the feature freeze of ESMValCore today.
Stay tuned for further news and updates here.

Manager	Buddy	Feature Freeze	Feature branch	Milestone
@zklaus	@bouweandela	2023-10-09

Minor Release	Status	Date	RTD	Release	conda-forge	PyPI	Docker
v2.10.0rc1		2023-11-01	Docs	v2.10.0rc1	esmvalcore_rc	esmvalcore (--pre)	docker
v2.10.0		2023-12-19	Docs	v2.10.0	esmvalcore	esmvalcore	docker

[valeriupredoi]

Almost 3:10 to Yuma 😁 (great movie BTW)

[zklaus]

As a sanity check before making the release candidate, I ran the following recipes. A check means the recipe ran successfully.

• bock20jgr/recipe_bock20jgr_fig_1-4.yml (Input data versions can confuse ESMValTool #2239)
• clouds/recipe_clouds_bias.yml
• clouds/recipe_lauer22jclim_fig3-4_zonal.yml (Ran out of time)
• examples/recipe_decadal.yml
• examples/recipe_python.yml
• examples/recipe_ncl.yml
• examples/recipe_r.yml
• ipccwg1ar6ch3/recipe_ipccwg1ar6ch3_atmosphere.yml (Sorting of ensemble members (#2095) breaks with mix of facet value types #2237)
• ipccwg1ar5ch9/recipe_flato13ipcc_figure_945a.yml
• recipe_anav13jclim.yml (Data problem on test machine, possibly Input data versions can confuse ESMValTool #2239)
• recipe_autoassess_landsurface_soilmoisture.yml
• recipe_autoassess_stratosphere.yml
• recipe_climwip_test_basic.yml (Sorting of ensemble members (#2095) breaks with mix of facet value types #2237)
• recipe_climwip_test_performance_sigma.yml (Sorting of ensemble members (#2095) breaks with mix of facet value types #2237)
• recipe_collins13ipcc.yml (Input data versions can confuse ESMValTool #2239)
• recipe_cmug_h2o.yml
• recipe_cox18nature.yml
• recipe_extreme_events.yml
• recipe_extreme_index.yml
• recipe_impact.yml (Sorting of ensemble members (#2095) breaks with mix of facet value types #2237)
• recipe_hyint.yml
• recipe_meehl20sciadv.yml
• recipe_toymodel.yml

[bouweandela]

If you're using the distributed scheduler, the failure of clouds/recipe_lauer22jclim_fig3-4_zonal.yml may be related to SciTools/iris#5457

[zklaus]

I did not use the distributed scheduler, but best I can tell, that recipe simply ran out of time; nothing else wrong, so I'll defer further testing to after the rc.

[zklaus]

I have unchecked recipe_bock20jgr_fig_1-4.yml now because I think it might be linked to #2239. I had previously fixed the version problem by adding version to the filename template for obs4MIPs in config_developer.yml, but seeing as the version problem is a wider issue, I would like to address that first and see if it solves the obs4MIPs issue as well.

[bouweandela]

@ESMValGroup/esmvaltool-developmentteam Would anyone have suggestions for highlights for the ESMValCore v2.10 changelog? We're planning to make the release today. Here is an example of what that looked like for v2.9.

[schlunma]

• Added percentile operation for statistics preprocessor (Added new operators for statistics preprocesor (e.g., percentile) and allowed arbitrary kwargs #2191)
• Improved output website (Dynamic HTML output for monitoring #2062)
• Further progress regarding out-of-core computing/dask/memory efficiency: Rechunk between preprocessor steps #2205, Reduce the size of the dask graph created by the anomalies preprocessor function #2200, Make preprocessors mask_above/below_threshold, mask_inside/outside_range lazy  #2169, Call coord.core_bounds() instead of coord.bounds in check.py #2146

[axel-lauer]

This is one of my highlights (but probably rather v2.11?):

• New preprocessor: local_solar_time #2258

[bouweandela]

The release is now available! 🥳 A big thanks to everyone who contributed! 🌟