[NO MERGE]: torch-2.13+cu130 and flash-attn-3 on santis - #2664

Closed

florianscheidl wants to merge 78 commits into

ecmwf:develop-sslfrom

florianscheidl:exp/try-pytorch-213-flash-attn-diff-versions

Commits on May 22, 2026

Revert "Spherical RoPE (#2082)" (#2399)
clessig
authored
89f97a3

Commits on May 26, 2026

adding three new regions for evaluation (#2385)
Tewson1
authored
388b90c

Commits on May 27, 2026

Commits on May 28, 2026

added arctic region for plotting in stereographic projection and modified projection logic (#2401)

authored
b684247

Commits on May 29, 2026

Sgrasse/develop/342 streams as dict (#2242)
grassesi
authored
835e0b8
combine inference from multiple ranks in evaluation (#2400)

iluise
and
SavvasMel
authored
764c455
Sgrasse/develop/2353 plot train (#2354)

grassesi
and
clessig
authored
ef637b5
Score animations with fixed colorbar (#2402)

SavvasMel
and
iluise
authored
84a60a9
apply scale_z_channels (#2417)

jpolz
and
iluise
authored
283f73a

Commits on Jun 1, 2026

Fix bug in the evaluation wegen_reader.py (#2431)
SavvasMel
authored
693f342

Commits on Jun 5, 2026

integrate plot as a function of initialization time into FastEvaluation (#2436)

iluise
and
shmh40
authored
ee0010a

Commits on Jun 7, 2026

Fixed how alive runs are determined. Made col len configurable (#2462)
clessig
authored
90ab24b
Remove memory pinning for validation to avoid crashes (#2460)
clessig
authored
5d7df94
Move data reader fesom to extra package (#2454)

kacpnowak
and
clessig
authored
8bfb2c3

Commits on Jun 8, 2026

remove clim align when not necessary (#2456)

authored
7423f17
implement power spectra (#2398)
iluise
authored
8c1af86

Commits on Jun 9, 2026

Commits on Jun 10, 2026

Fix missing type of ranks when specified as list (#2478)

clessig
and
iluise
authored
f83bc3a
Implement regular subsampling for DataReaderMesh (#2408)

kacpnowak
and
SavvasMel
authored
06803b7

Commits on Jun 12, 2026

Restore streams_directory overwrite behavior (#2490)

authored
79082ac
update json file (#2483)

authored
054c013
implement regridding in FastEval (#2494)
iluise
authored
4a92441
remove redundant plots for score_timeseries (#2497)
iluise
authored
ee193c2

Commits on Jun 15, 2026

[1050] Upgrade to torch 2.9.1 (#2310)
florianscheidl
authored
e65d99a

Commits on Jun 18, 2026

Implement Dynamic Channel-Weighting MSE loss (#2486)
kacpnowak
authored
1468a50
Evenmn/clessig/cristianl/pr1699 anemoi config join (#2519)

authored
4e52780
Override nvidia-nccl-cu12 >=2.29 to fix multi-node training on Alps (#2523)

ekouts
and
clessig
authored
6c94022

Commits on Jun 19, 2026

Restore gitignore that was accidentally removed in a recent commit (#2530)
evenmn
authored
f9bc4ee

Commits on Jun 22, 2026

multi_stream_data_sampler: Select existing filename from multiple options (#2525)
jpolz
authored
2317e19

Commits on Jun 25, 2026

[2555] chore(embeddings): remove forward_columns path in StreamEmbedTransformer (#2556)
florianscheidl
authored
10f838d
Fused optimizer (#2544)

florianscheidl
and
clessig
authored
61773bd
[2552] feat(trainer): add nvtx annotations (#2553)

florianscheidl
and
clessig
authored
3ea6024

Commits on Jun 26, 2026

[2186] Scaling utils (#2231)

authored
c15d20a
[2548] feat(train): make gradient scaler optional (#2549)

florianscheidl
and
clessig
authored
d62a212
[2298] Fix CI (#2299)
tjhunter
authored
f8f3080

Commits on Jun 29, 2026

call BatchSample method instead of repeating content (#2348)
TillHae
authored
54595ea
[2304] Adjust eval for precipitations (#2521)
vhertel
authored
9d603fe
[2526] Add configurable coords column names to obs reader (#2533)

vhertel
and
clessig
authored
689a82d

Commits on Jun 30, 2026

reinstating functions for power spectra (#2575)
enssow
authored
a52117d
Fix Dynamic Loss EMA update with forecast offset (#2567)

kacpnowak
and
clessig
authored
1850df9

Commits on Jul 1, 2026

Add timeseries plotting (#2435)
SavvasMel
authored
50196f9
fix sample and ipoint duplication with multiple ranks. (#2565)

iluise
and
clessig
authored
4ae7d06

Commits on Jul 3, 2026

Commits on Jul 10, 2026

[2502][evaluation] score bug fixes (#2503)

moritzhauschulz
and
claude
authored
c4d2aa1

Commits on Jul 13, 2026

[2507][Evaluation] Implement Adjusted SSR (#2508)

authored
e38dd45

Commits on Jul 14, 2026

[2531] Require geoinfo_channels for obs streams (#2534)

vhertel
and
clessig
authored
f2e43ad
pyproject with pt 2.13 and flash-attn-3
florianscheidl
committed
b2f5408
Update pyproejct
florianscheidl
committed
baf79ef
Remove old flash attention for now
florianscheidl
committed
b96135a
Using cuda 13
florianscheidl
committed
8ab1bef

Commits on Jul 15, 2026

avoid score computation when unnecessary and trigger json recompilation when config settings change (#2598)

iluise
and
jpolz
authored
680066f
Add geoinfos to obs streams (#2641)

vhertel
and
iluise
authored
2bcc95c
Export esemble members to cf-compliant netcdf (#2247)

s6sebusc
and
enssow
authored
9da4fcf

Commits on Jul 16, 2026

Use FA3 for attention and encoder
florianscheidl
committed
edea25e
Update operational analysis filename to up to date (#2651)
shmh40
authored
4f9932b

Commits on Jul 17, 2026

Merge branch 'develop' into exp/try-pytorch-213-flash-attn-diff-versions
florianscheidl
committed
c810422
Update surface dataset paths to v5 (#2653)
shmh40
authored
52f650a
Fix filename for integration test (#2654)
lxavier
authored
1de1e47

Commits on Jul 20, 2026

Updated pyproject
florianscheidl
committed
60984f9
Synop int. test, token_size 512 tok_spctm = False (#2659)
shmh40
authored
634440a
no build isolation
florianscheidl
committed
dd73c9b
Change colorbars in scatter_plot (#2634)

iluise
and
clessig
authored
c3a9119
temporary pin
florianscheidl
committed
7249859
platform restriction
florianscheidl
committed
fcaf119
Merge branch 'exp/try-pytorch-213-flash-attn-diff-versions' of github.com:florianscheidl/WeatherGenerator into exp/try-pytorch-213-flash-attn-diff-versions
florianscheidl
committed
12069e2

Commits on Jul 21, 2026

Merge branch 'develop' into exp/try-pytorch-213-flash-attn-diff-versions
florianscheidl
committed
32bf20d