Skip to content

Lower ReduceLROnPlateau from 0.001 to 1e-6#114

Open
StoryofLegend wants to merge 2 commits into
ArnovanHilten:masterfrom
StoryofLegend:fix/reducelr-min-lr
Open

Lower ReduceLROnPlateau from 0.001 to 1e-6#114
StoryofLegend wants to merge 2 commits into
ArnovanHilten:masterfrom
StoryofLegend:fix/reducelr-min-lr

Conversation

@StoryofLegend

@StoryofLegend StoryofLegend commented Jun 15, 2026

Copy link
Copy Markdown

Summary

Lowers the min_lr floor of the ReduceLROnPlateau callback in train_model from 0.001 to 1e-6.

Motivation

ReduceLROnPlateau is configured with factor=0.2 and min_lr=0.001. Because the floor (min_lr = 0.001) is close to typical starting learning rates, the scheduler has little or no room to anneal the learning rate.
Lowering the floor to 1e-6 lets the learning rate decay accross several reductions when val_loss plateaus, which help convergence.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant