[FEATURE] Add additional digit of precision for specifying learning rate and other parameters #661
Description
🚀 Feature
It would be helpful to be able to specify learning rate and other parameters with 7 decimal digits, (i.e. 1e-7), rather than the current 6.
Motivation
When getting down to final fine-tuning of models, I find that at being able to adjust learning rate in steps of 5e-7 or less can be helpful to get the best results. However, the current UX only allows steps of 1e-6. Currently I make changes to the code itself to allow the exact step I want, but this requires a code change for every model run rather than being able to do this through the UI.