All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog.
We release 0.3.2 version which you can install with pip install syne-tune[extra]
.
Thanks to all contributors (sorted by chronological commit order): @mseeger, @geoalgo, @aaronkl, @wistuba, @talesa, @hfurkanbozkurt, @rsnirwan, @duck105, @ondrejbohdal, @iaroslav-ai, @austinmw, @banyikun, @jjaeyeon, @ltiao
- New tutorial: How to Contribute a New Scheduler
- New tutorial: Multi-Fidelity Hyperparameter Optimization
- YAHPO benchmarks integrated into blackbox repository
- PD1 benchmarks integrated into blackbox repository
- New HPO algorithm: Hyper-Tune
- New HPO algorithm: Differential Evolution Hyperband (DEHB)
- New experimental HPO algorithm: Neuralband
- New HPO algorithm: Grid search (categorical variables only)
- BOTorch searcher
- MOBSTER algorithm supports independent GPs at each rung level
- Support for launching experiments in benchmarking/commons, for local, SageMaker, and simulator back-end
- New benchmark: Fine-tuning Hugging Face transformers
- Add IPython util function to display results as parallel categories plot
- New hyperparameter types
ordinal
,logordinal
- Support no checkpointing in BlackboxRepositoryBackend
- Plateau rule as StoppingCriterion
- Automate PyPI releases: python-publish.yml
- Add license hook
- Replace PyTorch MLP by sklearn in BORE (better performance)
- AWS dependencies moved out of core into
aws
- New dependencies
yahpo
- In SageMaker back-end, trials with low IDs received reports several times. This is fixed
- Fixing issue with checkpoint_s3_uri usage
- Fix mode in BOTorch searcher when maximizing
- Avoid experiment abort due to throttling of SageMaker job launching
- Surrogate model for lcbench defaults to 1-NN now
- Fix conditional imports, so Syne Tune can be run with reduced dependencies
- Fix lcbench blackbox (ignore first and last fidelity)
- Fix bug in BlackboxSimulatorBackend for pause/resume scheduling (issue #304)
- Revert wait_trial_completion_when_stopping to False
- Terminate with error when tuning sees an exception
- Docker Building Fixed by Adding Line Breaks At End of Requirements Files
- Control Decision for Running Trials When Stopping Criterion is Met
- Fix mode MSR and HB+BB
We release 0.3.0 version which you can install with pip install syne-tune[extra]==0.3.0
, thanks to all contributors!
(sorted by chronological commit order :-))
@mseeger, @geoalgo, @iaroslav-ai, @aaronkl, @wistuba, @rsnirwan, @hfurkanbozkurt, @ondrejbohdal, @ltiao, @lostella, @jjaeyeon
- Tensorboard visualization
- Option to change the path where experiments results are written
- Revamp of README.md, addition of an FAQ
- Code formatting with Black
- Scripts for launching and analysing benchmark results of Syne Tune AutoML paper
- Option to avoid suffixing the tuner name with a random hash
- Tutorial for PASHA
- Adds support to run BORE with Hyperband
- Updates python version to 3.8 in remote launcher as 3.6 is EOL
- Support custom images in remote launcher
- Add ZS/SMFO scheduler
- Add support to tune python functions directly rather than file scripts (experimental)
- Now display where results are written at the end of the tuning in addition to the beginning
- Log config space with tuning metadata
- Add option to delete checkpoints of finished trials and improve support of checkpointing for SageMaker backend
- Add support for adding surrogate on top of blackboxes evaluations
- Removed deprecated
search_space
which has been renamedconfig_space
in all the code base - Removed some unused dependencies
- fix conditional imports
- avoid sampling twice the same candidate in REA
- print tuning statistics only for numerics
- allow to load blackboxes without s3 credentials
- fix sagemaker root path in remote launcher
- fix a typo in product kernel implementation