Skip to content

Commit

Permalink
Prepare release 0.71.0 (#3244)
Browse files Browse the repository at this point in the history
* Adding the new version to the necessary files.

* modified release notes

---------

Co-authored-by: ZenML GmbH <[email protected]>
Co-authored-by: Baris Can Durak <[email protected]>
  • Loading branch information
3 people authored Dec 5, 2024
1 parent 61988c0 commit f0d59c6
Show file tree
Hide file tree
Showing 15 changed files with 899 additions and 764 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -333,7 +333,7 @@ the Apache License Version 2.0.
<a href="https://github.com/zenml-io/zenml-projects">Projects Showcase</a>
<br />
<br />
🎉 Version 0.70.0 is out. Check out the release notes
🎉 Version 0.71.0 is out. Check out the release notes
<a href="https://github.com/zenml-io/zenml/releases">here</a>.
<br />
🖥️ Download our VS Code Extension <a href="https://marketplace.visualstudio.com/items?itemName=ZenML.zenml-vscode">here</a>.
Expand Down
112 changes: 112 additions & 0 deletions RELEASE_NOTES.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,117 @@
<!-- markdown-link-check-disable -->

# 0.71.0

ZenML version 0.71.0 delivers a new Modal step operator integration as its
core feature, enabling efficient cloud execution for ML pipelines with granular
hardware configuration options. The release strengthens enterprise capabilities
through improved token management and dashboard features, while expanding
artifact handling with dynamic naming and enhanced visualization support.
Additionally, it includes various infrastructure improvements and bug fixes
that enhance the platform's stability and usability, particularly around
Docker connectivity, Kubernetes management, and service connector operations.

## New Feature: Modal Step Operator Integration

ZenML now [integrates with Modal](https://modal.com/), bringing lightning-fast
cloud execution capabilities to your ML pipelines. This new step operator[
https://docs.zenml.io/stack-components/step-operators/modal] allows you to
execute individual pipeline steps on Modal's specialized compute instances,
offering notable speed particularly for Docker image building and hardware
provisioning. With simple configuration options, you can precisely specify
hardware requirements like GPU type, CPU count, and memory for each step,
making it ideal for resource-intensive ML workloads.

## Other Highlights

- **Workload API Token Management:** Refactored token management for improved
security with a generic API token dispenser.
- **Dashboard Enhancements:**
- Introduced service account management capabilities.
- Added API key creation and integration features.
- **Dynamic Artifact Naming:** Introduced capability to dynamically name
artifacts.
- **Visualization Enhancements:** Made dictionaries and lists visualizable,
added JSON visualization type.

## Additional Features and Improvements

- Improved error messages for Docker daemon connectivity
- Enhanced SageMaker URL handling
- Simplified model version artifact linkage
- Added testing for pipeline templates
- Improved Kubernetes pod and label length management
- Allowed skipping type annotations for step inputs
- Enabled using feature service instances instead of just names

## Bug Fixes

- Fixed issues with getting out of an inaccessible active stack
- Fixed race conditions in the service connector type registry
- Resolved migration test complications
- Corrected documentation links
- Fixed artifact store and artifact URI handling
- Addressed various scalability and compatibility issues

## Documentation Updates

- Added documentation redirects
- Updated PyTorch documentation links
- Improved service connector documentation

## What's Changed
* Refactored workload API token management for better security and implemented generic API token dispenser by @stefannica in https://github.com/zenml-io/zenml/pull/3154
* Add 0.70.0 to the migration tests by @avishniakov in https://github.com/zenml-io/zenml/pull/3190
* Adjustments to the PR template by @bcdurak in https://github.com/zenml-io/zenml/pull/3194
* [docs] Fix links in the how-to section of docs by @wjayesh in https://github.com/zenml-io/zenml/pull/3196
* Fixing sagemaker urls to take the settings into consideration by @bcdurak in https://github.com/zenml-io/zenml/pull/3195
* Add cached run into testing of migrations by @avishniakov in https://github.com/zenml-io/zenml/pull/3199
* Fix service connector type registry race conditions by @stefannica in https://github.com/zenml-io/zenml/pull/3202
* Refactor container resource configuration in Vertex Orchestrator test by @avishniakov in https://github.com/zenml-io/zenml/pull/3203
* [docs] Add missing redirects by @wjayesh in https://github.com/zenml-io/zenml/pull/3200
* Add links to `uv` new PyTorch documentation by @strickvl in https://github.com/zenml-io/zenml/pull/3204
* Fix broken docs link by @strickvl in https://github.com/zenml-io/zenml/pull/3208
* Bugfix for getting out of an inaccessible active stack with no permissions by @bcdurak in https://github.com/zenml-io/zenml/pull/3198
* Simplify model version artifact linkage by @schustmi in https://github.com/zenml-io/zenml/pull/3175
* Reenable macos testing by @avishniakov in https://github.com/zenml-io/zenml/pull/3205
* Various fixes and improvements by @stefannica in https://github.com/zenml-io/zenml/pull/3211
* Pass config path during zenml pipeline build by @schustmi in https://github.com/zenml-io/zenml/pull/3212
* Add test for running templates by @schustmi in https://github.com/zenml-io/zenml/pull/3192
* Fix service connector docstring by @schustmi in https://github.com/zenml-io/zenml/pull/3216
* Improve error message when docker daemon is not reachable by @schustmi in https://github.com/zenml-io/zenml/pull/3214
* Don't run migration for empty updates by @schustmi in https://github.com/zenml-io/zenml/pull/3210
* Remove `--check` from format script and fix naming by @safoinme in https://github.com/zenml-io/zenml/pull/3218
* More scalability improvements by @schustmi in https://github.com/zenml-io/zenml/pull/3206
* Use correct keyword for artifact store open by @schustmi in https://github.com/zenml-io/zenml/pull/3220
* Fix passing of some sagemaker settings by @schustmi in https://github.com/zenml-io/zenml/pull/3221
* Add hint when trying to connect with api key by @schustmi in https://github.com/zenml-io/zenml/pull/3222
* Allow passing None values as parameter for optional complex types by @schustmi in https://github.com/zenml-io/zenml/pull/3215
* Limit kubernetes pod and label length by @schustmi in https://github.com/zenml-io/zenml/pull/3217
* Updating the quickstart example to use the new `log_metadata` by @bcdurak in https://github.com/zenml-io/zenml/pull/3188
* Allow skipping type annotations for step inputs by @schustmi in https://github.com/zenml-io/zenml/pull/3223
* Modal Step Operator by @strickvl in https://github.com/zenml-io/zenml/pull/2948
* Add dynamic artifacts naming, documentation and tests by @avishniakov in https://github.com/zenml-io/zenml/pull/3201
* Run template CLI command and bugfix by @schustmi in https://github.com/zenml-io/zenml/pull/3225
* Make dicts/lists visualizable and add JSON as viz type by @wjayesh in https://github.com/zenml-io/zenml/pull/2882
* Instances of the `FeatureService`s are now used instead of only the names of the FeatureServices. by @aiakide in https://github.com/zenml-io/zenml/pull/3209
* Quickstart fixes by @schustmi in https://github.com/zenml-io/zenml/pull/3227
* Add missing docs by @schustmi in https://github.com/zenml-io/zenml/pull/3226
* Misc cleanup by @schustmi in https://github.com/zenml-io/zenml/pull/3229
* Fix input resolution for steps with dynamic artifact names by @schustmi in https://github.com/zenml-io/zenml/pull/3228
* Follow-up on the `run_metadata` changes by @bcdurak in https://github.com/zenml-io/zenml/pull/3193
* Fixed broken links by @htahir1 in https://github.com/zenml-io/zenml/pull/3232
* Fixed wandb login problem in Quickstart by @htahir1 in https://github.com/zenml-io/zenml/pull/3233
* Misc bugfixes by @schustmi in https://github.com/zenml-io/zenml/pull/3234
* Add additional way to fetch docker repo digest by @schustmi in https://github.com/zenml-io/zenml/pull/3231
* AWS Image Builder implementation by @stefannica in https://github.com/zenml-io/zenml/pull/2904
* Disable client-side caching for some orchestrators by @schustmi in https://github.com/zenml-io/zenml/pull/3235
* Fix artifact uris for artifacts with name placeholders by @schustmi in https://github.com/zenml-io/zenml/pull/3237
* Materializer test fix on Windows by @bcdurak in https://github.com/zenml-io/zenml/pull/3238
* Fix GET step run endpoint to return unhydrated response if requested by @schustmi in https://github.com/zenml-io/zenml/pull/3240
* Pipeline run API token fixes and improvements by @stefannica in https://github.com/zenml-io/zenml/pull/3242

**Full Changelog**: https://github.com/zenml-io/zenml/compare/0.70.0...0.71.0

# 0.70.0

The **ZenML 0.70.0** release includes a significant number of database schema changes and migrations, which means upgrading to this version will require extra caution. As always, please make sure to make a copy of your production database before upgrading.
Expand Down
2 changes: 1 addition & 1 deletion examples/quickstart/configs/training_aws.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Environment configuration
settings:
docker:
parent_image: "715803424590.dkr.ecr.eu-central-1.amazonaws.com/zenml-public-pipelines:quickstart-0.70.0-py3.11-aws"
parent_image: "715803424590.dkr.ecr.eu-central-1.amazonaws.com/zenml-public-pipelines:quickstart-0.71.0-py3.11-aws"
skip_build: True # If you switch this to False remove the parent_image
requirements: requirements.txt
environment:
Expand Down
2 changes: 1 addition & 1 deletion examples/quickstart/configs/training_azure.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Environment configuration
settings:
docker:
parent_image: "zenmldocker/zenml-public-pipelines:quickstart-0.70.0-py3.11-azure"
parent_image: "zenmldocker/zenml-public-pipelines:quickstart-0.71.0-py3.11-azure"
skip_build: True
requirements: requirements.txt
environment:
Expand Down
2 changes: 1 addition & 1 deletion examples/quickstart/configs/training_gcp.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Environment configuration
settings:
docker:
parent_image: "zenmldocker/zenml-public-pipelines:quickstart-0.70.0-py3.11-gcp"
parent_image: "zenmldocker/zenml-public-pipelines:quickstart-0.71.0-py3.11-gcp"
skip_build: True
requirements: requirements.txt
environment:
Expand Down
Loading

0 comments on commit f0d59c6

Please sign in to comment.