Skip to content

0.67.0
Compare
Choose a tag to compare
@bcdurak bcdurak released this 30 Sep 16:22
· 169 commits to main since this release
0.67.0
4e5ac88
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Highlights

  • Improved Sagemaker Orchestrator: Now supports warm pools for AWS Sagemaker, enhancing performance and reducing startup times for TrainingJobs.
  • New DAG Visualizer: Shipped major enhancements to the DAG Visualizer for Pipeline Runs:
    • Preview of the actual DAG before pipeline completion
    • Visual adjustments for improved clarity
    • Real-time updates during pipeline execution
  • Environment Variable References in Configurations: Introduced the ability to reference environment variables in both code and configuration files using the syntax ${ENV_VARIABLE_NAME}, increasing flexibility in setups.
  • Enhanced UX for Major Cloud Providers: Displaying direct pipeline/log URL when working with major cloud platforms.
  • Skypilot with Kubernetes Support: Added compatibility for running Skypilot orchestrator on Kubernetes clusters.
  • Updated Deepchecks Integration: The Deepchecks integration has been refreshed with the latest features and improvements.

Features and Improvements

  • AWS Integration:
    • Added permissions to workflow to enable assuming AWS role.
    • Fixed expired credentials error when using the docker service connector.
  • Error Handling: Improved error messages for stack components of uninstalled integrations.
  • API Key Management: Added an option to write API keys to a file instead of using the CLI.

Pipeline Execution:

  • Implemented fixes for executing steps as single step pipelines.
  • Added filter option for templatable runs.
  • Added additional filtering options for pipeline runs.
  • MLflow Integration: Linked registered models in MLflow with the corresponding MLflow run.
  • Analytics: Added missing analytics event to improve user insights.

Documentation Updates

  • Updated documentation for various integrations including:
    • Lightning AI orchestrator
    • Kubeflow
    • Comet experiment tracker
    • Neptune
    • Hugging Face deployer
    • Weights & Biases (wandb)
  • Added documentation for run templates.
  • Fixed incorrect method name in Pigeon docs.
  • Various small documentation fixes and improvements.

Bug Fixes

  • Fixed YAML formatting issues.
  • Resolved RBAC issues for subpages in response models.
  • Fixed step output annotation in Discord test.
  • Addressed MLFlow integration requirements duplication.
  • Fixed Lightning orchestrator functionality.

What's Changed

New Contributors

Full Changelog: 0.66.0...0.67.0

Contributors

strickvl, stefannica, and 8 other contributors
Assets 2
Loading