Metaflow Netflix Extensions v1.3.1

What's Changed

• Add keyring support to lazy download by @romain-intel in #41
  • This enables the use of keyring to download packages from private repositories

Full Changelog: 1.3.0...1.3.1

Metaflow Netflix Extensions v1.3.0

What's Changed

• You can now specify your environment with a pyproject.toml file (Poetry format) on top of the current existing YAML file and requirements.txt
• Uses uv now to unpack the pypi dependencies. Change by setting METAFLOW_CONDA_PYPI_DEPENDENCY_RESOLVER=pip. Note that, as of now, pip is still used to resolve dependencies but uv is used to install them.
• Runner() now accepts environment as well allowing you to resolve and show the environments programmatically
• Ability to use GIT packages in mixed mode.
• Improved compatibility with Mamba 2.0
• Compatibility with Metaflow 2.16.0+
• Fixes around debug integration
• Many other bug fixes

Full Changelog: 1.2.3...1.3.0

Metaflow Netflix Extensions v1.2.3

What's Changed

• Upstream20241110 by @romain-intel in #51

Specifically

• Compatibility with Metaflow 2.12.29+
• Better recreation of Metaflow environment when code package is not available
• Additional debug messages when trying to acquire locks
• Clean up some messages
• Compatibility with mamba 2.0+

Full Changelog: 1.2.2...1.2.3

Metaflow Netflix Extensions v1.2.2

What's Changed

• Use bash binary from current environment by @ilian in #39
• Enhance code block for .yml format in README.md by @lamtrinhdev in #40
• Various fixes reported by users by @romain-intel in #42
  • Fix an issue when building cross-platform with GLIBC being injected (showed up as a pydantic error)
  • Fix an issue when building with pypi and conda dependencies with conda
  • Improve building of certain local projects that use pyproject.toml
  • Improve timeout documentation
• Bug fixes by @romain-intel in #44
• Fix wrong assert by @romain-intel in #46
• Added tests by @romain-intel in #43
• Fix issue with running Metaflow with the runner environment by @romain-intel in #45

New Contributors

• @ilian made their first contribution in #39
• @lamtrinhdev made their first contribution in #40

Full Changelog: 1.2.1...1.2.2

Metaflow Netflix Extensions v1.2.1

What's Changed

• fix: pin micromamba:1.5.7 by @majamil16 in #38

New Contributors

• @majamil16 made their first contribution in #38

Full Changelog: 1.2.0...1.2.1

Metaflow Netflix Extensions v1.2.0

What's Changed

• Add extensions to debug flows in isolated notebook instance by @talsperre in #36
• Fix resolution of derived environments in some cases by @romain-intel in #37

New Contributors

• @talsperre made their first contribution in #36

Full Changelog: 1.1.3...1.2.0

Metaflow Netflix Extensions v1.1.3

What's Changed

• Fix a forgotten --yes which could cause things to freeze by @romain-intel in #33
• Various fixes from upstream: by @romain-intel in #35
  • Properly handle sys packages when cross building
  • Add --conda-channel to requirements.txt type of files
  • Fix issue when locally building a package that already had a local identifier
  • Better handling of determining if a newer package needs to be built when pointing to a local directory or file
  • Add support to specify additional packages for builder environments thereby supporting authentication using GOOGLE_APPLICATION_CREDENTIALS
  • Improved support for python 3.7
  • More efficient environment building when building an environment that just adds ipykernel
  • Fix issue with micromamba in some cases (it would "hang" when compiling .pyc files)

Full Changelog: 1.1.2...1.1.3

Metaflow Netflix Extensions v1.1.2

What's Changed

• Add default packages for linux-64 to enable remote resolve from mac by @romain-intel in #32

Full Changelog: 1.1.1...1.1.2

Metaflow Netflix Extensions v1.1.1

Fix small issue with 1.1.0 which caused the sys packages to not always be properly injected.

Full Changelog: 1.1.0...1.1.1

Metaflow Netflix Extensions v1.1.0

What's Changed

• Support pip-repositories in conda-lock 2.4.0+ by @romain-intel in #27
• Fix #28: Properly split URLs on space as well by @romain-intel in #29
• Fixes an issue with resolving multiple mixed environments in parallel
• Allow pypi-indices in environment.yml to specify pip repositories in that format
• Improved parsing of version information in environment.yml
• Distinguish environments based on the glibc version they are built. Note that for mixed environments (using conda-lock), this requires a recent version of conda-lock (not yet released) which integrates everything in main up to December 11th 2023. In other modes, the handling of glibc version is now fixed and should behave as expected.
• Include tomli in dependencies in more cases to build pyproject.toml packages properly
• Optimistically build wheels even cross platform.

Notes

• Environments may be re-resolved once due to a change in the user-hash for the environment due to the inclusion of the glibc version being used. This may increase the resolution time for environments the first time around.

Full Changelog: 1.0.7...1.1.0