v0.8.3

Release Notes

We are excited to announce the release of 0.8.3. The release is focused on running syft_functions asynchronously with the ability to nest them. This release also adds the ability to dynamically scale workers in docker and communicate jobs between nodes via a queue.

API Notebooks

You can view tested API notebooks here:
https://github.com/OpenMined/PySyft/tree/dev/notebooks/api

Disclaimer

Syft is under active development and is not yet ready for pilots on private data without our assistance. As early access participants, please contact us via Slack or email if you would like to ask a question or have a use case that you would like to discuss.

Compatibility Notes

0.8.2 is now DEPRECATED and We strongly recommend everyone upgrades to 0.8.3 for all use cases
The Course 3 notebooks still target 0.7 so please use that version for course 3.

Currently supported python versions are 3.9 - 3.11

Next Release 0.8.4

Very shortly, the dev branch will switch to 0.8.4 beta and we will continue to support hotfixes into 0.8.3 as needed here: https://github.com/OpenMined/pysyft/tree/0.8.2

Jedi Program

A big thank you to all our Jedi contributors:

Jedi Contributors:

@akalliokoski, @callezenwaka, @jcardonnet, @khoaguin, @PeterChung241, @Poppy22, @tthoraldson, @znreza, @Param-29

If you want to join the Padawan Program you can see more here:
https://blog.openmined.org/work-on-ais-most-exciting-frontier-no-phd-required/

Changelog:

User Experience and Interface Improvements:

Demo improvements (PR #8137)
Dataset UX [WIP] (PR #8187)
Safer context (PR #8225)
Syftfileux (PR #8253)
Data structures refactor (PR #8268)
Job composition (PR #8266)
Nested requests (PR #8267)

Docker and Deployment Enhancements:

Updated docker compose for hagrid (PR #8196)
Merge backend and worker dockerfile (PR #8240)
Create a base image for syft (PR #8251)
Delay the build process of images (PR #8260)
Added repo.remotes.origin.fetch() to hagrid before calling checkout (PR #8269)
Helm migrations (PR #8270)
Updating docker images (PR #8281)
Build custom worker with config (PR #8254)
Clean up HELM docker (PR #8301)
Added worker docker file to release commit (PR #8314)
Update version dockerfile (PR #8312)

Testing and Quality Assurance:

Test for syft base CPU image (PR #8274)
Add more tests for CustomWorkerConfig (PR #8288)
CI file descriptor debugging [don't merge] (PR #8292)

Bug Fixes and Maintenance:

Time rounding (PR #8252)
Fix quotes (PR #8261)
Fix list repr when something goes wrong in one of the jobs (PR #8224)
Fix bumpversion (PR #8264)
Fix syft versions (PR #8265)
Fix Gateway Seaweedfs Bug (PR #8290)
Fix Release (PR #8291)
Fix SQLite File Descriptor Leak (PR #8300)
Fix: duplicated code requests (PR #8294)
Fix Seaweedfs dev flags in devspace (PR #8315)

Feature Additions and Enhancements:

Final Release Version 0.8.2 (PR #8258)
Helm (PR #8085)
Re-enabled cd (PR #8262)
Prep 0.8.3 beta [WIP] (PR #8263)
ADD job.kill() (PR #8272)
Bumping dependencies and removing gipc (PR #8306)
Added NODE_SIDE_TYPE flag to helm chart (PR #8293)
Reset and restage protocol version (PR #8319)

Dependency and Security Updates:

Use dependabot to keep GitHub actions up to date (PR #8276)
Ignore ansible and pip security issues (PR #8287)
Dependency updates by @dependabot (PRs #8283, #8284, #8286, #8285, #8282, #8303, #8304)

Infrastructure and Build Process:

Opening up gevent upgrade for hagrid (PR #8307)
Added gcc to arm64 runners (PR #8316)
Added Seaweedfs version to build args (PR #8317)
Remove string notation from Seaweedfs version (PR #8318)