Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dataloader support for TF #189

Open
kashprime opened this issue Dec 5, 2022 · 4 comments
Open

Dataloader support for TF #189

kashprime opened this issue Dec 5, 2022 · 4 comments
Labels
enhancement New feature or request

Comments

@kashprime
Copy link

Description

Hi Team, there is admittedly some overlap between this issue and a previous one. However I thought I would make a new one since the other is fairly old. I am looking for some data loader support in FedScale for TensorFlow. It seems the data classes as they stand are written using PyTorch in mind and I was wondering if anyone has any experience using a TensorFlow data set, particularly using .tfrecord files with a known schema.

Use case

I work in industry and am looking to use FedScale to run a simulation of a specific federated learning model on a specific set of hardware. All of our models are written using tf and keras.

@kashprime kashprime added the enhancement New feature or request label Dec 5, 2022
@AmberLJC
Copy link
Member

AmberLJC commented Dec 5, 2022

Hi kashprime, we had some tf data loader use cases (not public yet), we will discuss about it by this week and you may hear back soon.

@kashprime
Copy link
Author

Awesome, thank you AmberLJC!

@fanlai0990
Copy link
Member

Hi kashprime, Thank you for trying FedScale. You can refer here for a quick workaround too, which transforms PyTorch to TF tensors.

@fanlai0990
Copy link
Member

fanlai0990 commented Jan 13, 2023

Hi @kashprime. We have some updates to share with you: we are actively collaborating with LinkedIn to add TF support. We will merge this #194 soon to support TF.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants