Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support auto_lr_find with num_workers > 0 #227

Open
ejm714 opened this issue Sep 15, 2022 · 0 comments
Open

Support auto_lr_find with num_workers > 0 #227

ejm714 opened this issue Sep 15, 2022 · 0 comments
Labels
bug Something isn't working

Comments

@ejm714
Copy link
Collaborator

ejm714 commented Sep 15, 2022

auto_lr_find does not support DDP. We set the multiprocessing context based on the number of workers. This leads to a scenario where a user cannot use auto_lr_find with multiple workers, even though this would be possible if the multiprocessing context were set to None.

A couple options:

  • infer the multiprocessing context based on number of GPUs instead of number of workers
  • allow the user to explicitly set the multiprocessing context
  • do not support multiprocessing until PTL supports this for auto lr find
@ejm714 ejm714 changed the title Support auto_lr_find with num_workers > 0 Support auto_lr_find with num_workers > 0 Sep 15, 2022
@ejm714 ejm714 changed the title Support auto_lr_find with num_workers > 0 Support auto_lr_find with num_workers > 0 Sep 15, 2022
@klwetstone klwetstone added the bug Something isn't working label Apr 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants