Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(dask): make dask autoscaler optional #834

Closed
Alputer opened this issue Sep 20, 2024 · 0 comments · Fixed by #835, reanahub/reana-server#702, reanahub/reana-workflow-controller#604 or reanahub/reana-commons#474 · May be fixed by #791
Closed

feat(dask): make dask autoscaler optional #834

Alputer opened this issue Sep 20, 2024 · 0 comments · Fixed by #835, reanahub/reana-server#702, reanahub/reana-workflow-controller#604 or reanahub/reana-commons#474 · May be fixed by #791
Assignees
@Alputer
Labels
workflow/dask

Comments

@Alputer
Copy link
Member

Alputer commented Sep 20, 2024

Currently, all dask workflows are executed with autoscaler. However, while experimenting with several examples, autoscaler behaves sometimes weirdly by scheduling more than the maximum number of workers or schedulers not being able to detect some workers, although restarting of the workers solve the issue. Therefore, it is better to decide if this option is enabled to cluster administrators.
@Alputer Alputer self-assigned this Sep 20, 2024
@Alputer Alputer added this to Dask Sep 20, 2024
Alputer added a commit to Alputer/reana that referenced this issue Sep 20, 2024
@Alputer
feat(dask): make dask autoscaler optional (reanahub#821)
e3ce610 
closes (reanahub#834)
Alputer added a commit to Alputer/reana-workflow-controller that referenced this issue Sep 20, 2024
@Alputer
feat(dask): make dask autoscaler optional (reanahub#600)
ac5573d 
closes (reanahub/reana#834)
Alputer added a commit to Alputer/reana-server that referenced this issue Sep 20, 2024
@Alputer
feat(dask): update info command to include autoscaler info (reanahub#701
220b542 
)

closes reanahub/reana#834
This was referenced Sep 20, 2024
Merged
Merged
Merged
@Alputer Alputer changed the title Make dask autoscaler optional feat(dask): make dask autoscaler optional (#834) Sep 20, 2024
@Alputer Alputer mentioned this issue Oct 31, 2024
Merged
@Alputer Alputer changed the title feat(dask): make dask autoscaler optional (#834) feat(dask): make dask autoscaler optional Nov 4, 2024
Alputer added a commit to Alputer/reana that referenced this issue Nov 11, 2024
@Alputer
feat(helm): make Dask autoscaler configurable (reanahub#835)
aeebee1 
Closes reanahub#834
Alputer added a commit to Alputer/reana that referenced this issue Nov 11, 2024
@Alputer
feat(helm): make Dask autoscaler configurable (reanahub#835)
2ebee54 
Closes reanahub#834
Alputer added a commit to Alputer/reana that referenced this issue Nov 11, 2024
@Alputer
feat(helm): make Dask autoscaler configurable (reanahub#835)
b90e25f 
Closes reanahub#834
Alputer added a commit to Alputer/reana-workflow-controller that referenced this issue Nov 11, 2024
@Alputer
feat(config): make Dask autoscaler configurable (reanahub#604)
db9ac05 
Closes reanahub/reana#834
Alputer added a commit to Alputer/reana-server that referenced this issue Nov 11, 2024
@Alputer
feat(config): make Dask autoscaler configurable (reanahub#702)
95ea2df 
Closes reanahub/reana#834
@github-project-automation github-project-automation bot moved this from In review to Done in Dask Nov 11, 2024
@github-actions github-actions bot mentioned this issue Oct 31, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Alputer Alputer

Labels
workflow/dask
Projects
Dask
Status: Done
Milestone
No milestone
1 participant
@Alputer