Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request: Option to Increase the maximum batch size in the docker #1460

Open
austeregrim opened this issue Dec 3, 2024 · 1 comment
Open

Comments

@austeregrim
Copy link

Request: Enable increasing the queue-able batch size in the docker, either provide the option to manually set a max batch size in the settings (changing the slider's max), or provide a text box that can be set manually (keeping the slider's max at 10).

This allows someone to override the batch size, where long runs are desired, without having to click the generate button multiple times.

It appears there is no correlation between the Performance Settings page's "Maximum Batch Size" and the docker's Batch Size selection, and the max the settings page allows is 16. Please remove these arbitrary limits, I should be able to batch 100 images if I want.
(I have disk space, I have 64gb ram, and I have the GPU to do this.)

@Acly
Copy link
Owner

Acly commented Dec 9, 2024

Performance settings batch size is the number of 512x512 images generated in parallel. For bigger GPU it makes sense to go up to 8 or so to get better efficiency (at the cost of latency), but any higher does not yield any benefit.

Docker batch count is equivalent to pressing Generate X times.

Just put it at max and press button few times, you get tons of images. I really don't get the point though? Plenty of other UIs better suited to push button and sift through 100s of images.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants