Skip to content

Fix: Change suggested batch size to 5 to help with cpu limit issues #5

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Nov 23, 2023
Merged

Fix: Change suggested batch size to 5 to help with cpu limit issues #5

merged 1 commit into from
Nov 23, 2023

Conversation

gregnr
Copy link
Collaborator

@gregnr gregnr commented Nov 23, 2023 •
edited
Loading

Problem

The embed trigger batch size of 10 resulted in some users reporting CPU limits being reached in edge functions.

Solution

Lowering this to 5 in hopes that the edge function will be able to complete 5 embeddings at a time without hitting CPU limits.

@gregnr gregnr merged commit 9aedf72 into main Nov 23, 2023
@gregnr gregnr mentioned this pull request Nov 23, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@gregnr