Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

On large amount of requests keter may run out of sockets #245

Open
jappeace opened this issue Mar 24, 2022 · 1 comment
Open

On large amount of requests keter may run out of sockets #245

jappeace opened this issue Mar 24, 2022 · 1 comment

Comments

@jappeace
Copy link
Collaborator

We were being hit with hundreds of requests a second, with some of them taking longer than others - the result being that eventually the system ran out of sockets (aka file descriptors) to service all the requests, and Keter fell over.

So keter should be able to deal with this.
But once this happened it also didn't reboot (which is a nixos config issue, which is now also part of this repository).

@jappeace
Copy link
Collaborator Author

This is reproducible on massive resource usage from the app behind keter.
But we worked around this by using a ratelimit in nginx, eg:

     limit_req_zone $binary_remote_addr zone=applimit:10m rate=10r/s;

and then in the vhost:

             limit_req zone=applimit burst=20 nodelay;

For our app it becomes next to impossible now to get to the run out of socket
scenario, because we also use allocation limits for every request

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant