-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement health checks and graceful termination #1
Conversation
I need to add a license yet Update: done |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Just for my own understanding, the TERM
actually triggerd by K8s isnt' actually propagated by the Deputy? it just knows it has to shut down gracefully?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I mostly reviewed the docs, they look good and address my concerns from before!
|
||
!!!note | ||
|
||
K8s probes require that applications must respond to the probe requests in under `timeoutSeconds` (defaults to 1 second). Since Julia's HTTP.jl server can be unresponsive we recommend using a `timeoutSeconds` of at least 5 seconds. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why would the server take so long to respond?! compilation or something else?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I believe it's just delays with Julia running multiple threads. I didn't dig into this too much but I have witnessed the problem on a multi-node cluster.
- name: app | ||
ports: | ||
- name: health-check | ||
containerPort: 8081 # The default K8sDeputy.jl heath check port |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can we make this configurable, using an ENV?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It is configurable via the HEALTH_CHECK_PORT
environmental variable. For the documentation this was a bit cleaner as I didn't have to also introduce the env
block
Co-authored-by: Dave Kleinschmidt <[email protected]>
We initiate a graceful shutdown via the |
Initial implementation of K8sDeputy.jl