Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GKE sometimes dont stop instance-groups #81

Open
julian21olarte opened this issue Apr 23, 2020 · 4 comments
Open

GKE sometimes dont stop instance-groups #81

julian21olarte opened this issue Apr 23, 2020 · 4 comments

Comments

@julian21olarte
Copy link
Contributor

Hi, sometimes Zorya dont stop the clusters (instance-groups), I have added some prints to check what is happening and I could see that the function in gcp/gke.py:
no_of_nodes = gcp.get_instancegroup_no_of_nodes_from_url( url )
usually return the instance-group size zero, then Zorya not work because it cant resize to zero a instance-group that already has zero nodes.... to fix that temporally I need to run the Zorya cron job manually many times to get all clusters down, thanks for any help.

@eranchetz
Copy link
Contributor

@julian21olarte thanks for finding this, let me try and reproduce this on my local environment and see if I get the same results.

@hungpv29
Copy link

hungpv29 commented May 6, 2020

I have some questions:

  • If Minimum size in the node-pool is >0 the resize action will probably fail
  • If autocscaling is on in the node-pool, I do not know what will happen with the reduction size command

@okiirawan
Copy link

@eranchetz Is there any workaround for this issue?

@eranchetz
Copy link
Contributor

@okiirawan we are working on that, hopefully we will have an update soon

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants