Cluster Autoscaler 1.31.0

Changelog

General

• Cluster Autoscaler can now provision nodes before all pending pods are created and marked as unschedulable by scheduler. This behavior is disabled by default and can be enabled with --enable-proactive-scaleup flag. --pod-injection-limit flag is introduced to allow fine-tuning this behavior. (#7145)
  • This functionality can significantly speed up provisioning of nodes when hundreds or thousands of pods are created at the same time as well as lead to better scale-up decisions in those cases.
  • Injecting too many pods can make CA unstable, depending on number of NodeGroups and scalability of particular cloud provider integration. --pod-injection-limit can help control this.
• Added support for ProvisioningRequest v1 API. (#7195)
• Allows the user to use in-cluster kubernetes configuration while self-hosting cluster-autoscaler as a pod within their cluster. (#7156)
• Faster handling of failed scale ups, useful especially with multiple quota or stockout errors across the cluster. (#7087)
• Bin packing will be cut short after exceeding "maxBinpackingDuration". The "maxBinpackingDuration" is set using an new flag "--max-binpacking-time". This can prevent rare cases where CA gets unresponsive in scenarios with a very large number of pods pending. (#6556)
• Added a new least-nodes expander (#6792)

AWS

• Fix an issue in the Kubernetes Cluster Autoscaler where actual AWS instances could be incorrectly scaled down instead of placeholders. (#6911)
• Fix an issue with reading taints on Managed Node Groups scaled to zero, that can cause scale-up of nodes with taints that pending pods don't tolerate (#6482)

Azure

• ACTION REQUIRED: VMSS GPU Nodes must now also include the kubernetes.azure.com/accelerator label in addition to accelerator. (#7203)
• From now on, users should refer to https://cloud-provider-azure.sigs.k8s.io/install/configs/ for configuration interface (#6947)
• Fixed an issue where environment variables were not being passed in when config file exists (#6947)
• Fixed an issue where some cloud provider configurations were not being validated when UseManagedIdentityExtension is set to true (#6947)
• Renamed several fields from config file, with old names are still acceptable and taking precedence: useWorkloadIdentityExtension to useFederatedWorkloadIdentityExtension, vmssCacheTTL to vmssCacheTTLInSeconds, vmssVmsCacheTTL to vmssVirtualMachinesCacheTTLInSeconds, enableVmssFlex to enableVmssFlexNodes (#6947)
• Renamed several environment variables, with old names are still acceptable and taking precedence: ARM_USE_MANAGED_IDENTITY_EXTENSION to ARM_USE_FEDERATED_WORKLOAD_IDENTITY_EXTENSION, AZURE_VMSS_CACHE_TTL to AZURE_VMSS_CACHE_TTL_IN_SECONDS, AZURE_VMSS_VMS_CACHE_TTL to AZURE_VMSS_VMS_CACHE_TTL_IN_SECONDS, AZURE_ENABLE_VMSS_FLEX to AZURE_ENABLE_VMSS_FLEX_NODES (#6947)
• Fix some cases where instance cache is outdated but not getting refreshes (#7116)
• Support cloud provider AAD certificate authentication (#7003)
• getVMSS api will be called when using spot instances for having better updated information (#6470)
• The AZURE_CLUSTER_AUTOSCALER_USER_AGENT_SUFFIX variable can be used to customize the user agent for the Azure provider of cluster-autoscaler. Setting this to -my-user-agent results in a user agent like Go/go1.22.5 (amd64-linux) go-autorest/v14.2.1 cluster-autoscaler-my-user-agent/v1.31.0-alpha.2. (#7033)
• You can now optionally specify a default min and max size for Azure VMSSs through the auto discovery tags. Explicit min and max tags on VMSSs will still be given priority over the default. (#6863).
• Skips Azure-specific node labels that might mistakenly categorize nodegroups as different when, in reality, they are similar. (#6634)

Cluster API

• Added configurable autoscaling options to clusterapi provider allowing users to configure e.g. --scale-down-unneeded-time on a per node group level. (#6743)

GCE

• GCE cloud provider will use Instance.List api to list mig instances. IGM.ListManagedInstances api will be used as a fall back mechanism and for listing instances for migs that have instances in creating or deleting states. This should improve performance in clusters with a large number of NodeGroups. (#6955)

Hetzner

• Fixed exhausted node groups not backing off for Hetzner Provider (#6750)

Images

• registry.k8s.io/autoscaling/cluster-autoscaler:v1.31.0
• registry.k8s.io/autoscaling/cluster-autoscaler-arm64:v1.31.0
• registry.k8s.io/autoscaling/cluster-autoscaler-amd64:v1.31.0
• registry.k8s.io/autoscaling/cluster-autoscaler-s390x:v1.31.0

Full Changelog: cluster-autoscaler-1.30.0...cluster-autoscaler-1.31.0

vertical-pod-autoscaler-1.2.1

What's changed:

#7169 - Prevent nil pointer dereference in vpa-recommender.

vertical-pod-autoscaler-1.2.0...vertical-pod-autoscaler-1.2.1

vertical-pod-autoscaler-1.2.0

What's Changed

• #6788 - Added option to ignore namespaces by @adrianmoisey
• #6985 - Added support for leader election in VPA updater by @ialidzhikov.
• #6909, #6908, #6903 - Log object namespaces by @ialidzhikov.
• #6723 - Added more precise logging for VPA resource recommendations by @nikimanoledaki.
• #6665 - Added ability to the VPA admission-controller to reload its certificate v2 by @Nuckal777.
• #6910 - Added testing for selfRegistration() and filterVPAs() by @adrianmoisey
• #6820 - Fixed nil pointer panic in eviction admission (also cherrypicked to 1.1) by @itonyli.
• #6813, #6698 - Cleanups by @youngbo89 and @googs1025.
• #6660 - Configurable upper and lower bounds for memory and cpu recommendations by @emla9.
• #6712 - Fixed NPE in vpa-updater when Pod owner isn't scalable (also cherrypicked to 1.1) by @voelzmo
• #6625 - Updated VPA admission-controller to have adjustable minimum TLS version and TLS ciphers by @allenmun197.
• Golang bumps from 1.22.1 to 1.22.5.

Full Changelog: vertical-pod-autoscaler-1.1.2...vertical-pod-autoscaler-1.2.0

cluster-autoscaler-1.30.2

Changelog

General

• Update vendor to use k8s 1.30.2 by @x13n in #7046
• Refactor scale-up to apply resource limits before creating a node group by @yaroslava-serdiuk in #6931
• Add support for all-or-nothing scale-up strategy by @yaroslava-serdiuk in #7015
• Refactor Provisioning Request orchestrator unit tests by @yaroslava-serdiuk in #6933
• Update ProvisioningRequest API with the new name of scale-up provisioning class by @yaroslava-serdiuk in #7032
• Implement ProvisioningClass for best-effort-atomic-scale-up.kubernetes.io ProvisioningRequests by @yaroslava-serdiuk in #7030
• Public ProvisioningClass interface by @yaroslava-serdiuk in #7047
• Use the same processors for all currently supported provisioning classes by @yaroslava-serdiuk in #7051
• BookCapacity for ProvisioningRequest pods by @yaroslava-serdiuk in #7057
• Update ProvReq annotations to new prefix by @yaroslava-serdiuk in #7060

AWS

• PR#6911 Backport for 1.30: Fix/aws asg unsafe decommission #5829 by @kmsarabu in #7026
• CA - 1.30.2 Pre-release AWS Instance Types Update by @gjtempleton in #7043

Hetzner

• Backport #6750 [CA] fix(hetzner): missing error return in scale up/down into CA 1.30 by @Shubham82 in #7023

Images

• registry.k8s.io/autoscaling/cluster-autoscaler:v1.30.2
• registry.k8s.io/autoscaling/cluster-autoscaler-arm64:v1.30.2
• registry.k8s.io/autoscaling/cluster-autoscaler-amd64:v1.30.2
• registry.k8s.io/autoscaling/cluster-autoscaler-s390x:v1.30.2

Full Changelog: cluster-autoscaler-1.30.1...cluster-autoscaler-1.30.2

cluster-autoscaler-1.29.4

Changelog

General

• Update vendor to use k8s 1.29.6 by @x13n in #7048
• Backport #6528 [CA] Fix expectedToRegister to respect instances with nil status into CA1.29 by @Shubham82 in #6893

AWS

• CA - 1.29.4 Pre-release AWS Instance Types Update by @gjtempleton in #7042
• PR#6911 Backport for 1.29: Fix/aws asg unsafe decommission #5829 by @kmsarabu in #7025

Azure

• [Azure VMs pool] Introducing agentpool client by @wenxuan0923 in #6685

Hetzner

• Backport #6750 [CA] fix(hetzner): missing error return in scale up/down into CA 1.29 by @Shubham82 in #7022

Images

• registry.k8s.io/autoscaling/cluster-autoscaler:v1.29.4
• registry.k8s.io/autoscaling/cluster-autoscaler-arm64:v1.29.4
• registry.k8s.io/autoscaling/cluster-autoscaler-amd64:v1.29.4
• registry.k8s.io/autoscaling/cluster-autoscaler-s390x:v1.29.4

Full Changelog: cluster-autoscaler-1.29.3...cluster-autoscaler-1.29.4

cluster-autoscaler-1.28.6

Changelog

General

• Update vendor to use k8s 1.28.11 by @x13n in #7049
• Backport #6528 [CA] Fix expectedToRegister to respect instances with nil status into CA1.28 by @Shubham82 in #6892

AWS

• CA - 1.28.6 Pre-release AWS Instance Types Update by @gjtempleton in #7041
• Fix/aws asg unsafe decommission #5829 by @kmsarabu in #7012

Hetzner

• Backport #6750 [CA] fix(hetzner): missing error return in scale up/down into CA 1.28 by @Shubham82 in #7021

Images

• registry.k8s.io/autoscaling/cluster-autoscaler:v1.28.6
• registry.k8s.io/autoscaling/cluster-autoscaler-arm64:v1.28.6
• registry.k8s.io/autoscaling/cluster-autoscaler-amd64:v1.28.6
• registry.k8s.io/autoscaling/cluster-autoscaler-s390x:v1.28.6

Full Changelog: cluster-autoscaler-1.28.5...cluster-autoscaler-1.28.6

addon-resizer-1.8.22

What's Changed

• Various dependency bumps
• Added a Prometheus endpoint for monitoring to addon-resizer by @raywainman in #6916

Full Changelog: addon-resizer-1.8.21...addon-resizer-1.8.22

Cluster Autoscaler 1.30.1

Changelog

General

• Update k/k deps to 1.30.1 (#6872)
• Add --enable-provisioning-requests flag (#6826)
• Fix ProvisioningRequest update (#6825)
• Fix: scale up broken for providers not implementing NodeGroup.GetOptions() (#6756)

Hetzner

• Fix: hostname label is not considered (#6751)

Images

• registry.k8s.io/autoscaling/cluster-autoscaler:v1.30.1
• registry.k8s.io/autoscaling/cluster-autoscaler-arm64:v1.30.1
• registry.k8s.io/autoscaling/cluster-autoscaler-amd64:v1.30.1
• registry.k8s.io/autoscaling/cluster-autoscaler-s390x:v1.30.1

Full Changelog: cluster-autoscaler-1.30.0....cluster-autoscaler-1.30.1

Cluster Autoscaler 1.29.3

Changelog

General

• Update k/k deps to 1.29.5 (#6871)
• Remove shadow err variable in deleteCreatedNodesWithErros func (#6757)
• Fix: Scale up broken for providers not implementing NodeGroup.GetOptions(#6761)

Azure

• Support mixed agentpool types in Azure Cache (#6689)

Hetzner

• Fix: hostname label is not considered (#6752)
• Fix: missing ephemeral storage definition (#6673)
• Fix: autoscaling for worker nodes with invalid ProviderID (#6720)

Images

• registry.k8s.io/autoscaling/cluster-autoscaler:v1.29.3
• registry.k8s.io/autoscaling/cluster-autoscaler-arm64:v1.29.3
• registry.k8s.io/autoscaling/cluster-autoscaler-amd64:v1.29.3
• registry.k8s.io/autoscaling/cluster-autoscaler-s390x:v1.29.3

Full Changelog: cluster-autoscaler-1.29.2....cluster-autoscaler-1.29.3

Cluster Autoscaler 1.28.5

Changelog

General

• Update k/k deps to 1.28.10 (#6870)
• Remove shadow err variable in deleteCreatedNodesWithErros func (#6758)
• Fix: Scale up broken for providers not implementing NodeGroup.GetOptions(#6760)

Hetzner

• Fix: hostname label is not considered (#6753)
• Fix: missing ephemeral storage definition (#6674)
• Fix: autoscaling for worker nodes with invalid ProviderID (#6721)

Images

• registry.k8s.io/autoscaling/cluster-autoscaler:v1.28.5
• registry.k8s.io/autoscaling/cluster-autoscaler-arm64:v1.28.5
• registry.k8s.io/autoscaling/cluster-autoscaler-amd64:v1.28.5
• registry.k8s.io/autoscaling/cluster-autoscaler-s390x:v1.28.5

Full Changelog: cluster-autoscaler-1.28.4....cluster-autoscaler-1.28.5