VPA applying new recommendations every minute to Pod

[thejuan]

Which component are you using?:

vertical-pod-autoscaler

What version of the component are you using?:

0.14
via https://github.com/FairwindsOps/charts/tree/master/stable/vpa 3.0.2

Component version:

What k8s version are you using (kubectl version)?:

kubectl version Output

clientVersion:
  buildDate: "2022-09-21T14:33:49Z"
  compiler: gc
  gitCommit: 5835544ca568b757a8ecae5c153f317e5736700e
  gitTreeState: clean
  gitVersion: v1.25.2
  goVersion: go1.19.1
  major: "1"
  minor: "25"
  platform: windows/amd64
kustomizeVersion: v4.5.7
serverVersion:
  buildDate: "2023-10-20T23:21:27Z"
  compiler: gc
  gitCommit: 164dfb62db432c0b28a1fced3956256af68533b6
  gitTreeState: clean
  gitVersion: v1.26.10-eks-4f4795d
  goVersion: go1.20.10
  major: "1"
  minor: 26+
  platform: linux/amd64

What environment is this in?:

AWS

What did you expect to happen?:
Pod not restarted every minute. Recommendations to be applied and then let the pod run

What happened instead?:
This happens very sporadically (so far) where VPA causes a restart loop on a pod that lasts hours/days, but does eventually fix itself
Everytime the updater ran, the Pod was restarted to apply recommendations.

I1210 12:59:05.084699       1 event.go:285] Event(v1.ObjectReference{Kind:\"Pod\", Namespace:\"monitoring\", Name:\"prometheus-0\", UID:\"5c695f7f-4b85-4f81-beaa-4f6bd879d601\", APIVersion:\"v1\", ResourceVersion:\"1509938786\", FieldPath:\"\"}): type: 'Normal' reason: 'EvictedByVPA' Pod was evicted by VPA Updater to apply resource recommendation.
I1210 12:59:05.062223       1 updater.go:215] evicting pod prometheus-0
I1210 12:59:05.062189       1 update_priority_calculator.go:143] pod accepted for update monitoring/prometheus-0 with priority 0.047853622313252714
I1210 12:58:05.086849       1 event.go:285] Event(v1.ObjectReference{Kind:\"Pod\", Namespace:\"monitoring\", Name:\"prometheus-0\", UID:\"ca182d47-3fed-4264-a76c-eaf0a07ca624\", APIVersion:\"v1\", ResourceVersion:\"1509935060\", FieldPath:\"\"}): type: 'Normal' reason: 'EvictedByVPA' Pod was evicted by VPA Updater to apply resource recommendation.
I1210 12:58:05.065297       1 updater.go:215] evicting pod prometheus-0
I1210 12:58:05.065263       1 update_priority_calculator.go:143] pod accepted for update monitoring/prometheus-0 with priority 0.047853622313252714

This is the recommendation and request during the period

How to reproduce it (as minimally and precisely as possible):

Unable to at the moment.
Maybe coincidence, but started seeing it after 0.14 upgrade from 0.13

Anything else we need to know?:

[thejuan]

Closing this as I believe this was a result of bad configuration #5481
We were running multiple recommenders and updaters