Improve KubeAI autoscaling support#1052

eero-t merged 7 commits intoopea-project:mainopea-project/GenAIInfra:mainfrom

eero-t:kubeai-scalingeero-t/GenAIInfra:kubeai-scalingCopy head branch name to clipboard