I'm going to open a PR for this but I wanted to capture the issue I'm having in an issue 1st.
My company uses LiteLLM as a proxy in front of vLLM... LiteLLM needs to take a x-litellm-api-key : value as the auth header. I wasn't able with the current codebase to get this working so I'll write a PR that adds a few more config options for you to review - and when I say I I mean (my little AI buddies)
I'm going to open a PR for this but I wanted to capture the issue I'm having in an issue 1st.
My company uses LiteLLM as a proxy in front of vLLM... LiteLLM needs to take a
x-litellm-api-key:valueas the auth header. I wasn't able with the current codebase to get this working so I'll write a PR that adds a few more config options for you to review - and when I say I I mean (my little AI buddies)