[Enhance] Local Model configuration

[a7m-1st]

Motivation

Currently the fields used to config local models have very limited customizability.
Configuring it is kind of confusing and error prone.
The error returned form the api endpoint isn't fool proof.

Solution

• Perhaps we can reuse the mcp config code window to configure the model configurations like topp, temprerature etc..?
• We need to fully utilize the url validation to return rich error details

Alternatives

No response

Additional context

[darkmoon-o]

Hi, @a7m-1st .
I am looking to contribute this project.
Would you assign this task to me?

[a7m-1st]

Hi there @darkmoon-o , oh yea that would speed things up. The backend api supports model_config already, just need to update the frontend to pass in a model config json, and which fails if validation error ofcourse.

I am assigning it to you, thanks for reaching out !

[a7m-1st]

Hi there @darkmoon-o , is there any updates with your work?
Feel free to ask me for help if needed