Support modifying model names based on model mapping when forwarding to target services

[johnlanni]

Now, when overriding the original model name by setting a target model name, only one fixed model can be configured; mapping configurations are not supported.

But the actual underlying mechanism is supported. A rule that is essentially a global mapping has been configured, and the following is the actual effective configuration:

It can support configuring more mapping strategies, for example:

apiVersion: extensions.higress.io/v1alpha1
kind: WasmPlugin
metadata:
  name: model-mapper.internal
  namespace: higress-system
spec:
  defaultConfigDisable: true
  failStrategy: FAIL_OPEN
  matchRules:
  - config:
      modelMapping:
        'gpt-4-*': "qwen-max"
        'gpt-4o': "qwen-vl-plus"
        '*': "qwen-turbo"
    configDisable: false
    # This configuration takes effect when the following ingress and service match simultaneously.
    ingress:
    - ai-route-dashscope.internal
    service:
    - llm-dashscope.internal.dns
  phase: AUTHN
  priority: 800
  url: oci://higress-registry.cn-hangzhou.cr.aliyuncs.com/plugins/model-mapper:1.0.0

For an introduction to the configuration of the model-mapper plugin, you can refer to this:

https://github.com/alibaba/higress/blob/main/plugins/wasm-cpp/extensions/model_mapper/README_EN.md

[CH3CHO]

Should this model mapping config be set in a provider level or route level?

[johnlanni]

Should this model mapping config be set in a provider level or route level?

provider&route level, like this match config:

ingress:
- ai-route-dashscope.internal
service:
- llm-dashscope.internal.dns

[CH3CHO]

Should this model mapping config be set in a provider level or route level?

provider&route level, like this match config:

ingress:
- ai-route-dashscope.internal
service:
- llm-dashscope.internal.dns

So we need to figure out a UI design of this kind of model mapping configuration with multiple entries.

[johnlanni]

Yes, can we change the current target model input box to a "Model Mapping" button? After clicking, the key-value pairs can be configured in a pop-up window.