[Bug]: Cleanup caikit ootb runtime

[andrewballantyne]

Is there an existing issue for this?

• I have searched the existing issues

Deploy type

Installing Dashboard directly (eg. v2.12.0, commit xyz, branch name)

Version

main

Current Behavior

A little bit of a cleanup still needed for the caikit-ootb.yaml.

Expected Behavior

Add an additional env var in caikit-ootb.yaml

Expected output:

        env:
          - name: RUNTIME_LOCAL_MODELS_DIR
            value: /mnt/models
          - name: RUNTIME_GRPC_SERVER_THREAD_POOL_SIZE
            value: 64

---

Remove ports name field in caikit-ootb.yaml as this will cause some issues with KServe.

Steps To Reproduce

Go to Settings => Serving Runtimes & view the YAML for the ootb caikit runtime

Workaround (if any)

No response

What browsers are you seeing the problem on?

No response

Anything else

No response

[andrewballantyne]

cc @lucferbux @Xaenalt

[manosnoam]

Verified on RHOAI 2.5: