[Bug]: Model queries using HTTP protocol fail on Caikit+TGIS Serving Runtime

[bdattoma]

Is there an existing issue for this?

• I have searched the existing issues

Deploy type

OpenDataHub core version (eg. v1.6.0)

Version

nightly

Current Behavior

I'm facing issues while querying models using HTTP protocol on Caikit Serving Runtime. I believe this is the same issue as opendatahub-io/caikit-tgis-serving#147.

The solution should be easy: removing name: h2c from the port configuration of the Custom Serving Runtime template

Expected Behavior

Models can be successfully queried using HTTP protocol

Steps To Reproduce

1. deploy a model via KServe UI selecting the default Caikit CustomServingRuntime
2. query the model

curl -k --json '{
	"model_id": "<model_name>",
	"inputs": "<query text>"
}' https://<inference_url>:443/api/v1/task/server-streaming-text-generation

3. check the result --> I get unexpected EOF

Workaround (if any)

Duplicate the caikit-tgis-runtime from ODH Dashboard > Settings > Custom serving runtimes and remove line 29 (i.e., name: h2c). Source: opendatahub-io/caikit-tgis-serving@22c9ec1

What browsers are you seeing the problem on?

No response

Anything else

No response

[bdattoma]

@lucferbux @Xaenalt ^^

[bdattoma]

closing in favor of original #2143