Issue when running ray-llm with tensorrt-llm

[leon-g-xu]

I am seeing the following issue when using tensorrt-llm(0.6.1) on top of ray-llm (0.5.0)
ImportError: cannot import name 'trt_llm_engine_py' from 'tensorrt_llm.libs' (unknown location)
And looks like it's from this line of code:
https://github.com/ray-project/ray-llm/blob/master/rayllm/backend/llm/trtllm/trtllm_models.py#L15

Wondering if anyone has run into this issue before?

[leon-g-xu]

Tagging @sihanwang41 and @shrekris-anyscale for awareness as you are both the committers on the file.