llmperf not working for concurrent users

[nkanike07]

Hi, We facing issue with llmperf when setting concurrent_users more than 1 user. The code gets stuck and doesnot progress further even after few mins. Attached screenshot below.

After sometime (~5mins) it fails with below error: (we set 2 concurrent users)

We checked even memory and cpu cosumption and we have still 75% available bandwidth to support.

Could someone please help us here to proceed further on this perf testing?

Thanks,
Nihar