CPU time limits

[FireMasterK]

It would be nice to have CPU usage limits, rather than just wall clock limits in ResourceLimits through max_duration for certain use cases.

It is nice that max_memory already exists to limit RSS memory.

[davidhewitt]

Can you please give more details about your use case where the difference matters?

[samuelcolvin]

Unless you understand how process/CPU accounting works better than me, I don't think this is possible without deep integration with individual OS's which I'd like to avoid.

[FireMasterK]

Can you please give more details about your use case where the difference matters?

My use case involves giving agents access to LLM calls (RLMs), which can use a lot more blocking time due to LLM tool calls which don't use any CPU.

[FireMasterK]

Unless you understand how process/CPU accounting works better than me, I don't think this is possible without deep integration with individual OS's which I'd like to void.

I think 2 implementations would be required based on the kinds of OS - one based on libc's clock_gettime (unix like OSs like linux, osx, etc.), and another for windows.

[samuelcolvin]

PR welcome if it's not too complex to implement.

[FireMasterK]

I can try to create a PR. How should the API semantics be due to #483?