Skip to content

[Optimization] Advance parser concurrently with model forward pass #985

[Optimization] Advance parser concurrently with model forward pass

[Optimization] Advance parser concurrently with model forward pass #985

basic-tests-linux-python-other (3.11, llamacpp_phi3_mini_4k_instruct_cpu)  /  run-plain-basic-tests

succeeded Nov 5, 2024 in 8m 30s