Serving openai/clip-vit-base-patch32 on main fails during warmup with:
AssertionError: no query bucket for query_len=128; top bucket is 77, which should be at least max_num_batched_tokens.
Worker crashes and the engine never starts. Will follow up with root cause details and a fix.
Serving
openai/clip-vit-base-patch32on main fails during warmup with:Worker crashes and the engine never starts. Will follow up with root cause details and a fix.