Skip to content

feat: add FP16 auto-precision and batching parameters to Reranker #813 - #817

Open
suhaniiz wants to merge 2 commits into
param20h:devfrom
suhaniiz:feat-fp16-batching-813
Open

feat: add FP16 auto-precision and batching parameters to Reranker #813#817
suhaniiz wants to merge 2 commits into
param20h:devfrom
suhaniiz:feat-fp16-batching-813