Skip to content

Commit e21c673

Browse files
perf: replace chunk-based pipeline with streaming worker pool
Removes sequential chunk barriers (30 PRs per batch). Each PR now flows independently through enrich -> filter -> pre-classify -> deep process using FuturesUnordered with per-stage semaphores (5/15/5 concurrency). AtomicUsize counter stops the pool as soon as max_tasks is reached. Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
1 parent d9311a6 commit e21c673

File tree

1 file changed

+176
-146
lines changed

1 file changed

+176
-146
lines changed

0 commit comments

Comments
 (0)