graph based stream processing framework
-
Updated
Dec 11, 2025 - Rust
graph based stream processing framework
High-throughput(100+ pages/sec), respectful C++ web crawler with smart frontier scheduling, robots.txt compliance, HTTP/2 multiplexing, and RocksDB-backed persistence for production-scale ingestion.
Add a description, image, and links to the high-thoughput topic page so that developers can more easily learn about it.
To associate your repository with the high-thoughput topic, visit your repo's landing page and select "manage topics."