Skip to content

WIP web-crawler project with kafka queues, redis cache support, neo4j map builder, strict robots.txt compliance, one of a kind static js parser with goja, some cool features from rod library and more! No updates for a while, but the work will be resumed soon

Notifications You must be signed in to change notification settings

lein3000zzz/project-arachne

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

34 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

cool logo

About

WIP web-crawler project with kafka queues, redis cache support, neo4j map builder, strict robots.txt compliance, one of a kind static js parser with goja, some cool features from rod library and more! No updates for a while, but the work will be resumed soon

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages