Skip to content

Latest commit

 

History

History
8 lines (5 loc) · 450 Bytes

README.md

File metadata and controls

8 lines (5 loc) · 450 Bytes

UIUC.chat's Web Crawler

Hosted on Railway.app. I found Railway preferable to severless functions because it easily handles the large bundle size introduced by using Chromium for full javascript execution during web crawling.

It's powered by the excellent Crawlee.dev