Fast and elegant scraping and crawling framework for Go.
Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.
- Stars
- 25k
- Downloads
- —
- Updated
- 2026-06-18
- Skill installs
- —
Control center / Discover
Browse by category instead of drowning in search results. Every category opens a submenu of subcategories with live counts, and checking one narrows the grid to exactly that slice.
Fast and elegant scraping and crawling framework for Go.
Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.
Next generation crawling and spidering framework for fast website discovery.
Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.
Extensible archival quality web crawler used by the Internet Archive.
Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.
Extensible and scalable open source web crawler for large scale data collection.
Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.
Open-source, LLM-friendly crawler with smart extraction strategies.
Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.
Python library for building reliable web crawlers and scrapers at scale
Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.
Apify's scraping and browser automation library for reliable large-scale crawlers.
Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.