Control center / Discover

Discover

Browse by category instead of drowning in search results. Every category opens a submenu of subcategories with live counts, and checking one narrows the grid to exactly that slice.

Verified against GitHub · scores pending
7 results for “crawler” across 1 categories
Sort by:Type:Trust:Maturity:7 shown

Data & Research

7

Colly Fast Go Scraping Framework

gocolly★ 26kToolactive

Fast and elegant scraping and crawling framework for Go.

Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.

Stars
26k
Downloads
—
Updated
2026-09-16
Skill installs
—
Trust pendingMomentum not matched

Katana

projectdiscovery★ 18kToolstable

Next generation crawling and spidering framework for fast website discovery.

Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.

Stars
18k
Downloads
—
Updated
2026-09-25
Skill installs
—
Trust pendingMomentum not matched

Heritrix

internetarchive★ 3.3kToolstable

Extensible archival quality web crawler used by the Internet Archive.

Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.

Stars
3.3k
Downloads
—
Updated
2026-09-22
Skill installs
—
Trust pendingMomentum not matched

Apache Nutch

apache★ 3.3kRepositoryexperimental

Extensible and scalable open source web crawler for large scale data collection.

Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.

Stars
3.3k
Downloads
—
Updated
2026-09-23
Skill installs
—
Trust pendingMomentum not matched

Crawl4AI

unclecode★ 84kToolexperimental

Open-source, LLM-friendly crawler with smart extraction strategies.

Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.

Stars
84k
Downloads
1736k
Updated
2026-09-25
Skill installs
—
Trust pendingMomentum not matched

Crawlee for Python

apify★ 9.6kRepositorystable

Python library for building reliable web crawlers and scrapers at scale

Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.

Stars
9.6k
Downloads
864k
Updated
2026-09-26
Skill installs
—
Trust pendingMomentum not matched

Crawlee

apify★ 26kRepositorystable

Apify's scraping and browser automation library for reliable large-scale crawlers.

Best match because its name, category, capabilities, or owner matches “crawler”. Adoption and trust break close ties.

Stars
26k
Downloads
807k
Updated
2026-09-26
Skill installs
—
Trust pendingMomentum not matched
Discover · SkillPilot