← All leaderboards
Site crawling
What this board tests: enumerate and fetch many pages across a site. Every provider below ran the identical corpus on 2026-09-14. The composite blends measured quality, latency p50, the track-specific cost metric and error rate. Method and corpora: how we measure.
| Rank | Provider | Composite | Coverage | Cost | Latency p50 | Field note |
|---|---|---|---|---|---|---|
| 1 |  Tavily |
8.91/10 | 0.88 | $0.013 / useful | 523 ms | Performs well through its /map variant. |
| 2 |  Firecrawl |
8.17/10 | 0.84 | $0.026 / useful | 13.9 s | Clean path-scoped enumeration; Tavily's map now covers more of the corpus. |
| 3 |  Spider |
7.96/10 | 0.68 | $5.7e-05 / useful | 4.8 s | Quick at recursive crawling. |
| 4 |  Bright Data |
4.44/10 | 0.10 | $0.01 / useful | 7.2 s | No link discovery: url_collection hands back just the seed. |
Low scores are published alongside high ones — a ranking you can only trust if nothing gets hidden. No per-call markup, no commission from any provider. Cost figures are priced by the 2026-09-14 run's own table; the price the gateway bills today is on each provider page.