spider icon indicating copy to clipboard operation
spider copied to clipboard

Published 20 hours ago • verified publisher icon spider-rs
→

Metadata

The fastest web crawler written in Rust. Maintained by @a11ywatch.

Spider

Build Status Crates.io Documentation Rust

The fastest web crawler and indexer.

Getting Started

View the spider or CLI directory to get started.

Benchmarks

See BENCHMARKS.

Examples

See EXAMPLES.

Contributing

See CONTRIBUTING.

← Metadata

708
Stars
71
Forks
Watchers

Owner

verified publisher icon spider-rs

Metadata

The fastest web crawler written in Rust. Maintained by @a11ywatch.

Back