robotparser-rs

robots.txt parser for Rust.