reqwest_resume

Crates.io MIT / Apache 2.0 licensed Build Status

Docs

Wrapper that uses the Range HTTP header to resume get requests.

It's a thin wrapper around reqwest. It's a work in progress – wrapping functionality is copied across on an as-needed basis. Feel free to open a PR/issue if you need something.

Example

```rust extern crate reqwest_resume; extern crate flate2;

use std::io::{BufRead, BufReader};

let url = "http://commoncrawl.s3.amazonaws.com/crawl-data/CC-MAIN-2018-30/warc.paths.gz"; let body = reqwest_resume::get(url.parse().unwrap()).unwrap(); // Content-Encoding isn't set, so decode manually let body = flate2::read::MultiGzDecoder::new(body);

for line in BufReader::new(body).lines() { println!("{}", line.unwrap()); } ```

License

Licensed under either of

at your option.

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.