Requests2

A Rust library the crate help you quickly request, parse and store data ([Python] BS4 library).

• Each new requests initializes a cache instance which stores the parsed data in key value pairs

• When you get an instance of connect, you can call the parser method to parse the data in the form of closure

• use dbnote macro, write data to a database table

• set connect database str in config file

• find findall select selectall method supports CSS selectors to parse DOM document

rust config postgres=<host=localhost user=your password=test dbname=postgres> sqlite=<dbname=sqlite_db>

auto add sqlite_db file to project dir, support sqlite

store data to csv and postgres database, you can use this example code:

```rust // store example use requests2::{ dbfile::{self, DBfile}, dbfile_derive::{dbnote, DBfile}, *, };

// change postgres to sqlite same run

[derive(DBfile)]

[dbnote(tablename = "test999", driver = "postgres" primarykey = "isbn")]

pub struct PP { pub isbn: String, pub price: f32, }

fn main() { let pp = PP { isbn: String::from("test"), price: 0.1, }; pp.createtable(); pp.todb(); } ```

```rust // parse code let data = Cache::new(); let client = Requests::new(&data); let rq = client.connect("https://www.qq.com/", Headers::Default);

[derive(DBfile, Debug)]

[dbnote(tablename = "testlink", driver = "postgres", primary_key="href")]

struct Link<'a> { href: &'a str, link_name: String, title: &'a str, }

rq.free_parse(|p| { let title = p.select("title").text();

let links = p
    .select_all("li.nav-item a")
    .iter()
    .map(|x| Link {
        title: "",
        href: x.attr("href").unwrap_or_default(),
        link_name: x.text(),
    })
    .collect::<Vec<Link>>();


// create a table
links[0].create_table();

for (idx, mut link) in links.into_iter().enumerate() {
    if idx == 0 {
        link.title = &title;
        link.write_csv_head();
    }
    link.to_csv("a");
    link.to_db();
}

}); `` Add#[dbnote(tablename = "testlink", driver = "postgres", primarykey="href")]to struct, you can use writecsvhead()andtocsvput data to a file, table_name as file name. Usecreateatable()you can creata table in postgres , but you must add config file to project.todb()` put data to the table.

find() find_all() select() select_all() method unified use css selector as first argument.

See the test folder for more details