[Dyer-cli] is a great tool created to guide you use [dyer] fast and at ease, helps you build a robust crawler, data processor, netwrok program fast and correctly.
Dyer-cli is built completely by Rust programming language without extra dependencies, So rust must be installed beforehand, to test it with:
bash
rustup --version
if you ever see some infomation like that
bash
rustup 1.23.1 (3df2264a9 2020-11-30)
then you are ready to go, the following code would suffice.
bash
cargo install dyer-cli
the command will download the source code and complie it to build a executable file inside your $HOME/.cargo/bin
Dyer-cli provides some commands that helps you initialize, debug programm, but for now, only dyer-cli new supported, more commands are to go.
This command helps you initialize a project whose structure is
bash
|___Cargo.toml
|___Readme.md
|___data/
|___data/tasks/
|___src/
|___src/entity.rs
|___src/parser.rs
|___src/spider.rs
|___src/middleware.rs
|___src/main.rs
|___src/pipeline.rs