spcsv v0.0.8 and spcsv v0.1.0 splitting 12,133,531 rows from a CSV if 1.8G of size into 10 files:
spcsv Covid.csv 10
Experimental branch
Simple command to split into n files the contents of one big csv.
Simply run:
cargo install split-csv
Or use the GitHub version:
cargo install --git https://github.com/AOx0/csv-split
```HELP spcsv 0.1.1 Split a lage csv file into multiple files
USAGE:
spcsv [OPTIONS]
ARGS:
OPTIONS: -h, --help Print help information -n, --not-signed-file The first line of FILE is NOT a header line. [By default it is] -r, --remaining-in-last Write remaining lines in the last file [By default remaining rows are written to a new extra file] -v, --verbose Print when file is created -V, --version Print version information ```
Example:
spcsv COVID19.csv 100
The example above will split the lines of Covid.csv along a hundred files with the names: Covid_1.csv, Covid_2.csv, Covid_3.csv, ....
Comparison of benchmarking results for spcsv v0.0.8 and spcsv v0.1.0 splitting 12,133,531 rows from a CSV if 1.8G of size into 10 files:
spcsv Covid.csv 10
Splitting the CSV into 50 files:
spcsv Covid.csv 50
Splitting the CSV into 100 files:
spcsv Covid.csv 100
Splitting the CSV into 10000 files:
spcsv Covid.csv 10000
