This is a Rust program that splits a CSV file into multiple files. It is designed to be as fast as possible.
This is also a work in progress, so your mileage may vary.
bash
$ cargo install csv-splitter
or:
bash
$ git clone git@github.com:patterns-complexity/csv-splitter
$ cd csv-splitter
$ cargo build --release
$ cd ./target/release/
$ ./csv-splitter -h
bash
$ csv-splitter -d <input_directory> -o <output_directory> -g <granularity>
or:
bash
$ csv-splitter --directory <input_directory> --output <output_directory> --granularity <granularity>
help:
bash
$ csv-splitter -h
| Short form | Long form | Description | | --- | --- | --- | | -d | --directory | The directory containing the CSV files to split | | -o | --output | The directory to output the split files to | | -g | --granularity | The number of lines to split the CSV files by |
bash
$ csv-splitter -d ./input -o ./output -g 500