CSV to Arrow
Convert CSV files to Apache Arrow. This package is part of Arrow CLI tools.
Installation
Download prebuilt binaries
You can get the latest releases from https://github.com/domoritz/arrow-tools/releases.
With Cargo
cargo install csv2arrow
To avoid re-compilation and speed up installation, you can install this tool with cargo binstall:
cargo binstall csv2arrow
Usage
```
Usage: csv2arrow [OPTIONS] [ARROW]
Arguments:
Input CSV file, stdin if not present
[ARROW] Output file, stdout if not present
Options:
-s, --schema-file
File with Arrow schema in JSON format
-m, --max-read-records
The number of records to infer the schema from. All rows if not present. Setting max-read-records to zero will stop schema inference and all columns will be string typed
--header
Set whether the CSV file has headers [possible values: true, false]
-d, --delimiter
Set the CSV file's column delimiter as a byte character [default: ,]
-p, --print-schema
Print the schema to stderr
-n, --dry
Only print the schema
-h, --help
Print help
-V, --version
Print version
```
The --schema-file option uses the same file format as --dry and --print-schema.