CSV to Arrow

Crates.io

Convert CSV files to Apache Arrow. This package is part of Arrow CLI tools.

Installation

Download prebuilt binaries

You can get the latest releases from https://github.com/domoritz/arrow-tools/releases.

With Cargo

cargo install csv2arrow

With Cargo B(inary)Install

To avoid re-compilation and speed up installation, you can install this tool with cargo binstall:

cargo binstall csv2arrow

Usage

``` Usage: csv2arrow [OPTIONS] [ARROW]

Arguments: Input CSV file, stdin if not present [ARROW] Output file, stdout if not present

Options: -s, --schema-file File with Arrow schema in JSON format -m, --max-read-records The number of records to infer the schema from. All rows if not present. Setting max-read-records to zero will stop schema inference and all columns will be string typed --header

Set whether the CSV file has headers [possible values: true, false] -d, --delimiter Set the CSV file's column delimiter as a byte character [default: ,] -p, --print-schema Print the schema to stderr -n, --dry Only print the schema -h, --help Print help -V, --version Print version ```

The --schema-file option uses the same file format as --dry and --print-schema.