a1fus/csv-parakeet

Parquet to CSV converter

CSV-Parakeet

A simple command line tool to convert csv files to parquet, and vice versa.

Installation

Requirements:

• Python >=3.8

pip install --user csv-parakeet

Usage

parakeet p2c /path/to/input.parquet /path/to/output.csv
parakeet c2p /path/to/input.csv /path/to/output.parquet

Noticed a bug? Raise an issue.

csv-parakeet's Issues

Separate commands for csv to parquet and vice versa

Example:

$ parakeet c2p test.csv test.parquet
$ parakeet p2c test.parquet test.csv

Fix nox and add to release pipeline

Add short help option

docs link

Partition columns option for c2p

—partition_cols, -p option available when saving to parquet to pass partition column(s).

• Might need to validate columns are in the dataframe
• May be tricky handling multiple values, one option is a comma separated value that is split

Add additional pre commit hooks

Specifically:

• id: check-builtin-literals
• id: check-case-conflict
• id: check-docstring-first
• id: check-toml
• id: detect-private-key

Add verbose mode

—verbose, -v flag that echos where the file has been saved, with any options if applicable. Might be worth investigating if a decorator makes sense?

Record a demo with vhs

Run tests on dependency changes

Add option to read multiple files and combine into a single output

Run tests only on pull request and only when changes to python files

reference

Add Documentation

• Expand README.md
  • Installation
  • Usage
• Add help for both functions
• Contributing?
• Release notes

Add dependabot assignee