Getting the SQL statement from stdin

[pacman82]

Getting the SQL statement from stdin

[pacman82]

I’ll do this by extending the mara_db.shell.copy_to_stdout_command function. See also mara/mara-db#56

Just looking at this you may also like odbcsv.

[pacman82]

Hello @leo-schick ,

could you help me understand your motivation for doing so? Would reading the query from a file also be an acceptable solution to your problem?

Cheers, Markus

[leo-schick]

I plan to extend the Mara ETL framework with a db query to parquet function and would like to use odbc2parquet for this.

I’ll do this by extending the mara_db.shell.copy_to_stdout_command function. See also mara/mara-db#56

Mara is a nice ETL framework which does the data processing via shell tools instead of processing the data in python itself. This gives an extra performance boost compared to other ETL engines relying on e.g. pandas or pyarrow

[pacman82]

Hello @leo-schick ,

odbc2parquet 0.9.4 accepts a query from standard in if you pass - as a query string.

Cheers, Markus