coderhs/csvsqlweb

Manipulate CSV using SQL online

CSVSQLWEB *

Demo

A web based application that allows you to manipulate a CSV file using SQL. The app import the csv file into an in memory sqlite3 database, thus no data (100% privacy) is ever shared with the web server. The data in database can be manipulated using SQL, and then the result of the SQL can be downloaded as a CSV file.

This project doesn't use any special framework at the moment but we are building using 2 major libraries.

1. Papaparse Papa parse, lightweight library that parses and generates CSV files.
2. sql.js SQLite compiled to JavaScript

Things to do

1. Proper/better name for the project
2. Move both Papa parse/SQL to service worker, to reduce load on the browser main thread.
3. Validate SQL query as valid before executing
4. Detect data type and use that when we create the table

Run Locally

npm install
http-server .

csvsqlweb's Issues

Detect SQLite keywords in column names

When the CSV file has column names that are keywords in SQLite the CSV silently fails to load.

In my case, the CSV had a column named index. When I changed it to idx the file loaded correctly. Perhaps you could add a tail to column names that are keywords so, for instance, a column name of index would be imported as index_. That would avoid the collision and stop the error that blocks loading the data. If you need test data, I was using the organizations-10000.csv file from here.

No license

There's no license in this repo. If you intend it to be open source, please add a license. If it's not intended to be open source, you should probably state that in the README.