Giter Site home page Giter Site logo

Comments (2)

gvenzl avatar gvenzl commented on May 13, 2024

It is unclear whether that feature provides significant value to be implemented. Users today can load data into a staging table with all columns being of a string data type and then perform the data type conversion inside the database.

There is a valid argument that dates should be converted correctly when loaded into a table with the correct data types, hence requiring a way of passing on the date format (as NLS value for example with Oracle). However, the question is where to start and where to stop. For example, what to do with TIMESTAMP columns, and what to do with NUMBER columns in different regions in the world where the fraction symbol is , and not .. What about character set conversion, etc.

By having date format available to be passed on as command line parameter, users could be lead to expect all other conversions to be provided as well, quickly moving the complexity of data type conversion out from the database and into csv2db and further increase the already long list of parameters. Since the very inception of csv2db it has been a core principle for it not to become an ETL tools with all the bells and whistles. There are already many, very good ETL tools out there and the world doesn't need yet another. Instead, csv2db should aid users as a simple command line tool to get rows from a delimited file into a database table, and not more! According to these principles, the question of data type conversion can be answered by the user in three ways:

  1. Load the data into a staging table with all string columns, then perform the data type conversion with database provided functionality such as INSERT INTO SELECT and/or stored procedures. However, this does not solve the question of character set conversion.
  2. Have the database configured correctly to match the territory and incoming data of the files, hence allowing for implicit data type and avoiding unnecessary character set conversion
  3. Do not use csv2db but one of the many, good ETL tools instead.

from csv2db.

gvenzl avatar gvenzl commented on May 13, 2024

This ER will not be implemented based on the feedback above.

from csv2db.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.