docteurklein/php-etl

Extract-Transform-Load library

php-etl's Issues

[RFC] TransformerChain

New idea.

TransformerChain which implements TransformerInterface. It accepts collection of transformers in the constructor and iterates over them and calls transform() on each of them.

Add some Examples

Hi,

i really like this library, but it's hard to understand how it's working if you see it for the first time.

Ok, there is the /bin folder and the config.sample, but it woud be really cool to have some standard use cases in the Readme.

[Transformer] Why transform data should be array ?

Hi !

Is there any good reason to force $data to be an array in TransformerInterface ?

https://github.com/docteurklein/php-etl/blob/master/src/Knp/ETL/TransformerInterface.php#L17

ExtractorInterface should be iterator

@docteurklein Does this makes sense to you?

Undefined ContextInterface.getTableName()

Called in DBALLoader on ContextInterface.

Console table loader

http://symfony.com/doc/current/components/console/helpers/table.html

Should inject SplFileObject in CsvExtractor

Waiting for PR ;)

bin/pimple-etl config.sample.php fails

It is in readme, and it fails:

$ bin/pimple-etl config.sample.php
PHP Fatal error:  Uncaught exception 'RuntimeException' with message 'SplFileObject::__construct(csv/users.csv): failed to open stream: No such file or directory' in src/Knp/ETL/Extractor/CsvExtractor.php:29
Stack trace:
#0 src/Knp/ETL/Extractor/CsvExtractor.php(29): SplFileObject->__construct('/home/umpirsky/...')
#1 config.sample.php(36): Knp\ETL\Extractor\CsvExtractor->__construct('/home/umpirsky/...', ';', '"', 0)
#2 vendor/pimple/pimple/src/Pimple/Container.php(113): {closure}(Object(Pimple\Container))
#3 bin/pimple-etl(17): Pimple\Container->offsetGet('e')
#4 {main}
  thrown in src/Knp/ETL/Extractor/CsvExtractor.php on line 29

Fatal error: Uncaught exception 'RuntimeException' with message 'SplFileObject::__construct(csv/users.csv): failed to open stream: No such file or directory' in src/Knp/ETL/Extractor/CsvExtractor.php on line 29

RuntimeException: SplFileObject::__construct(csv/users.csv): failed to open stream: No such file or directory in src/Knp/ETL/Extractor/CsvExtractor.php on line 29

Call Stack:
    0.0030     638128   1. {main}() bin/pimple-etl:0
    0.0047     971928   2. Pimple\Container->offsetGet() bin/pimple-etl:17
    0.0047     971960   3. {closure:config.sample.php:36-36}() vendor/pimple/pimple/src/Pimple/Container.php:113
    0.0050    1002152   4. Knp\ETL\Extractor\CsvExtractor->__construct() config.sample.php:36
    0.0050    1006568   5. SplFileObject->__construct() src/Knp/ETL/Extractor/CsvExtractor.php:29

Not very user friendly.

I suggest adding user entity and csv to fixtures and make it work by default.

Or providing some more basic example like suggested in #24 (comment).

[RFC] Semantic fluent interface

$etl = new Knp\Etl();

$etl
    ->extract('from.csv')
    ->transform(function(array $data) {
        return array_change_key_case($data)
    })
    ->load('to.json')
;

What do you think?