jnsrch/pdi-fastjsoninput-plugin

FastJsonInput step plugin for Pentaho Data Integration

Fast JSON Input - PDI Plugin

This is an alternate version of the "JSON Input" step that uses Jayway JsonPath instead of a parser based on JavaScript. It is intended to be a drop-in replacement for the "JSON Input" step but should be much faster and memory efficient.

Features over PDI JSON Input

• [PDI-10344] Replaced JavaScript parsing engine with Jayway JsonPath
• [PDI-10858] Checkbox to "Remove source field from output stream"
• Checkbox to enable JsonPath's DEFAULT_PATH_LEAF_TO_NULL option which returns null for missing leafs:

[
    {
        "name": "Jesse Adametz",
        "gender": "male"
    },
    {
        "name": "Etienne Dube"
    }
]

• Tests! There are currently 4 test cases which test the permutations of "Ignore missing path" and "Default path leaf to null"

Help

Help for the step and its usage can be found in the Help documentation.

Development

Build

To build (requires Apache Maven 3 or later):

mvn package

Install

1. Run mvn install -Dpdi.home=/path/to/local/data-integration (e.g. - mvn install -Dpdi.home=/ssd/graphiq/gq-kettle/dist)

Authors:

• Etienne Dube - etdube (at) gmail (dot) com
• Jesse Adametz - jesse (at) graphiq (dot) com
• James Ebentier - jebentier (at) graphiq (dot) com