ORC output/input support

[yotpoltd]

ORC output/input support

[lyogev]

Not planned at the moment, if anyone wishes to help write this it can be very helpful.

[lyogev]

It's possible now with the new generic file input

[tooptoop4]

readme does not mention anything about ORC

[lyogev]

Add to your metric config file:

output:
  - dataFrameName: df
    outputType: File
    format: orc
    outputOptions:
      saveMode: Overwrite
      path: file.orc
     ....

Check out metric full sample config file

[tooptoop4]

its not in the metric full sample config file?

[lyogev]

We haven't documented all formats possible but the file output type allows sending arbitrary formats and parameters to spark as long as it's in your classpath.
You are welcome to add an orc example + documentation it would be great!