Add common Sinks & Sources

[51zero]

Add common Sinks & Sources

[sksamuel]

What would you do on kafka, because kafka is a streaming source, in that you don't have a set of data, its an ever changing target. You could make it suck in all the messages from a queue from a given offset I suppose.

[Antwnis]

suck data in

• until Xo.ooo records fetched
• until timeout = 1.minute reached

also push any source data i.e. from a SQL -> into Json -> kafka topic or avro or whatever 👍

[sksamuel]

Ok cool ideas

On 27 January 2016 at 18:16, Antonios Chalkiopoulos <
[email protected]> wrote:

suck data in

• until Xo.ooo records fetched
• until timeout = 1.minute reached

also push any source data i.e. from a SQL -> into Json -> kafka topic or
avro or whatever [image: 👍]

—
Reply to this email directly or view it on GitHub
#17 (comment).

[sksamuel]

Splitting this up into different issues