Sample Apache Beam pipeline that can be deployed to Amazon Managed Service for Apache Flink. It reads taxi events from a Kinesis data stream, processes and aggregates them, and ingests the result to Amazon CloudWatch for visualization.
License: MIT No Attribution
Java 97.16%Shell 2.84%
amazon-kinesis-analytics-beam-taxi-consumer's People
Would you be able provide a bit more information about the runner being used, does it run directly against Kinesis or can we now directly target the new Kinesis Flink runtime?
If it does directly target Kinesis, would you have any information on the compatibility or limitations of the Apache Beam running on Kinesis or the limitations of running Beam? This example seems comprehensive, though I haven't found any additional information for the runner other than some source in beam repo and Kinesis doesn't appear to be listed as a runner in the beam compatibility matrix.
If we can now directly target Flink, are there any caveats or implementations details that we should know about and how would we change this example?