geofbot/flink

Mirror of Apache Flink. See `new-iterations-with-multiops` branch for Python API bulk iterations implementation

flink's Issues

Work Log

The result of .flat_map cannot be directly used to close bulk iterations

iteration = [...].flat_map(lambda x, c: [x, x])
iterator.close_with(iteration)

...causes...

------------------------------------------------------------
 The program finished with the following exception:

org.apache.flink.client.program.ProgramInvocationException: The main method caused an error.
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:524)
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:403)
    at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:331)
    at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:775)
    at org.apache.flink.client.CliFrontend.run(CliFrontend.java:251)
    at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1003)
    at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1046)
Caused by: java.lang.RuntimeException: Error while creating the data flow plan for the program: Unknown operator or data set type: null
    at org.apache.flink.api.java.operators.OperatorTranslation.translate(OperatorTranslation.java:104)
    at org.apache.flink.api.java.operators.OperatorTranslation.translateBulkIteration(OperatorTranslation.java:196)
    at org.apache.flink.api.java.operators.OperatorTranslation.translate(OperatorTranslation.java:94)
    at org.apache.flink.api.java.operators.OperatorTranslation.translateSingleInputOperator(OperatorTranslation.java:124)
    at org.apache.flink.api.java.operators.OperatorTranslation.translate(OperatorTranslation.java:88)
    at org.apache.flink.api.java.operators.OperatorTranslation.translateSingleInputOperator(OperatorTranslation.java:124)
    at org.apache.flink.api.java.operators.OperatorTranslation.translate(OperatorTranslation.java:88)
    at org.apache.flink.api.java.operators.OperatorTranslation.translate(OperatorTranslation.java:63)
    at org.apache.flink.api.java.operators.OperatorTranslation.translateToPlan(OperatorTranslation.java:51)
    at org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:1035)
    at org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:1002)
    at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:58)
    at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:896)
    at org.apache.flink.python.api.PythonPlanBinder.runPlan(PythonPlanBinder.java:150)
    at org.apache.flink.python.api.PythonPlanBinder.main(PythonPlanBinder.java:115)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:509)
    ... 6 more