hazelcast/hazelcast-jet-demos

Demonstration applications using Hazelcast Jet

Hazelcast Jet Demo Applications

These are Demonstration applications using Hazelcast Jet. Each is a full application and demonstrates how you can use Jet to solve real-world problems.

For smaller, feature specific samples see https://github.com/hazelcast/hazelcast-jet-code-samples

Application Demos

• Bitcoin Death Cross - See Hazelcast Guides.
• Real-time Image Recognition - Recognizes images present in the webcam video input with a model trained with CIFAR-10 dataset.
• Twitter Cryptocurrency Sentiment Analysis - Twitter content is analyzed in real time to calculate cryptocurrency trend list with popularity index.
• Real-Time Road Traffic Analysis and Prediction - Continuously computes linear regression models from current traffic. Uses the trend from week ago to predict traffic now.
• Real-time Sports Betting Engine - This is a simple example of a sports book and is a good introduction to the Pipeline API. It also uses Hazelcast IMDG as an in-memory data store.
• Flight Telemetry - See Hazelcast Guides.
• Market Data Ingestion - Uploads a stream of stock market data (prices) from a Kafka topic into an IMDG map. Data is analysed as part of the upload process, calculating the moving averages to detect buy/sell indicators. Input data here is manufactured to ensure such indicators exist, but this is easy to reconnect to real input.
• Markov Chain Generator Generates a Markov Chain with probabilities based on supplied classical books.
• Train Track An Apache Beam IOT example, tracking a GPS feed from a train.
• TensorFlow A TensorFlow example showcasing a ML model execution in Hazelcast Jet pipelines.
• Debezium Change Data Capture with Apache Kafka A Debezium example showcasing consumption of CDC events from Apache Kafka in Hazelcast Jet pipelines.
• Debezium Change Data Capture without Apache Kafka A Debezium example showcasing consumption of CDC events directly from Debezium using Kafka Connect source in Hazelcast Jet pipelines.

External Demos

• Real-Time Trade Processing Oliver Buckley-Salmon. Reads from a Kafka topic with Jet and then storage to HBase and Hazelcast IMDG. Shows enrichment and streaming aggregations. Jet 0.4.
• Transport Tycoon Collision Prevention Vladimír Schreiner. Reads a vehicle telemetry data from the running Open Transport Tycoon DeLuxe game and uses Jet to predict and prevent collisions.

Prerequisites

• Git Large File Storage: Installation Guide Some of the demo applications includes machine learning models in their use cases. Since some models' size exceeds GitHub's 100MB file storage limit this repository uses Git LFS.
• Java Development Kit 8+: Installation Guide
• Apache Maven: Installation Guide

hazelcast-jet-demos's Issues

Change default discovery method to TCP/IP

Change default discovery for demos to TCP/IP from multicast.

Multicast doesn’t usually work on the public Wifi networks (frequent when demoing).

When multicast is working, one may unintentionally join the cluster with attendees running the demo on their laptops.

Log how many items processed on JetCoinTrend

It is nice to see that how many items processed to calculate those windows.

Clean Code : flight-telemetry

https://github.com/hazelcast/hazelcast-jet-demos/blob/master/flight-telemetry/src/main/java/com/hazelcast/jet/demo/Demo.java

As a Java engineer new to Jet I would look at this class and wonder what the hell is going on.

Can we please break down the build of the DAG into atomic methods that are cleanly described and have instructive JavaDocs. So for example when you build Noise Levels have that in its own method.

Right now we have one long method that is very scarey to read.

Add Jet scoring to the main pipeline in Churn Prediction

Jet isn’t doing the scoring. Instead of that, Jet just pumps the scoring requests from Kafka to an IMap. Then, the data are downloaded to the client to do scoring locally in a loop. To show the integration of Jet an JPMML, the Jet pipeline should be consume from input -> classify -> write result to sink.

Train Track broken on 4.1 - NoClassDefFoundError: com/hazelcast/jet/IMapJet

Exception in thread "main" java.lang.reflect.InvocationTargetException
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:564)
    at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
    at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
    at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
    at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:52)
Caused by: java.lang.NoClassDefFoundError: com/hazelcast/jet/IMapJet
    at java.base/java.lang.Class.getDeclaredMethods0(Native Method)
    at java.base/java.lang.Class.privateGetDeclaredMethods(Class.java:3119)
    at java.base/java.lang.Class.getDeclaredMethod(Class.java:2432)
    at org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:191)
    at org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:155)
    at org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55)
    at org.apache.beam.sdk.Pipeline.create(Pipeline.java:147)
    at com.hazelcast.jet.demos.traintrack.MyBeamJob.build(MyBeamJob.java:31)
    at com.hazelcast.jet.demos.traintrack.Application.main(Application.java:61)
    ... 8 more
Caused by: java.lang.ClassNotFoundException: com.hazelcast.jet.IMapJet
    at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:466)
    at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:566)
    at org.springframework.boot.loader.LaunchedURLClassLoader.loadClass(LaunchedURLClassLoader.java:92)
    at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:499)
    ... 17 more

java -jar jetleopard-1.0.0-SNAPSHOT.jar

We should have a main class in the manifest of the jar.

It's not clear what to run.

customer churn : mvn clean install : kafka hangs on tests

running mvn clean install runs the test suites. Kafka hangs...

2018-02-08 07:40:05.076  WARN 8241 --- [.async.thread-3] com.hazelcast.jet.impl.MasterContext     : [172.18.0.1]:5701 [jet] [0.5] Execution of job fd5d-7242-a8ba-0fd5, execution 37b1-57d3-7158-6866 failed in 305331 ms

com.hazelcast.jet.JetException: Exception in ProcessorTasklet{vertex=streamKafka, processor=com.hazelcast.jet.impl.connector.kafka.StreamKafkaP@57aa242d}: org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata
	at com.hazelcast.jet.impl.execution.TaskletExecutionService$BlockingWorker.run(TaskletExecutionService.java:173) ~[hazelcast-jet-0.5.jar:0.5]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_161]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_161]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_161]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_161]
	at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_161]
	at ------ submitted from ------.(Unknown Source) ~[na:na]
	at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolve(InvocationFuture.java:127) ~[hazelcast-jet-0.5.jar:0.5]
	at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolveAndThrowIfException(InvocationFuture.java:79) ~[hazelcast-jet-0.5.jar:0.5]
	at com.hazelcast.spi.impl.AbstractInvocationFuture.get(AbstractInvocationFuture.java:147) ~[hazelcast-jet-0.5.jar:0.5]
	at com.hazelcast.jet.impl.MasterContext.lambda$invoke$15(MasterContext.java:551) [hazelcast-jet-0.5.jar:0.5]
	at com.hazelcast.jet.impl.util.ExceptionUtil.lambda$withTryCatch$0(ExceptionUtil.java:132) ~[hazelcast-jet-0.5.jar:0.5]
	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760) ~[na:1.8.0_161]
	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736) ~[na:1.8.0_161]
	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) ~[na:1.8.0_161]
	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962) ~[na:1.8.0_161]
	at com.hazelcast.jet.impl.MasterContext.lambda$invokeOnParticipants$19(MasterContext.java:600) [hazelcast-jet-0.5.jar:0.5]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_161]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_161]
	at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_161]
	at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:64) ~[hazelcast-jet-0.5.jar:0.5]
	at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:80) ~[hazelcast-jet-0.5.jar:0.5]
Caused by: org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata

Add file with input data to Churn Predictor

The web app hardly produces enough clicks to justify Jet’s ability to scale. The demo should contain the “big” file with input data to demonstrate how demo works in “scale”. The web app should be used as another means of input. One can easily achieve this by using IMap as an input source. Both web app and file-based client would write to this IMap.

PR builder fails on `master`

[WARNING] Error injecting: org.springframework.boot.maven.RepackageMojo
java.lang.TypeNotPresentException: Type org.springframework.boot.maven.RepackageMojo not present
    at org.eclipse.sisu.space.URLClassSpace.loadClass (URLClassSpace.java:147)
    at org.eclipse.sisu.space.NamedClass.load (NamedClass.java:46)
    at org.eclipse.sisu.space.AbstractDeferredClass.get (AbstractDeferredClass.java:48)
    at com.google.inject.internal.ProviderInternalFactory.provision (ProviderInternalFactory.java:86)
    at com.google.inject.internal.InternalFactoryToInitializableAdapter.provision (InternalFactoryToInitializableAdapter.java:57)
    at com.google.inject.internal.ProviderInternalFactory$1.call (ProviderInternalFactory.java:67)
    at com.google.inject.internal.ProvisionListenerStackCallback$Provision.provision (ProvisionListenerStackCallback.java:109)
    at com.google.inject.internal.ProvisionListenerStackCallback$Provision.provision (ProvisionListenerStackCallback.java:124)
    at com.google.inject.internal.ProvisionListenerStackCallback.provision (ProvisionListenerStackCallback.java:66)
    at com.google.inject.internal.ProviderInternalFactory.circularGet (ProviderInternalFactory.java:62)
    at com.google.inject.internal.InternalFactoryToInitializableAdapter.get (InternalFactoryToInitializableAdapter.java:47)
    at com.google.inject.internal.InjectorImpl$1.get (InjectorImpl.java:1101)
    at org.eclipse.sisu.inject.Guice4$1.get (Guice4.java:162)
    at org.eclipse.sisu.inject.LazyBeanEntry.getValue (LazyBeanEntry.java:81)
    at org.eclipse.sisu.plexus.LazyPlexusBean.getValue (LazyPlexusBean.java:51)
    at org.codehaus.plexus.DefaultPlexusContainer.lookup (DefaultPlexusContainer.java:263)
    at org.codehaus.plexus.DefaultPlexusContainer.lookup (DefaultPlexusContainer.java:255)
    at org.apache.maven.plugin.internal.DefaultMavenPluginManager.getConfiguredMojo (DefaultMavenPluginManager.java:494)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:114)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:342)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:330)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:175)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:76)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:163)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:160)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:910)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:283)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:226)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:407)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:348)
Caused by: java.lang.UnsupportedClassVersionError: org/springframework/boot/maven/RepackageMojo has been compiled by a more recent version of the Java Runtime (class file version 61.0), this version of the Java Runtime only recognizes class file versions up to 52.0
    at java.lang.ClassLoader.defineClass1 (Native Method)
    at java.lang.ClassLoader.defineClass (ClassLoader.java:756)
    at java.security.SecureClassLoader.defineClass (SecureClassLoader.java:142)
    at java.net.URLClassLoader.defineClass (URLClassLoader.java:473)
    at java.net.URLClassLoader.access$100 (URLClassLoader.java:74)
    at java.net.URLClassLoader$1.run (URLClassLoader.java:369)
    at java.net.URLClassLoader$1.run (URLClassLoader.java:363)
    at java.security.AccessController.doPrivileged (Native Method)
    at java.net.URLClassLoader.findClass (URLClassLoader.java:362)
    at org.codehaus.plexus.classworlds.realm.ClassRealm.findClassInternal (ClassRealm.java:313)
    at org.codehaus.plexus.classworlds.realm.ClassRealm.loadClassFromSelf (ClassRealm.java:432)
    at org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy.loadClass (SelfFirstStrategy.java:42)
    at org.codehaus.plexus.classworlds.realm.ClassRealm.unsynchronizedLoadClass (ClassRealm.java:271)
    at org.codehaus.plexus.classworlds.realm.ClassRealm.loadClass (ClassRealm.java:247)
    at org.codehaus.plexus.classworlds.realm.ClassRealm.loadClass (ClassRealm.java:239)
    at org.eclipse.sisu.space.URLClassSpace.loadClass (URLClassSpace.java:139)
    at org.eclipse.sisu.space.NamedClass.load (NamedClass.java:46)
    at org.eclipse.sisu.space.AbstractDeferredClass.get (AbstractDeferredClass.java:48)
    at com.google.inject.internal.ProviderInternalFactory.provision (ProviderInternalFactory.java:86)
    at com.google.inject.internal.InternalFactoryToInitializableAdapter.provision (InternalFactoryToInitializableAdapter.java:57)
    at com.google.inject.internal.ProviderInternalFactory$1.call (ProviderInternalFactory.java:67)
    at com.google.inject.internal.ProvisionListenerStackCallback$Provision.provision (ProvisionListenerStackCallback.java:109)
    at com.google.inject.internal.ProvisionListenerStackCallback$Provision.provision (ProvisionListenerStackCallback.java:124)
    at com.google.inject.internal.ProvisionListenerStackCallback.provision (ProvisionListenerStackCallback.java:66)
    at com.google.inject.internal.ProviderInternalFactory.circularGet (ProviderInternalFactory.java:62)
    at com.google.inject.internal.InternalFactoryToInitializableAdapter.get (InternalFactoryToInitializableAdapter.java:47)
    at com.google.inject.internal.InjectorImpl$1.get (InjectorImpl.java:1101)
    at org.eclipse.sisu.inject.Guice4$1.get (Guice4.java:162)
    at org.eclipse.sisu.inject.LazyBeanEntry.getValue (LazyBeanEntry.java:81)
    at org.eclipse.sisu.plexus.LazyPlexusBean.getValue (LazyPlexusBean.java:51)
    at org.codehaus.plexus.DefaultPlexusContainer.lookup (DefaultPlexusContainer.java:263)
    at org.codehaus.plexus.DefaultPlexusContainer.lookup (DefaultPlexusContainer.java:255)
    at org.apache.maven.plugin.internal.DefaultMavenPluginManager.getConfiguredMojo (DefaultMavenPluginManager.java:494)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:114)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute2 (MojoExecutor.java:342)
    at org.apache.maven.lifecycle.internal.MojoExecutor.doExecute (MojoExecutor.java:330)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:175)
    at org.apache.maven.lifecycle.internal.MojoExecutor.access$000 (MojoExecutor.java:76)
    at org.apache.maven.lifecycle.internal.MojoExecutor$1.run (MojoExecutor.java:163)
    at org.apache.maven.plugin.DefaultMojosExecutionStrategy.execute (DefaultMojosExecutionStrategy.java:39)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:160)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:105)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:73)
    at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:53)
    at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:118)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:261)
    at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:173)
    at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:101)
    at org.apache.maven.cli.MavenCli.execute (MavenCli.java:910)
    at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:283)
    at org.apache.maven.cli.MavenCli.main (MavenCli.java:206)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:283)
    at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:226)
    at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:407)
    at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:348)

Suggests issue with Spring version not supporting Java 8, which the project is currently built on.

This blocks any other PRs.

Move relevant maven properties to parent

Should some (all?) maven dependencies & properties be pulled up to the parent project to avoid version clash across the examples?

tensorflow example fails on 4.4

Using

mvn compile exec:java -Dexec.mainClass=InProcessClassification -Dexec.args="data"

as per README.md https://github.com/hazelcast/hazelcast-jet-demos/blob/master/tensorflow/README.md gives

com.hazelcast.nio.serialization.HazelcastSerializationException: java.io.InvalidObjectException: ReflectiveOperationException during deserialization
	at com.hazelcast.internal.serialization.impl.SerializationUtil.handleException(SerializationUtil.java:103)
	at com.hazelcast.internal.serialization.impl.AbstractSerializationService.toObject(AbstractSerializationService.java:211)
	at com.hazelcast.jet.impl.execution.init.CustomClassLoadedObject.deserializeWithCustomClassLoader(CustomClassLoadedObject.java:66)
	at com.hazelcast.jet.impl.JobCoordinationService.deserializeJobDefinition(JobCoordinationService.java:876)
	at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitJob$1(JobCoordinationService.java:208)
	at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$46(JobCoordinationService.java:1039)
	at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$47(JobCoordinationService.java:1060)
	at com.hazelcast.internal.util.executor.CompletableFutureTask.run(CompletableFutureTask.java:64)
	at com.hazelcast.internal.util.executor.CachedExecutorServiceDelegate$Worker.run(CachedExecutorServiceDelegate.java:217)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at java.base/java.lang.Thread.run(Thread.java:832)
	at com.hazelcast.internal.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:76)
	at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102)
Caused by: java.io.InvalidObjectException: ReflectiveOperationException during deserialization
	at java.base/java.lang.invoke.SerializedLambda.readResolve(SerializedLambda.java:244)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at java.base/java.io.ObjectStreamClass.invokeReadResolve(ObjectStreamClass.java:1316)
	at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2244)
	at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1712)
	at java.base/java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2540)
	at java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2434)
	at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2235)
	at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1712)
	at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:519)
	at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:477)
	at java.base/java.util.ArrayList.readObject(ArrayList.java:899)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at java.base/java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1226)
	at java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2401)
	at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2235)
	at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1712)
	at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:519)
	at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:477)
	at java.base/java.util.HashMap.readObject(HashMap.java:1551)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at java.base/java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1226)
	at java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2401)
	at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2235)
	at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1712)
	at java.base/java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2540)
	at java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2434)
	at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2235)
	at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1712)
	at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:519)
	at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:477)
	at com.hazelcast.internal.serialization.impl.defaultserializers.JavaDefaultSerializers$JavaSerializer.read(JavaDefaultSerializers.java:83)
	at com.hazelcast.internal.serialization.impl.defaultserializers.JavaDefaultSerializers$JavaSerializer.read(JavaDefaultSerializers.java:76)
	at com.hazelcast.internal.serialization.impl.StreamSerializerAdapter.read(StreamSerializerAdapter.java:44)
	at com.hazelcast.internal.serialization.impl.AbstractSerializationService.toObject(AbstractSerializationService.java:205)
	... 12 more
Caused by: java.lang.reflect.InvocationTargetException
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:64)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at java.base/java.lang.invoke.SerializedLambda.readResolve(SerializedLambda.java:242)
	... 55 more
Caused by: java.lang.IllegalArgumentException: Invalid lambda deserialization
	at InProcessClassification.$deserializeLambda$(InProcessClassification.java:1)
	... 60 more
[WARNING] 
com.hazelcast.nio.serialization.HazelcastSerializationException: java.io.InvalidObjectException: ReflectiveOperationException during deserialization
    at com.hazelcast.internal.serialization.impl.SerializationUtil.handleException (SerializationUtil.java:103)
    at com.hazelcast.internal.serialization.impl.AbstractSerializationService.toObject (AbstractSerializationService.java:211)
    at com.hazelcast.jet.impl.execution.init.CustomClassLoadedObject.deserializeWithCustomClassLoader (CustomClassLoadedObject.java:66)
    at com.hazelcast.jet.impl.JobCoordinationService.deserializeJobDefinition (JobCoordinationService.java:876)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitJob$1 (JobCoordinationService.java:208)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$46 (JobCoordinationService.java:1039)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$47 (JobCoordinationService.java:1060)
    at com.hazelcast.internal.util.executor.CompletableFutureTask.run (CompletableFutureTask.java:64)
    at com.hazelcast.internal.util.executor.CachedExecutorServiceDelegate$Worker.run (CachedExecutorServiceDelegate.java:217)
    at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1130)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:630)
    at java.lang.Thread.run (Thread.java:832)
    at com.hazelcast.internal.util.executor.HazelcastManagedThread.executeRun (HazelcastManagedThread.java:76)
    at com.hazelcast.internal.util.executor.HazelcastManagedThread.run (HazelcastManagedThread.java:102)
Caused by: java.io.InvalidObjectException: ReflectiveOperationException during deserialization
    at java.lang.invoke.SerializedLambda.readResolve (SerializedLambda.java:244)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:64)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:564)
    at java.io.ObjectStreamClass.invokeReadResolve (ObjectStreamClass.java:1316)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2244)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java:2540)
    at java.io.ObjectInputStream.readSerialData (ObjectInputStream.java:2434)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2235)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:519)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:477)
    at java.util.ArrayList.readObject (ArrayList.java:899)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:64)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:564)
    at java.io.ObjectStreamClass.invokeReadObject (ObjectStreamClass.java:1226)
    at java.io.ObjectInputStream.readSerialData (ObjectInputStream.java:2401)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2235)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:519)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:477)
    at java.util.HashMap.readObject (HashMap.java:1551)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:64)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:564)
    at java.io.ObjectStreamClass.invokeReadObject (ObjectStreamClass.java:1226)
    at java.io.ObjectInputStream.readSerialData (ObjectInputStream.java:2401)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2235)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java:2540)
    at java.io.ObjectInputStream.readSerialData (ObjectInputStream.java:2434)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2235)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:519)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:477)
    at com.hazelcast.internal.serialization.impl.defaultserializers.JavaDefaultSerializers$JavaSerializer.read (JavaDefaultSerializers.java:83)
    at com.hazelcast.internal.serialization.impl.defaultserializers.JavaDefaultSerializers$JavaSerializer.read (JavaDefaultSerializers.java:76)
    at com.hazelcast.internal.serialization.impl.StreamSerializerAdapter.read (StreamSerializerAdapter.java:44)
    at com.hazelcast.internal.serialization.impl.AbstractSerializationService.toObject (AbstractSerializationService.java:205)
    at com.hazelcast.jet.impl.execution.init.CustomClassLoadedObject.deserializeWithCustomClassLoader (CustomClassLoadedObject.java:66)
    at com.hazelcast.jet.impl.JobCoordinationService.deserializeJobDefinition (JobCoordinationService.java:876)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitJob$1 (JobCoordinationService.java:208)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$46 (JobCoordinationService.java:1039)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$47 (JobCoordinationService.java:1060)
    at com.hazelcast.internal.util.executor.CompletableFutureTask.run (CompletableFutureTask.java:64)
    at com.hazelcast.internal.util.executor.CachedExecutorServiceDelegate$Worker.run (CachedExecutorServiceDelegate.java:217)
    at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1130)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:630)
    at java.lang.Thread.run (Thread.java:832)
    at com.hazelcast.internal.util.executor.HazelcastManagedThread.executeRun (HazelcastManagedThread.java:76)
    at com.hazelcast.internal.util.executor.HazelcastManagedThread.run (HazelcastManagedThread.java:102)
Caused by: java.lang.reflect.InvocationTargetException
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:64)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:564)
    at java.lang.invoke.SerializedLambda.readResolve (SerializedLambda.java:242)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:64)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:564)
    at java.io.ObjectStreamClass.invokeReadResolve (ObjectStreamClass.java:1316)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2244)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java:2540)
    at java.io.ObjectInputStream.readSerialData (ObjectInputStream.java:2434)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2235)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:519)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:477)
    at java.util.ArrayList.readObject (ArrayList.java:899)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:64)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:564)
    at java.io.ObjectStreamClass.invokeReadObject (ObjectStreamClass.java:1226)
    at java.io.ObjectInputStream.readSerialData (ObjectInputStream.java:2401)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2235)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:519)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:477)
    at java.util.HashMap.readObject (HashMap.java:1551)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:64)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:564)
    at java.io.ObjectStreamClass.invokeReadObject (ObjectStreamClass.java:1226)
    at java.io.ObjectInputStream.readSerialData (ObjectInputStream.java:2401)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2235)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java:2540)
    at java.io.ObjectInputStream.readSerialData (ObjectInputStream.java:2434)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2235)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:519)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:477)
    at com.hazelcast.internal.serialization.impl.defaultserializers.JavaDefaultSerializers$JavaSerializer.read (JavaDefaultSerializers.java:83)
    at com.hazelcast.internal.serialization.impl.defaultserializers.JavaDefaultSerializers$JavaSerializer.read (JavaDefaultSerializers.java:76)
    at com.hazelcast.internal.serialization.impl.StreamSerializerAdapter.read (StreamSerializerAdapter.java:44)
    at com.hazelcast.internal.serialization.impl.AbstractSerializationService.toObject (AbstractSerializationService.java:205)
    at com.hazelcast.jet.impl.execution.init.CustomClassLoadedObject.deserializeWithCustomClassLoader (CustomClassLoadedObject.java:66)
    at com.hazelcast.jet.impl.JobCoordinationService.deserializeJobDefinition (JobCoordinationService.java:876)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitJob$1 (JobCoordinationService.java:208)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$46 (JobCoordinationService.java:1039)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$47 (JobCoordinationService.java:1060)
    at com.hazelcast.internal.util.executor.CompletableFutureTask.run (CompletableFutureTask.java:64)
    at com.hazelcast.internal.util.executor.CachedExecutorServiceDelegate$Worker.run (CachedExecutorServiceDelegate.java:217)
    at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1130)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:630)
    at java.lang.Thread.run (Thread.java:832)
    at com.hazelcast.internal.util.executor.HazelcastManagedThread.executeRun (HazelcastManagedThread.java:76)
    at com.hazelcast.internal.util.executor.HazelcastManagedThread.run (HazelcastManagedThread.java:102)
Caused by: java.lang.IllegalArgumentException: Invalid lambda deserialization
    at InProcessClassification.$deserializeLambda$ (InProcessClassification.java:1)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:64)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:564)
    at java.lang.invoke.SerializedLambda.readResolve (SerializedLambda.java:242)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:64)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:564)
    at java.io.ObjectStreamClass.invokeReadResolve (ObjectStreamClass.java:1316)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2244)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java:2540)
    at java.io.ObjectInputStream.readSerialData (ObjectInputStream.java:2434)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2235)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:519)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:477)
    at java.util.ArrayList.readObject (ArrayList.java:899)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:64)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:564)
    at java.io.ObjectStreamClass.invokeReadObject (ObjectStreamClass.java:1226)
    at java.io.ObjectInputStream.readSerialData (ObjectInputStream.java:2401)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2235)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:519)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:477)
    at java.util.HashMap.readObject (HashMap.java:1551)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at jdk.internal.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:64)
    at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:564)
    at java.io.ObjectStreamClass.invokeReadObject (ObjectStreamClass.java:1226)
    at java.io.ObjectInputStream.readSerialData (ObjectInputStream.java:2401)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2235)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.defaultReadFields (ObjectInputStream.java:2540)
    at java.io.ObjectInputStream.readSerialData (ObjectInputStream.java:2434)
    at java.io.ObjectInputStream.readOrdinaryObject (ObjectInputStream.java:2235)
    at java.io.ObjectInputStream.readObject0 (ObjectInputStream.java:1712)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:519)
    at java.io.ObjectInputStream.readObject (ObjectInputStream.java:477)
    at com.hazelcast.internal.serialization.impl.defaultserializers.JavaDefaultSerializers$JavaSerializer.read (JavaDefaultSerializers.java:83)
    at com.hazelcast.internal.serialization.impl.defaultserializers.JavaDefaultSerializers$JavaSerializer.read (JavaDefaultSerializers.java:76)
    at com.hazelcast.internal.serialization.impl.StreamSerializerAdapter.read (StreamSerializerAdapter.java:44)
    at com.hazelcast.internal.serialization.impl.AbstractSerializationService.toObject (AbstractSerializationService.java:205)
    at com.hazelcast.jet.impl.execution.init.CustomClassLoadedObject.deserializeWithCustomClassLoader (CustomClassLoadedObject.java:66)
    at com.hazelcast.jet.impl.JobCoordinationService.deserializeJobDefinition (JobCoordinationService.java:876)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitJob$1 (JobCoordinationService.java:208)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$46 (JobCoordinationService.java:1039)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitToCoordinatorThread$47 (JobCoordinationService.java:1060)
    at com.hazelcast.internal.util.executor.CompletableFutureTask.run (CompletableFutureTask.java:64)
    at com.hazelcast.internal.util.executor.CachedExecutorServiceDelegate$Worker.run (CachedExecutorServiceDelegate.java:217)
    at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1130)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:630)
    at java.lang.Thread.run (Thread.java:832)
    at com.hazelcast.internal.util.executor.HazelcastManagedThread.executeRun (HazelcastManagedThread.java:76)
    at com.hazelcast.internal.util.executor.HazelcastManagedThread.run (HazelcastManagedThread.java:102)

Replace Kafka with IMap in Churn Prediction

Kafka is used for request ingestion. It should be replaced with IMap with Event journal to reduce the number of moving parts.

model training and prediction

Assume a deep learning model is built using google tensorflow for image classification. For prediction gpu is required. How can Hazelcast JET be used for real time image classification? Model runs on gpu address memory space while Hazelcast JET in-memory works on normal CPU RAM?

image recognition fails to run

mvn exec:java

[hz._hzInstance_1_jet.async.thread-3] WARN com.hazelcast.jet.impl.MasterContext - [172.18.0.1]:5701 [jet] [0.6-SNAPSHOT] Execution of job 52f2-7c29-757c-ecbb, execution 1d40-0a57-86ec-cced failed in 350 ms
java.lang.RuntimeException: Unknown type.  Value = 0x73726576
	at deepboof.io.torch7.TorchType.valueToType(TorchType.java:54)
	at deepboof.io.torch7.ParseBinaryTorch7.readType(ParseBinaryTorch7.java:59)
	at deepboof.io.torch7.ParseTorch7.parseNext(ParseTorch7.java:79)
	at deepboof.io.torch7.ParseTorch7.parse(ParseTorch7.java:68)
	at deepboof.io.torch7.ParseTorch7.parseOne(ParseTorch7.java:44)
	at deepboof.io.torch7.ParseTorch7.parseIntoBoof(ParseTorch7.java:51)
	at boofcv.deepboof.ImageClassifierVggCifar10.loadModel(ImageClassifierVggCifar10.java:77)
	at ClassifierProcessor.init(ClassifierProcessor.java:48)
	at com.hazelcast.jet.core.AbstractProcessor.init(AbstractProcessor.java:98)
	at com.hazelcast.jet.impl.execution.ProcessorTasklet.init(ProcessorTasklet.java:129)
	at com.hazelcast.jet.impl.execution.TaskletExecutionService.submitCooperativeTasklets(TaskletExecutionService.java:136)
	at com.hazelcast.jet.impl.execution.TaskletExecutionService.beginExecute(TaskletExecutionService.java:95)
	at com.hazelcast.jet.impl.execution.ExecutionContext.beginExecution(ExecutionContext.java:124)
	at com.hazelcast.jet.impl.operation.StartExecutionOperation.doRun(StartExecutionOperation.java:49)
	at com.hazelcast.jet.impl.operation.AsyncOperation.run(AsyncOperation.java:45)
	at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:194)
	at com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl.run(OperationExecutorImpl.java:406)
	at com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl.runOrExecute(OperationExecutorImpl.java:433)
	at com.hazelcast.spi.impl.operationservice.impl.Invocation.doInvokeLocal(Invocation.java:569)
	at com.hazelcast.spi.impl.operationservice.impl.Invocation.doInvoke(Invocation.java:554)
	at com.hazelcast.spi.impl.operationservice.impl.Invocation.invoke0(Invocation.java:513)
	at com.hazelcast.spi.impl.operationservice.impl.Invocation.invoke(Invocation.java:207)
	at com.hazelcast.spi.impl.operationservice.impl.InvocationBuilderImpl.invoke(InvocationBuilderImpl.java:60)
	at com.hazelcast.jet.impl.MasterContext.invokeOnParticipants(MasterContext.java:628)
	at com.hazelcast.jet.impl.MasterContext.invoke(MasterContext.java:589)
	at com.hazelcast.jet.impl.MasterContext.invokeStartExecution(MasterContext.java:401)
	at com.hazelcast.jet.impl.MasterContext.onInitStepCompleted(MasterContext.java:319)
	at com.hazelcast.jet.impl.MasterContext.lambda$invoke$19(MasterContext.java:606)
	at com.hazelcast.jet.impl.util.ExceptionUtil.lambda$withTryCatch$0(ExceptionUtil.java:134)
	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760)
	at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:778)
	at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2140)
	at com.hazelcast.jet.impl.MasterContext.invoke(MasterContext.java:592)
	at com.hazelcast.jet.impl.MasterContext.tryStartJob(MasterContext.java:211)
	at com.hazelcast.jet.impl.JobCoordinationService.tryStartJob(JobCoordinationService.java:267)
	at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitOrJoinJob$1(JobCoordinationService.java:191)
	at com.hazelcast.util.executor.CachedExecutorServiceDelegate$Worker.run(CachedExecutorServiceDelegate.java:227)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:64)
	at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:80)
	at ------ submitted from ------.(Unknown Source)
	at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolve(InvocationFuture.java:127)
	at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolveAndThrowIfException(InvocationFuture.java:79)
	at com.hazelcast.spi.impl.AbstractInvocationFuture.get(AbstractInvocationFuture.java:147)
	at com.hazelcast.jet.impl.MasterContext.lambda$invoke$19(MasterContext.java:597)
	at com.hazelcast.jet.impl.util.ExceptionUtil.lambda$withTryCatch$0(ExceptionUtil.java:134)
	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760)
	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736)
	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1962)
	at com.hazelcast.jet.impl.MasterContext.lambda$invokeOnParticipants$21(MasterContext.java:625)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:64)
	at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:80)
	at ------ submitted from ------.(Unknown Source)
	at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolve(InvocationFuture.java:127)
	at com.hazelcast.spi.impl.AbstractInvocationFuture$1.run(AbstractInvocationFuture.java:243)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:64)
	at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:80)
[hz._hzInstance_1_jet.async.thread-2] ERROR com.hazelcast.jet.impl.operation.CancelExecutionOperation - [172.18.0.1]:5701 [jet] [0.6-SNAPSHOT] job 52f2-7c29-757c-ecbb, execution 1d40-0a57-86ec-cced not found for coordinator [172.18.0.1]:5701 for 'CancelExecutionOperation'
com.hazelcast.jet.core.TopologyChangedException: job 52f2-7c29-757c-ecbb, execution 1d40-0a57-86ec-cced not found for coordinator [172.18.0.1]:5701 for 'CancelExecutionOperation'
	at com.hazelcast.jet.impl.JobExecutionService.assertExecutionContext(JobExecutionService.java:263)
	at com.hazelcast.jet.impl.operation.CancelExecutionOperation.run(CancelExecutionOperation.java:58)
	at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:194)
	at com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl.run(OperationExecutorImpl.java:406)
	at com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl.runOrExecute(OperationExecutorImpl.java:433)
	at com.hazelcast.spi.impl.operationservice.impl.Invocation.doInvokeLocal(Invocation.java:569)
	at com.hazelcast.spi.impl.operationservice.impl.Invocation.doInvoke(Invocation.java:554)
	at com.hazelcast.spi.impl.operationservice.impl.Invocation.invoke0(Invocation.java:513)
	at com.hazelcast.spi.impl.operationservice.impl.Invocation.invoke(Invocation.java:207)
	at com.hazelcast.spi.impl.operationservice.impl.InvocationBuilderImpl.invoke(InvocationBuilderImpl.java:60)
	at com.hazelcast.jet.impl.MasterContext.invokeOnParticipants(MasterContext.java:628)
	at com.hazelcast.jet.impl.MasterContext.invoke(MasterContext.java:589)
	at com.hazelcast.jet.impl.MasterContext.lambda$cancelExecute$8(MasterContext.java:411)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:64)
	at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:80)
[WARNING] 
java.util.concurrent.ExecutionException: java.lang.RuntimeException: Unknown type.  Value = 0x73726576
    at java.util.concurrent.CompletableFuture.reportGet (CompletableFuture.java:357)
    at java.util.concurrent.CompletableFuture.get (CompletableFuture.java:1895)
    at com.hazelcast.jet.Job.lambda$join$0 (Job.java:95)
    at com.hazelcast.jet.impl.util.Util.uncheckRun (Util.java:98)
    at com.hazelcast.jet.Job.join (Job.java:95)
    at RealtimeImageRecognition.main (RealtimeImageRecognition.java:47)
    at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke (Method.java:498)
    at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:282)
    at java.lang.Thread.run (Thread.java:748)
Caused by: java.lang.RuntimeException: Unknown type.  Value = 0x73726576
    at deepboof.io.torch7.TorchType.valueToType (TorchType.java:54)
    at deepboof.io.torch7.ParseBinaryTorch7.readType (ParseBinaryTorch7.java:59)
    at deepboof.io.torch7.ParseTorch7.parseNext (ParseTorch7.java:79)
    at deepboof.io.torch7.ParseTorch7.parse (ParseTorch7.java:68)
    at deepboof.io.torch7.ParseTorch7.parseOne (ParseTorch7.java:44)
    at deepboof.io.torch7.ParseTorch7.parseIntoBoof (ParseTorch7.java:51)
    at boofcv.deepboof.ImageClassifierVggCifar10.loadModel (ImageClassifierVggCifar10.java:77)
    at ClassifierProcessor.init (ClassifierProcessor.java:48)
    at com.hazelcast.jet.core.AbstractProcessor.init (AbstractProcessor.java:98)
    at com.hazelcast.jet.impl.execution.ProcessorTasklet.init (ProcessorTasklet.java:129)
    at com.hazelcast.jet.impl.execution.TaskletExecutionService.submitCooperativeTasklets (TaskletExecutionService.java:136)
    at com.hazelcast.jet.impl.execution.TaskletExecutionService.beginExecute (TaskletExecutionService.java:95)
    at com.hazelcast.jet.impl.execution.ExecutionContext.beginExecution (ExecutionContext.java:124)
    at com.hazelcast.jet.impl.operation.StartExecutionOperation.doRun (StartExecutionOperation.java:49)
    at com.hazelcast.jet.impl.operation.AsyncOperation.run (AsyncOperation.java:45)
    at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run (OperationRunnerImpl.java:194)
    at com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl.run (OperationExecutorImpl.java:406)
    at com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl.runOrExecute (OperationExecutorImpl.java:433)
    at com.hazelcast.spi.impl.operationservice.impl.Invocation.doInvokeLocal (Invocation.java:569)
    at com.hazelcast.spi.impl.operationservice.impl.Invocation.doInvoke (Invocation.java:554)
    at com.hazelcast.spi.impl.operationservice.impl.Invocation.invoke0 (Invocation.java:513)
    at com.hazelcast.spi.impl.operationservice.impl.Invocation.invoke (Invocation.java:207)
    at com.hazelcast.spi.impl.operationservice.impl.InvocationBuilderImpl.invoke (InvocationBuilderImpl.java:60)
    at com.hazelcast.jet.impl.MasterContext.invokeOnParticipants (MasterContext.java:628)
    at com.hazelcast.jet.impl.MasterContext.invoke (MasterContext.java:589)
    at com.hazelcast.jet.impl.MasterContext.invokeStartExecution (MasterContext.java:401)
    at com.hazelcast.jet.impl.MasterContext.onInitStepCompleted (MasterContext.java:319)
    at com.hazelcast.jet.impl.MasterContext.lambda$invoke$19 (MasterContext.java:606)
    at com.hazelcast.jet.impl.util.ExceptionUtil.lambda$withTryCatch$0 (ExceptionUtil.java:134)
    at java.util.concurrent.CompletableFuture.uniWhenComplete (CompletableFuture.java:760)
    at java.util.concurrent.CompletableFuture.uniWhenCompleteStage (CompletableFuture.java:778)
    at java.util.concurrent.CompletableFuture.whenComplete (CompletableFuture.java:2140)
    at com.hazelcast.jet.impl.MasterContext.invoke (MasterContext.java:592)
    at com.hazelcast.jet.impl.MasterContext.tryStartJob (MasterContext.java:211)
    at com.hazelcast.jet.impl.JobCoordinationService.tryStartJob (JobCoordinationService.java:267)
    at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitOrJoinJob$1 (JobCoordinationService.java:191)
    at com.hazelcast.util.executor.CachedExecutorServiceDelegate$Worker.run (CachedExecutorServiceDelegate.java:227)
    at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:624)
    at java.lang.Thread.run (Thread.java:748)
    at com.hazelcast.util.executor.HazelcastManagedThread.executeRun (HazelcastManagedThread.java:64)
    at com.hazelcast.util.executor.HazelcastManagedThread.run (HazelcastManagedThread.java:80)
    at ------ submitted from ------. (Unknown Source)
    at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolve (InvocationFuture.java:127)
    at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolveAndThrowIfException (InvocationFuture.java:79)
    at com.hazelcast.spi.impl.AbstractInvocationFuture.get (AbstractInvocationFuture.java:147)
    at com.hazelcast.jet.impl.MasterContext.lambda$invoke$19 (MasterContext.java:597)
    at com.hazelcast.jet.impl.util.ExceptionUtil.lambda$withTryCatch$0 (ExceptionUtil.java:134)
    at java.util.concurrent.CompletableFuture.uniWhenComplete (CompletableFuture.java:760)
    at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire (CompletableFuture.java:736)
    at java.util.concurrent.CompletableFuture.postComplete (CompletableFuture.java:474)
    at java.util.concurrent.CompletableFuture.complete (CompletableFuture.java:1962)
    at com.hazelcast.jet.impl.MasterContext.lambda$invokeOnParticipants$21 (MasterContext.java:625)
    at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:624)
    at java.lang.Thread.run (Thread.java:748)
    at com.hazelcast.util.executor.HazelcastManagedThread.executeRun (HazelcastManagedThread.java:64)
    at com.hazelcast.util.executor.HazelcastManagedThread.run (HazelcastManagedThread.java:80)
    at ------ submitted from ------. (Unknown Source)
    at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolve (InvocationFuture.java:127)
    at com.hazelcast.spi.impl.AbstractInvocationFuture$1.run (AbstractInvocationFuture.java:243)
    at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:624)
    at java.lang.Thread.run (Thread.java:748)
    at com.hazelcast.util.executor.HazelcastManagedThread.executeRun (HazelcastManagedThread.java:64)
    at com.hazelcast.util.executor.HazelcastManagedThread.run (HazelcastManagedThread.java:80)
    at ------ submitted from ------. (Unknown Source)
    at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolve (InvocationFuture.java:127)
    at com.hazelcast.spi.impl.AbstractInvocationFuture$1.run (AbstractInvocationFuture.java:243)
    at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:624)
    at java.lang.Thread.run (Thread.java:748)
    at com.hazelcast.util.executor.HazelcastManagedThread.executeRun (HazelcastManagedThread.java:64)
    at com.hazelcast.util.executor.HazelcastManagedThread.run (HazelcastManagedThread.java:80)

when did you last check your codes?

when did you last check your codes? your almost all project has many many bugs and not working. it looks also so amateur codes. to find main class sometimes so difficult. and most of your demo project is not working. your datasource has different format then your parsing. if possible, please check your codes. many many many bugs and there is almost no any working project.

market-data-analyzer

Which Directory?
What about putting the scripts in the root directory of the main module. Your instructions for running Hazelcast need you be there, yet the scripts require you to be in src/main/scripts.

Or, build a target and have everything in a bin directory.

flight telemetry example: ADS-B, not ADB-S

In the whole flight telemetry example, you say "ADB-S". But it is called ADS-B.

Cryptocurrency realtime trend isn't producing any output

When I run this demo following the instructions in a readme, there is no output printed:

58:47,300 StartExecutionOperation [127.0.0.1]:5701 [dev] [0.6-SNAPSHOT] Start execution of job 107c-304c-868d-b40f, execution d241-e541-58ea-f935 from coordinator [127.0.0.1]:5701
/------+---------------+---------------+----------------\
|      |          Sentiment (tweet count)               |
| Coin | Last 30 sec   | Last minute   | Last 5 minutes |
|------+---------------+---------------+----------------|
\------+---------------+---------------+----------------/
/------+---------------+---------------+----------------\
|      |          Sentiment (tweet count)               |
| Coin | Last 30 sec   | Last minute   | Last 5 minutes |
|------+---------------+---------------+----------------|
\------+---------------+---------------+----------------/
/------+---------------+---------------+----------------\
|      |          Sentiment (tweet count)               |
| Coin | Last 30 sec   | Last minute   | Last 5 minutes |
|------+---------------+---------------+----------------|
\------+---------------+---------------+----------------/
/------+---------------+---------------+----------------\
|      |          Sentiment (tweet count)               |
| Coin | Last 30 sec   | Last minute   | Last 5 minutes |
|------+---------------+---------------+----------------|
\------+---------------+---------------+----------------/
/------+---------------+---------------+----------------\
|      |          Sentiment (tweet count)               |
| Coin | Last 30 sec   | Last minute   | Last 5 minutes |
|------+---------------+---------------+----------------|
\------+---------------+---------------+----------------/

Image recognition demo may not be able to use CIFAR

See http://groups.csail.mit.edu/vision/TinyImages/

It may need https://github.com/hazelcast/hazelcast-jet-demos/tree/master/realtime-image-recognition to use a different provider

Requires Jet Snapshots

These demos seem to depend on Jet snapshots. We should either only rely on released versions so builds can pick up from maven central or we should put our cloudbees snapshot repos in the maven repositories.

At present a user needs to clone and install jet to their local maven to make these build.

Minor version mismatch

Jet demos has

    <groupId>com.hazelcast.jet.demos</groupId>
    <artifactId>hazelcast-jet-demos</artifactId>
    <version>3.1</version>

but

 <hazelcast-jet.version>3.2</hazelcast-jet.version>

All the poms should be project version 3.2 to match the Jet version

Please do not override the ADSBx checks for the data stream.

Please see https://adsbexchange.com/data/

You endangering ADSBx project and infrastructure by forcibly working around the protections in place.

This is unacceptable.

ADSBX

crytocurrency readme needs to show how to obtain a twitter token

Not everyone will know about twitter tokens to gain access to the twitter API.

We need to put a section in the readme with links and a description of how to obtain this.

Cryptocurrency demo should fail fast if no twitter/reddit credentials supplied

User needs to provide their own twitter and reddit login details.

If left with the defaults in the properties files the following confusing error is produced...

Exception in thread "hz._hzInstance_1_dev.cached.thread-2" java.lang.IllegalArgumentException: Output ordinals for vertex aggregateTrend15Min are not ordered. Actual: [1] Expected: [0]
	at com.hazelcast.jet.core.DAG.validateOutboundEdgeOrdinals(DAG.java:279)
	at com.hazelcast.jet.core.DAG.validate(DAG.java:244)
	at com.hazelcast.jet.core.DAG.iterator(DAG.java:215)
	at com.hazelcast.jet.impl.MasterContext.tryStartJob(MasterContext.java:171)
	at com.hazelcast.jet.impl.JobCoordinationService.tryStartJob(JobCoordinationService.java:267)
	at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitOrJoinJob$1(JobCoordinationService.java:191)
	at com.hazelcast.util.executor.CachedExecutorServiceDelegate$Worker.run(CachedExecutorServiceDelegate.java:227)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:64)
	at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:80)

Repo needs large file support

The Git repo fails to download cleanly, complaining about LFS

$ git clone https://github.com/hazelcast/hazelcast-jet-demos.git
Cloning into 'hazelcast-jet-demos'...
remote: Counting objects: 365, done.
remote: Compressing objects: 100% (40/40), done.
remote: Total 365 (delta 31), reused 54 (delta 19), pack-reused 291
Receiving objects: 100% (365/365), 38.33 MiB | 874.00 KiB/s, done.
Resolving deltas: 100% (64/64), done.
git-lfs smudge 'realtime-image-recognition/likevgg_cifar10/model.net': git-lfs: command not found
error: external filter git-lfs smudge %f failed -1
error: external filter git-lfs smudge %f failed
fatal: realtime-image-recognition/likevgg_cifar10/model.net: smudge filter lfs failed
warning: Clone succeeded, but checkout failed.
You can inspect what was checked out with 'git status'
and retry the checkout with 'git checkout -f HEAD'

$ 

This is going to dissuade people from using, it should install and work straight away

NullPointerException on "realtime-image-recognition"

The realtime-image-recognition demo gives an NPE

[hz._hzInstance_1_jet.jet.blocking.thread-0] WARN com.hazelcast.jet.impl.execution.TaskletExecutionService - [127.0.0.1]:5701 [jet] [3.2] Exception in ProcessorTasklet{webcam#0}
java.lang.NullPointerException
	at boofcv.io.webcamcapture.UtilWebcamCapture.adjustResolution(UtilWebcamCapture.java:88)
	at boofcv.io.webcamcapture.UtilWebcamCapture.openDefault(UtilWebcamCapture.java:42)
	at WebcamSource.<init>(WebcamSource.java:41)
	at WebcamSource.lambda$webcam$2b1177f1$1(WebcamSource.java:59)
	at com.hazelcast.jet.function.FunctionEx.apply(FunctionEx.java:43)
	at com.hazelcast.jet.impl.connector.ConvenientSourceP.init(ConvenientSourceP.java:106)
	at com.hazelcast.jet.core.AbstractProcessor.init(AbstractProcessor.java:83)
	at com.hazelcast.jet.impl.execution.ProcessorTasklet.init(ProcessorTasklet.java:231)
	at com.hazelcast.jet.impl.execution.TaskletExecutionService$BlockingWorker.run(TaskletExecutionService.java:255)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
[hz._hzInstance_1_jet.cached.thread-3] ERROR com.hazelcast.jet.impl.MasterJobContext - [127.0.0.1]:5701 [jet] [3.2] Execution of job '0365-7398-bac0-0001', execution 0365-7398-bac1-0001 failed after 1,796 ms
com.hazelcast.jet.JetException: Exception in ProcessorTasklet{webcam#0}: java.lang.NullPointerException
	at com.hazelcast.jet.impl.execution.TaskletExecutionService$BlockingWorker.run(TaskletExecutionService.java:270)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	at ------ submitted from ------.(Unknown Source)
	at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolve(InvocationFuture.java:126)
	at com.hazelcast.spi.impl.AbstractInvocationFuture$1.run(AbstractInvocationFuture.java:251)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
	at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:64)
	at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:80)
Caused by: java.lang.NullPointerException
	at boofcv.io.webcamcapture.UtilWebcamCapture.adjustResolution(UtilWebcamCapture.java:88)
	at boofcv.io.webcamcapture.UtilWebcamCapture.openDefault(UtilWebcamCapture.java:42)
	at WebcamSource.<init>(WebcamSource.java:41)
	at WebcamSource.lambda$webcam$2b1177f1$1(WebcamSource.java:59)
	at com.hazelcast.jet.function.FunctionEx.apply(FunctionEx.java:43)
	at com.hazelcast.jet.impl.connector.ConvenientSourceP.init(ConvenientSourceP.java:106)
	at com.hazelcast.jet.core.AbstractProcessor.init(AbstractProcessor.java:83)
	at com.hazelcast.jet.impl.execution.ProcessorTasklet.init(ProcessorTasklet.java:231)
	at com.hazelcast.jet.impl.execution.TaskletExecutionService$BlockingWorker.run(TaskletExecutionService.java:255)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

Steps taken

git clone https://github.com/hazelcast/hazelcast-jet-demos 
cd hazelcast-jet-demos/realtime-image-recognition
mvn install
mvn exec:java

Environment

$ java -version
openjdk version "1.8.0_232"
OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09)
OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode)

&

$ sw_vers
ProductName:	Mac OS X
ProductVersion:	10.15.1
BuildVersion:	19B88

I get the same on OpenJDK 11, and if I change the boofcv dependency to latest (0.34).

I suspect this is related to Catalina.
System Properties doesn't show anything as having requested Camera access.

If this is a Catalina issue, the code should check the O/S prior to starting the job

debezium-cdc-without-kafka fails on 4.4

Works on 4.3, on 4.4 gives

hazelcast-jet_1         | Caused by: java.lang.ClassNotFoundException: com.hazelcast.jet.contrib.debezium.HazelcastListDatabaseHistory
hazelcast-jet_1         | 	at jdk.internal.loader.BuiltinClassLoader.loadClass(Unknown Source) ~[?:?]
hazelcast-jet_1         | 	at jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(Unknown Source) ~[?:?]
hazelcast-jet_1         | 	at java.lang.ClassLoader.loadClass(Unknown Source) ~[?:?]
hazelcast-jet_1         | 	at io.debezium.config.Instantiator.getInstanceWithProvidedConstructorType(Instantiator.java:50) ~[hazelcast-jet-cdc-debezium-4.4.jar:?]
hazelcast-jet_1         | 	at io.debezium.config.Instantiator.getInstance(Instantiator.java:28) ~[hazelcast-jet-cdc-debezium-4.4.jar:?]
hazelcast-jet_1         | 	at io.debezium.config.Configuration.getInstance(Configuration.java:1463) ~[hazelcast-jet-cdc-debezium-4.4.jar:?]
hazelcast-jet_1         | 	at io.debezium.config.Configuration.getInstance(Configuration.java:1449) ~[hazelcast-jet-cdc-debezium-4.4.jar:?]
hazelcast-jet_1         | 	at io.debezium.connector.mysql.MySqlSchema.<init>(MySqlSchema.java:126) ~[hazelcast-jet-cdc-mysql-4.4.jar:?]
hazelcast-jet_1         | 	at io.debezium.connector.mysql.MySqlTaskContext.<init>(MySqlTaskContext.java:86) ~[hazelcast-jet-cdc-mysql-4.4.jar:?]
hazelcast-jet_1         | 	at io.debezium.connector.mysql.MySqlTaskContext.<init>(MySqlTaskContext.java:52) ~[hazelcast-jet-cdc-mysql-4.4.jar:?]
hazelcast-jet_1         | 	at io.debezium.connector.mysql.MySqlConnectorTask.createAndStartTaskContext(MySqlConnectorTask.java:357) ~[hazelcast-jet-cdc-mysql-4.4.jar:?]
hazelcast-jet_1         | 	at io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:143) ~[hazelcast-jet-cdc-mysql-4.4.jar:?]
hazelcast-jet_1         | 	at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:101) ~[hazelcast-jet-cdc-debezium-4.4.jar:?]
hazelcast-jet_1         | 	at com.hazelcast.jet.contrib.connect.KafkaConnectSources$Context.fillBuffer(KafkaConnectSources.java:133) ~[?:?]
hazelcast-jet_1         | 	at com.hazelcast.function.BiConsumerEx.accept(BiConsumerEx.java:47) ~[hazelcast-jet-4.4.jar:4.4]
hazelcast-jet_1         | 	at com.hazelcast.jet.impl.connector.ConvenientSourceP.complete(ConvenientSourceP.java:117) ~[hazelcast-jet-4.4.jar:4.4]
hazelcast-jet_1         | 	at com.hazelcast.jet.impl.execution.ProcessorTasklet.complete(ProcessorTasklet.java:472) ~[hazelcast-jet-4.4.jar:4.4]
hazelcast-jet_1         | 	at com.hazelcast.jet.impl.execution.ProcessorTasklet.stateMachineStep(ProcessorTasklet.java:372) ~[hazelcast-jet-4.4.jar:4.4]
hazelcast-jet_1         | 	at com.hazelcast.jet.impl.execution.ProcessorTasklet.call(ProcessorTasklet.java:247) ~[hazelcast-jet-4.4.jar:4.4]
hazelcast-jet_1         | 	at com.hazelcast.jet.impl.execution.TaskletExecutionService$BlockingWorker.run(TaskletExecutionService.java:293) ~[hazelcast-jet-4.4.jar:4.4]
hazelcast-jet_1         | 	... 5 more

customer churn predictor : kafka install

Would be better if we give instructions and have the demo work with a docker image for kafka rather than making people download it onto their systems.

All demos should be run using same maven commands

All demos should be run using:

mvn clean package
mvn java:exec

jetleopard relies on a released version of betleopard

We might need to provide a repo for betleopad releases....

building the jet-demos project on a clean machine gives the following....

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] cryptocurrency-realtime-trend ...................... SUCCESS [05:39 min]
[INFO] demos .............................................. SUCCESS [  0.026 s]
[INFO] ADB-S Flight Telemetry Stream Processing Demo ...... SUCCESS [ 20.955 s]
[INFO] Real-time Image Recognition Demo ................... SUCCESS [ 52.529 s]
[INFO] jetleopard ......................................... FAILURE [  3.985 s]
[INFO] markov-chain-generator ............................. SKIPPED
[INFO] online-training-traffic-predictor .................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 06:57 min
[INFO] Finished at: 2018-01-29T15:31:39Z
[INFO] Final Memory: 65M/466M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project jetleopard: Could not resolve dependencies for project com:jetleopard:jar:1.0.0-SNAPSHOT: Could not find artifact com:betleopard:jar:1.1.0 in central (https://repo.maven.apache.org/maven2) -> [Help 1]

Markov Chain

The final output needs to be formatted with CR between the sentences. It's one really hard to read block right now.

Also could we have a little more description around how the sentences are created, is each word the highest probability link from the last?

Visualize output on JetCoinTrend

Add Grafana charts via Graphite sink to visualize coin trends

flight-telemetry : ClassCastException

I followed the set-up instructions in the Readme and running the application I get the following....

49:25,663 [172.19.0.1]:5702 [jet] [0.6-SNAPSHOT] Exception in ProcessorTasklet{vertex=addVerticalDirection, processor=com.hazelcast.jet.impl.processor.TransformP@78e38ade}
java.lang.ClassCastException: com.hazelcast.jet.datamodel.Tuple2 cannot be cast to java.util.List
	at com.hazelcast.jet.demo.Demo.assignDirection(Demo.java:286)
	at com.hazelcast.jet.core.processor.Processors.lambda$null$a61c02b4$1(Processors.java:673)
	at com.hazelcast.jet.core.AbstractProcessor$FlatMapper.tryProcess(AbstractProcessor.java:585)
	at com.hazelcast.jet.impl.processor.TransformP.tryProcess(TransformP.java:44)
	at com.hazelcast.jet.core.AbstractProcessor.tryProcess0(AbstractProcessor.java:205)
	at com.hazelcast.jet.core.AbstractProcessor.process0(AbstractProcessor.java:613)
	at com.hazelcast.jet.core.AbstractProcessor.process(AbstractProcessor.java:127)
	at com.hazelcast.jet.impl.execution.ProcessorTasklet.stateMachineStep(ProcessorTasklet.java:183)
	at com.hazelcast.jet.impl.execution.ProcessorTasklet.stateMachineStep(ProcessorTasklet.java:154)
	at com.hazelcast.jet.impl.execution.ProcessorTasklet.call(ProcessorTasklet.java:141)
	at com.hazelcast.jet.impl.execution.ProcessorTasklet.call(ProcessorTasklet.java:134)
	at com.hazelcast.jet.impl.execution.TaskletExecutionService$CooperativeWorker.run(TaskletExecutionService.java:230)
	at java.lang.Thread.run(Thread.java:748)
49:25,668 [172.19.0.1]:5702 [jet] [0.6-SNAPSHOT] Exception in ProcessorTasklet{vertex=addVerticalDirection, processor=com.hazelcast.jet.impl.processor.TransformP@627cd94b}
java.lang.ClassCastException: com.hazelcast.jet.datamodel.Tuple2 cannot be cast to java.util.List
	at com.hazelcast.jet.demo.Demo.assignDirection(Demo.java:286)
	at com.hazelcast.jet.core.processor.Processors.lambda$null$a61c02b4$1(Processors.java:673)
	at com.hazelcast.jet.core.AbstractProcessor$FlatMapper.tryProcess(AbstractProcessor.java:585)
	at com.hazelcast.jet.impl.processor.TransformP.tryProcess(TransformP.java:44)
	at com.hazelcast.jet.core.AbstractProcessor.tryProcess0(AbstractProcessor.java:205)
	at com.hazelcast.jet.core.AbstractProcessor.process0(AbstractProcessor.java:613)
	at com.hazelcast.jet.core.AbstractProcessor.process(AbstractProcessor.java:127)
	at com.hazelcast.jet.impl.execution.ProcessorTasklet.stateMachineStep(ProcessorTasklet.java:183)
	at com.hazelcast.jet.impl.execution.ProcessorTasklet.stateMachineStep(ProcessorTasklet.java:154)
	at com.hazelcast.jet.impl.execution.ProcessorTasklet.call(ProcessorTasklet.java:141)
	at com.hazelcast.jet.impl.execution.ProcessorTasklet.call(ProcessorTasklet.java:134)
	at com.hazelcast.jet.impl.execution.TaskletExecutionService$CooperativeWorker.run(TaskletExecutionService.java:230)
	at java.lang.Thread.run(Thread.java:748)

customer churn predictor : README

I have no idea what this application does, we need a few paragraphs explaining the use case.

OOME on RealtimeImageRecognition

3a, execution 4d00-9fdb-c59a-0ae2 initialized
[hz._hzInstance_1_jet.cached.thread-2] INFO com.hazelcast.jet.impl.operation.StartExecutionOperation - [192.168.43.157]:5701 [jet] [0.6-SNAPSHOT] Start execution of job 448b-ec68-4d6a-ad3a, execution 4d00-9fdb-c59a-0ae2 from coordinator [192.168.43.157]:5701
[hz._hzInstance_1_jet.cached.thread-2] ERROR com.hazelcast.jet.impl.MasterContext - [192.168.43.157]:5701 [jet] [0.6-SNAPSHOT] Exception during callback
java.lang.OutOfMemoryError: Java heap space
at deepboof.io.torch7.ParseBinaryTorch7.readArrayFloat(ParseBinaryTorch7.java:148)
at deepboof.io.torch7.ParseTorch7.parseStorage(ParseTorch7.java:243)
at deepboof.io.torch7.ParseTorch7.parseTorchObject(ParseTorch7.java:150)
at deepboof.io.torch7.ParseTorch7.parseNext(ParseTorch7.java:89)
at deepboof.io.torch7.ParseTorch7.parseTensor(ParseTorch7.java:217)
at deepboof.io.torch7.ParseTorch7.parseTorchObject(ParseTorch7.java:152)
at deepboof.io.torch7.ParseTorch7.parseNext(ParseTorch7.java:89)
at deepboof.io.torch7.ParseTorch7.parseTable(ParseTorch7.java:304)
at deepboof.io.torch7.ParseTorch7.parseNext(ParseTorch7.java:99)
at deepboof.io.torch7.ParseTorch7.parseTorchObject(ParseTorch7.java:163)
at deepboof.io.torch7.ParseTorch7.parseNext(ParseTorch7.java:89)
at deepboof.io.torch7.ParseTorch7.parseTable(ParseTorch7.java:304)
at deepboof.io.torch7.ParseTorch7.parseNext(ParseTorch7.java:99)
at deepboof.io.torch7.ParseTorch7.parseTable(ParseTorch7.java:304)
at deepboof.io.torch7.ParseTorch7.parseNext(ParseTorch7.java:99)
at deepboof.io.torch7.ParseTorch7.parseTorchObject(ParseTorch7.java:163)
at deepboof.io.torch7.ParseTorch7.parseNext(ParseTorch7.java:89)
at deepboof.io.torch7.ParseTorch7.parseTable(ParseTorch7.java:304)
at deepboof.io.torch7.ParseTorch7.parseNext(ParseTorch7.java:99)
at deepboof.io.torch7.ParseTorch7.parseTable(ParseTorch7.java:304)
at deepboof.io.torch7.ParseTorch7.parseNext(ParseTorch7.java:99)
at deepboof.io.torch7.ParseTorch7.parseTorchObject(ParseTorch7.java:163)
at deepboof.io.torch7.ParseTorch7.parseNext(ParseTorch7.java:89)
at deepboof.io.torch7.ParseTorch7.parse(ParseTorch7.java:68)
at deepboof.io.torch7.ParseTorch7.parseOne(ParseTorch7.java:44)
at deepboof.io.torch7.ParseTorch7.parseIntoBoof(ParseTorch7.java:51)
at boofcv.deepboof.ImageClassifierVggCifar10.loadModel(ImageClassifierVggCifar10.java:77)
at ClassifierProcessor.init(ClassifierProcessor.java:48)
at com.hazelcast.jet.core.AbstractProcessor.init(AbstractProcessor.java:98)
at com.hazelcast.jet.impl.execution.ProcessorTasklet.init(ProcessorTasklet.java:129)
at com.hazelcast.jet.impl.execution.TaskletExecutionService.submitCooperativeTasklets(TaskletExecutionService.java:136)
at com.hazelcast.jet.impl.execution.TaskletExecutionService.beginExecute(TaskletExecutionService.java:95)
at ------ submitted from ------.(Unknown Source)
at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolve(InvocationFuture.java:127)
at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolveAndThrowIfException(InvocationFuture.java:79)
at com.hazelcast.spi.impl.AbstractInvocationFuture.get(AbstractInvocationFuture.java:147)
at com.hazelcast.jet.impl.MasterContext.lambda$invoke$19(MasterContext.java:597)
at com.hazelcast.jet.impl.MasterContext$$Lambda$205/911616689.accept(Unknown Source)
at com.hazelcast.jet.impl.util.ExceptionUtil.lambda$withTryCatch$0(ExceptionUtil.java:134)
at com.hazelcast.jet.impl.util.ExceptionUtil$$Lambda$82/1051794848.accept(Unknown Source)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760)
at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:778)
at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2132)
at com.hazelcast.jet.impl.MasterContext.invoke(MasterContext.java:592)
at com.hazelcast.jet.impl.MasterContext.invokeStartExecution(MasterContext.java:401)
at com.hazelcast.jet.impl.MasterContext.onInitStepCompleted(MasterContext.java:319)
at com.hazelcast.jet.impl.MasterContext$$Lambda$147/1527681111.accept(Unknown Source)
at com.hazelcast.jet.impl.MasterContext.lambda$invoke$19(MasterContext.java:606)
at com.hazelcast.jet.impl.MasterContext$$Lambda$205/911616689.accept(Unknown Source)
at com.hazelcast.jet.impl.util.ExceptionUtil.lambda$withTryCatch$0(ExceptionUtil.java:134)
at com.hazelcast.jet.impl.util.ExceptionUtil$$Lambda$82/1051794848.accept(Unknown Source)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760)
at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:778)
at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2132)
at com.hazelcast.jet.impl.MasterContext.invoke(MasterContext.java:592)
at com.hazelcast.jet.impl.MasterContext.tryStartJob(MasterContext.java:211)
at com.hazelcast.jet.impl.JobCoordinationService.tryStartJob(JobCoordinationService.java:267)
at com.hazelcast.jet.impl.JobCoordinationService.lambda$submitOrJoinJob$1(JobCoordinationService.java:191)
at com.hazelcast.jet.impl.JobCoordinationService$$Lambda$74/1332738458.run(Unknown Source)
at com.hazelcast.util.executor.CachedExecutorServiceDelegate$Worker.run(CachedExecutorServiceDelegate.java:227)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:64)
at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:80)
[hz._hzInstance_1_jet.async.thread-5] ERROR com.hazelcast.jet.impl.execution.TaskletExecutionService - [192.168.43.157]:5701 [jet] [0.6-SNAPSHOT] Exception during callback
java.lang.NullPointerException
at com.hazelcast.jet.impl.execution.TaskletExecutionService$ExecutionTracker.lambda$new$1(TaskletExecutionService.java:337)
at com.hazelcast.jet.impl.execution.TaskletExecutionService$ExecutionTracker$$Lambda$214/132172009.accept(Unknown Source)
at com.hazelcast.jet.impl.util.ExceptionUtil.lambda$withTryCatch$0(ExceptionUtil.java:134)
at com.hazelcast.jet.impl.util.ExceptionUtil$$Lambda$82/1051794848.accept(Unknown Source)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
at java.util.concurrent.CompletableFuture.cancel(CompletableFuture.java:2257)
at com.hazelcast.jet.impl.execution.ExecutionContext.cancelExecution(ExecutionContext.java:156)
at com.hazelcast.jet.impl.operation.CancelExecutionOperation.run(CancelExecutionOperation.java:59)
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:194)
at com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl.run(OperationExecutorImpl.java:406)
at com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl.runOrExecute(OperationExecutorImpl.java:433)
at com.hazelcast.spi.impl.operationservice.impl.Invocation.doInvokeLocal(Invocation.java:569)
at com.hazelcast.spi.impl.operationservice.impl.Invocation.doInvoke(Invocation.java:554)
at com.hazelcast.spi.impl.operationservice.impl.Invocation.invoke0(Invocation.java:513)
at com.hazelcast.spi.impl.operationservice.impl.Invocation.invoke(Invocation.java:207)
at com.hazelcast.spi.impl.operationservice.impl.InvocationBuilderImpl.invoke(InvocationBuilderImpl.java:60)
at com.hazelcast.jet.impl.MasterContext.invokeOnParticipants(MasterContext.java:628)
at com.hazelcast.jet.impl.MasterContext.invoke(MasterContext.java:589)
at com.hazelcast.jet.impl.MasterContext.lambda$cancelExecute$8(MasterContext.java:411)
at com.hazelcast.jet.impl.MasterContext$$Lambda$223/1043673787.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at com.hazelcast.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:64)
at com.hazelcast.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:80)

Visualise output of Traffic Predictor

Visualise the predictions. Use a chart to show, how the predictions differ from the real measurements.

Demo(s) broken on 4.0-SNAPSHOT

hazelcast-jet-demos uses

<hazelcast-jet.version>4.0-SNAPSHOT</hazelcast-jet.version> 

Today the bitcoin-death-cross demo is broken, possibly others (haven't had time to test).

Building against SNAPSHOT is asking for trouble.

We should have unit tests on these demos, so at least build breaks and Jenkins shows it.

OOME on JetCoinTrend

16:53,828 [127.0.0.1]:5701 [dev] [0.6-SNAPSHOT] Resetting heartbeat timestamps because of huge system clock jump! Clock-Jump: 8181 ms, Heartbeat-Timeout: 5000 ms
----------------
30 Second Aggregations
----------------
----------------
1 Minute Aggregations
----------------
----------------
5 Minute Aggregations
----------------

17:24,135 [127.0.0.1]:5701 [dev] [0.6-SNAPSHOT] Exception in ProcessorTasklet{vertex=sentiment, processor=SentimentProcessor@19934597}
java.lang.OutOfMemoryError: GC overhead limit exceeded
^C17:29,976 [127.0.0.1]:5701 [dev] [0.6-SNAPSHOT] Terminating forcefully...
[WARNING]

Repo name change

Our other projects are prefixed with hazelcast. for example hazelcast-code-samples or hazelcast-jet-code-samples.

This repo should be hazelcast-jet-demos