hazelcast/hazelcast-jet-docker

This repository contains Docker image for Hazelcast Jet open-source distributed computing platform built for high-performance stream processing and fast batch processing.

Hazelcast Jet Docker

This repository contains Dockerfiles for the official Hazelcast Jet and Hazelcast Jet Enterprise Docker images:

• Hazelcast Jet Docker Images

• Hazelcast Jet Enterprise Docker Images

hazelcast-jet-docker's Issues

current latest image of hazelcast/hazelcast-jet on DockerHub fails to start with prometheus turned on

rmay_sorint@MacBook-Pro jet % docker run -e "JAVA_OPTS=-Dhazelcast.jmx=true" -e PROMETHEUS_PORT=8080 -it hazelcast/hazelcast-jet
########################################

JAVA_OPTS=-javaagent:/opt/hazelcast-jet/lib/jmx_prometheus_javaagent.jar=8080:/opt/hazelcast-jet/jmx_agent_config.yaml --add-modules java.se --add-exports java.base/jdk.internal.ref=ALL-UNNAMED --add-opens java.base/java.lang=ALL-UNNAMED --add-opens java.base/java.nio=ALL-UNNAMED --add-opens java.base/sun.nio.ch=ALL-UNNAMED --add-opens java.management/sun.management=ALL-UNNAMED --add-opens jdk.management/com.sun.management.internal=ALL-UNNAMED -Djava.net.preferIPv4Stack=true -Dhazelcast.logging.type=log4j2 -Dlog4j.configurationFile=file:/opt/hazelcast-jet/config/log4j2.properties -Djet.home=/opt/hazelcast-jet -Dhazelcast.config=/opt/hazelcast-jet/config/hazelcast.yaml -Dhazelcast.client.config=/opt/hazelcast-jet/config/hazelcast-client.yaml -Dhazelcast.jet.config=/opt/hazelcast-jet/config/hazelcast-jet.yaml -Dhazelcast.jmx=true

CLASSPATH=/opt/hazelcast-jet:/opt/hazelcast-jet/:/opt/hazelcast-jet/lib:/opt/hazelcast-jet/lib/

starting now....

########################################

• exec java -server -javaagent:/opt/hazelcast-jet/lib/jmx_prometheus_javaagent.jar=8080:/opt/hazelcast-jet/jmx_agent_config.yaml --add-modules java.se --add-exports java.base/jdk.internal.ref=ALL-UNNAMED --add-opens java.base/java.lang=ALL-UNNAMED --add-opens java.base/java.nio=ALL-UNNAMED --add-opens java.base/sun.nio.ch=ALL-UNNAMED --add-opens java.management/sun.management=ALL-UNNAMED --add-opens jdk.management/com.sun.management.internal=ALL-UNNAMED -Djava.net.preferIPv4Stack=true -Dhazelcast.logging.type=log4j2 -Dlog4j.configurationFile=file:/opt/hazelcast-jet/config/log4j2.properties -Djet.home=/opt/hazelcast-jet -Dhazelcast.config=/opt/hazelcast-jet/config/hazelcast.yaml -Dhazelcast.client.config=/opt/hazelcast-jet/config/hazelcast-client.yaml -Dhazelcast.jet.config=/opt/hazelcast-jet/config/hazelcast-jet.yaml -Dhazelcast.jmx=true com.hazelcast.jet.server.JetMemberStarter
  Error opening zip file or JAR manifest missing : /opt/hazelcast-jet/lib/jmx_prometheus_javaagent.jar
  Error occurred during initialization of VM
  agent library failed to init: instrument

The same command minus PROMETHEUS_PORT=8080 does start.

Update JDK version

CVE-2020-15999 at Hazelcast Jet Enterprise Openshift

It comes from base image's libraries:
https://access.redhat.com/security/cve/cve-2020-15999

This vulnerability is already fixed so rebuilding the image via calling dnf update command is enough to fix it.

remove log4j dependency

repository is getting flagged for log4j dependency, it's present in https://github.com/hazelcast/hazelcast-jet-docker/blob/master/examples/pom.xml

docker image should use jet-start script

Currently there's a lot of repetition in dockerfile and jet-start. docker image should use the start script directly instead of reimplementing it.

Web Modules is missing, can use HTTP with Jet docker image

IMDG dockerfile uses hazelcast-all so includes hazelcast-wm

Jet dockerfile only adds AWS

Download hazelcast-aws jars from maven repo.

ADD https://repo1.maven.org/maven2/com/hazelcast/hazelcast-aws/$HZ_AWS_VERSION/hazelcast-aws-$HZ_AWS_VERSION.jar $JET_HOME

So the HTTP modules can be used with IMDG docker image but not the Jet docker image.

Don't use java.util.logging in Docker, use Log4j

Remove special support for MIN_HEAP_SIZE and MAX_HEAP_SIZE

It is simple enough to use JAVA_OPTS="-Xms1g -Xmx2g" and every special parameter must be redundantly supported inside the Jet startup scripts

README should be updated

See the readme at: http://github.com/hazelcast/hazelcast-docker

remove Eureka client from Jet Docker Image

It has several dependencies and is not required for operation of Jet

Vulnerabilities in Hazelcast Eureka used by Hazelcast Jet Enterprise Openshift

openshift image uses Hazelcast Eureka version 1.1.2 which depends on some libraries with vulnerabilities

It depends com.fasterxml.jackson.core:jackson-databind:2.8.7 which includes following vulnerability

• https://nvd.nist.gov/vuln/detail/CVE-2019-12384 fixed in version 2.9.10

it depends org.apache.httpcomponents:httpclient:4.5.3 which includes following vulnerability

• CVE-2020-13956 fixed in version 4.5.13

It depends org.apache.logging.log4j:log4j-core:2.12.1 which includes following vulnerability

• CVE-2020-9488 fixed in version 2.13.2

It depends com.thoughtworks.xstream:xstream:1.4.11.1 which includes following vulnerabilities

• https://nvd.nist.gov/vuln/detail/CVE-2021-21342, https://nvd.nist.gov/vuln/detail/CVE-2021-21344, https://nvd.nist.gov/vuln/detail/CVE-2021-21345, https://nvd.nist.gov/vuln/detail/CVE-2021-21346, https://nvd.nist.gov/vuln/detail/CVE-2021-21347, https://nvd.nist.gov/vuln/detail/CVE-2021-21350, https://nvd.nist.gov/vuln/detail/CVE-2021-21351, fixed in version 1.4.16
• https://nvd.nist.gov/vuln/detail/CVE-2020-26217 fixed in version 1.4.14-jdk7
• https://nvd.nist.gov/vuln/detail/CVE-2020-26258 fixed in version 1.4.15
• https://nvd.nist.gov/vuln/detail/CVE-2021-21341, https://nvd.nist.gov/vuln/detail/CVE-2021-21343, https://nvd.nist.gov/vuln/detail/CVE-2021-21348, https://nvd.nist.gov/vuln/detail/CVE-2021-21349 fixed in version 1.4.16
• https://nvd.nist.gov/vuln/detail/CVE-2021-29505 fixed in version 1.4.17
• https://nvd.nist.gov/vuln/detail/CVE-2020-26259 fixed in version 1.4.15

Update Docker Images to use new CLI instead of submit.sh

CVE security vulnerabilities for Jet 4.3

hazelcast-jet and hazelcast-jet-enterprise list today 5 security vulnerabilities

CVE-2020-27350
CVE-2020-29361
CVE-2020-29362
CVE-2020-29363
CVE-2020-1971