Comments (11)
zborisha
commented on August 18, 2024
and I assigned 5GB of RAM to vagrant box - so memory should not be the issue
from decision.
mariomgal
commented on August 18, 2024
Thanks for reporting it, we are going to try to reproduce and fix it.
from decision.
epeinado
commented on August 18, 2024
Hi zborisha,
Please, can you check that streaming is really running with "ps -aux | grep streaming"?? Maybe "service streaming restart" is failing.
from decision.
zborisha
commented on August 18, 2024
Hi, looks like it is running
[vagrant@streaming ~]$ sudo service streaming status
Checking for Stratio Streaming: Stratio Streaming seems to be running (pid 6419)
[vagrant@streaming ~]$ /opt/sds/streaming-shell/bin/shell
/ | | () / | | | | |
| ( | | _ __ ___ __ _ _ __ ___ _ _ __ __ _ | ( | |__ | | |
** | | '/ _ / | '_ | | '_ \ / ` | ___ | ' \ / _ \ | |
_) | || | | __/ (| | | | | | | | | | | (| | _) | | | | **/ | |
|/ || **|**,|| || |||| |_|, | |_____/|| ||**|||
__/ |
|**/
Connection urls:
- Kafka: localhost:9092
- Zookeeper: localhost:2181
Type "help" to see all available commands.
stratio-streaming> list
Command failed java.lang.reflect.UndeclaredThrowableException
stratio-streaming> exit
[vagrant@streaming ~]$ ps -ef | grep streaming
stratio 6419 1 64 09:24 ? 00:01:24 /usr/java/jdk1.7.0_71/bin/java -Xms512m -Xmx512m -Dcom.sun.management.jmxremote.port=7193 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -classpath /etc/sds/streaming:/opt/sds/streaming/lib/org/apache/curator/curator-recipes/2.6.0/curator-recipes-2.6.0.jar:/opt/sds/streaming/lib/org/apache/curator/curator-framework/2.6.0/curator-framework-2.6.0.jar:/opt/sds/streaming/lib/org/apache/curator/curator-client/2.6.0/curator-client-2.6.0.jar:/opt/sds/streaming/lib/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/opt/sds/streaming/lib/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar:/opt/sds/streaming/lib/com/google/guava/guava/16.0.1/guava-16.0.1.jar:/opt/sds/streaming/lib/org/apache/kafka/kafka_2.10/0.8.1.1/kafka_2.10-0.8.1.1.jar:/opt/sds/streaming/lib/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/opt/sds/streaming/lib/org/xerial/snappy/snappy-java/1.0.5/snappy-java-1.0.5.jar:/opt/sds/streaming/lib/net/sf/jopt-simple/jopt-simple/3.2/jopt-simple-3.2.jar:/opt/sds/streaming/lib/org/scala-lang/scala-library/2.10.1/scala-library-2.10.1.jar:/opt/sds/streaming/lib/com/101tec/zkclient/0.3/zkclient-0.3.jar:/opt/sds/streaming/lib/org/apache/spark/spark-streaming_2.10/1.0.2/spark-streaming_2.10-1.0.2.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-server/8.1.14.v20131031/jetty-server-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.servlet/3.0.0.v201112011016/javax.servlet-3.0.0.v201112011016.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-continuation/8.1.14.v20131031/jetty-continuation-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-http/8.1.14.v20131031/jetty-http-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-io/8.1.14.v20131031/jetty-io-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/apache/spark/spark-core_2.10/1.0.2/spark-core_2.10-1.0.2.jar:/opt/sds/streaming/lib/org/apache/hadoop/hadoop-client/1.0.4/hadoop-client-1.0.4.jar:/opt/sds/streaming/lib/org/apache/hadoop/hadoop-core/1.0.4/hadoop-core-1.0.4.jar:/opt/sds/streaming/lib/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/opt/sds/streaming/lib/org/apache/commons/commons-math/2.1/commons-math-2.1.jar:/opt/sds/streaming/lib/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/opt/sds/streaming/lib/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/opt/sds/streaming/lib/commons-lang/commons-lang/2.4/commons-lang-2.4.jar:/opt/sds/streaming/lib/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/opt/sds/streaming/lib/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/opt/sds/streaming/lib/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/opt/sds/streaming/lib/commons-el/commons-el/1.0/commons-el-1.0.jar:/opt/sds/streaming/lib/hsqldb/hsqldb/1.8.0.10/hsqldb-1.8.0.10.jar:/opt/sds/streaming/lib/oro/oro/2.0.8/oro-2.0.8.jar:/opt/sds/streaming/lib/net/java/dev/jets3t/jets3t/0.7.1/jets3t-0.7.1.jar:/opt/sds/streaming/lib/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-plus/8.1.14.v20131031/jetty-plus-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.transaction/1.1.1.v201105210645/javax.transaction-1.1.1.v201105210645.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-webapp/8.1.14.v20131031/jetty-webapp-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-xml/8.1.14.v20131031/jetty-xml-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-servlet/8.1.14.v20131031/jetty-servlet-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-jndi/8.1.14.v20131031/jetty-jndi-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.mail.glassfish/1.4.1.v201005082020/javax.mail.glassfish-1.4.1.v201005082020.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.activation/1.1.0.v201105071233/javax.activation-1.1.0.v201105071233.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-security/8.1.14.v20131031/jetty-securi
vagrant 6889 3355 0 09:26 pts/0 00:00:00 grep streaming
[vagrant@streaming ~]$
[vagrant@streaming ~]$ free -g
total used free shared buffers cached
Mem: 5 2 2 0 0 0
-/+ buffers/cache: 2 3
Swap: 0 0 0
from decision.
zborisha
commented on August 18, 2024
I tried restarting it many times but does not help
[vagrant@streaming ~]$ sudo service streaming status
Checking for Stratio Streaming: Stratio Streaming seems to be running (pid 6419)
[vagrant@streaming ~]$ ps -ef | grep streaming
stratio 6419 1 39 09:24 ? 00:02:59 /usr/java/jdk1.7.0_71/bin/java -Xms512m -Xmx512m -Dcom.sun.management.jmxremote.port=7193 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -classpath /etc/sds/streaming:/opt/sds/streaming/lib/org/apache/curator/curator-recipes/2.6.0/curator-recipes-2.6.0.jar:/opt/sds/streaming/lib/org/apache/curator/curator-framework/2.6.0/curator-framework-2.6.0.jar:/opt/sds/streaming/lib/org/apache/curator/curator-client/2.6.0/curator-client-2.6.0.jar:/opt/sds/streaming/lib/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/opt/sds/streaming/lib/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar:/opt/sds/streaming/lib/com/google/guava/guava/16.0.1/guava-16.0.1.jar:/opt/sds/streaming/lib/org/apache/kafka/kafka_2.10/0.8.1.1/kafka_2.10-0.8.1.1.jar:/opt/sds/streaming/lib/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/opt/sds/streaming/lib/org/xerial/snappy/snappy-java/1.0.5/snappy-java-1.0.5.jar:/opt/sds/streaming/lib/net/sf/jopt-simple/jopt-simple/3.2/jopt-simple-3.2.jar:/opt/sds/streaming/lib/org/scala-lang/scala-library/2.10.1/scala-library-2.10.1.jar:/opt/sds/streaming/lib/com/101tec/zkclient/0.3/zkclient-0.3.jar:/opt/sds/streaming/lib/org/apache/spark/spark-streaming_2.10/1.0.2/spark-streaming_2.10-1.0.2.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-server/8.1.14.v20131031/jetty-server-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.servlet/3.0.0.v201112011016/javax.servlet-3.0.0.v201112011016.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-continuation/8.1.14.v20131031/jetty-continuation-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-http/8.1.14.v20131031/jetty-http-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-io/8.1.14.v20131031/jetty-io-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/apache/spark/spark-core_2.10/1.0.2/spark-core_2.10-1.0.2.jar:/opt/sds/streaming/lib/org/apache/hadoop/hadoop-client/1.0.4/hadoop-client-1.0.4.jar:/opt/sds/streaming/lib/org/apache/hadoop/hadoop-core/1.0.4/hadoop-core-1.0.4.jar:/opt/sds/streaming/lib/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/opt/sds/streaming/lib/org/apache/commons/commons-math/2.1/commons-math-2.1.jar:/opt/sds/streaming/lib/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/opt/sds/streaming/lib/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/opt/sds/streaming/lib/commons-lang/commons-lang/2.4/commons-lang-2.4.jar:/opt/sds/streaming/lib/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/opt/sds/streaming/lib/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/opt/sds/streaming/lib/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/opt/sds/streaming/lib/commons-el/commons-el/1.0/commons-el-1.0.jar:/opt/sds/streaming/lib/hsqldb/hsqldb/1.8.0.10/hsqldb-1.8.0.10.jar:/opt/sds/streaming/lib/oro/oro/2.0.8/oro-2.0.8.jar:/opt/sds/streaming/lib/net/java/dev/jets3t/jets3t/0.7.1/jets3t-0.7.1.jar:/opt/sds/streaming/lib/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-plus/8.1.14.v20131031/jetty-plus-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.transaction/1.1.1.v201105210645/javax.transaction-1.1.1.v201105210645.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-webapp/8.1.14.v20131031/jetty-webapp-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-xml/8.1.14.v20131031/jetty-xml-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-servlet/8.1.14.v20131031/jetty-servlet-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-jndi/8.1.14.v20131031/jetty-jndi-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.mail.glassfish/1.4.1.v201005082020/javax.mail.glassfish-1.4.1.v201005082020.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.activation/1.1.0.v201105071233/javax.activation-1.1.0.v201105071233.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-security/8.1.14.v20131031/jetty-securi
vagrant 6967 3355 0 09:32 pts/0 00:00:00 grep streaming
[vagrant@streaming ~]$ sudo service streaming stop
Stopping Stratio Streaming [vagrant@streaming ~]$
[vagrant@streaming ~]$ ps -ef | grep streaming
vagrant 7092 3355 0 09:32 pts/0 00:00:00 grep streaming
[vagrant@streaming ~]$ sudo service streaming start
Starting Stratio Streaming STARTED
[vagrant@streaming ~]$ sudo service streaming status
Checking for Stratio Streaming: Stratio Streaming seems to be running (pid 7127)
[vagrant@streaming ~]$ ps -ef | grep streaming
stratio 7127 1 85 09:32 ? 00:00:12 /usr/java/jdk1.7.0_71/bin/java -Xms512m -Xmx512m -Dcom.sun.management.jmxremote.port=7193 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -classpath /etc/sds/streaming:/opt/sds/streaming/lib/org/apache/curator/curator-recipes/2.6.0/curator-recipes-2.6.0.jar:/opt/sds/streaming/lib/org/apache/curator/curator-framework/2.6.0/curator-framework-2.6.0.jar:/opt/sds/streaming/lib/org/apache/curator/curator-client/2.6.0/curator-client-2.6.0.jar:/opt/sds/streaming/lib/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/opt/sds/streaming/lib/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar:/opt/sds/streaming/lib/com/google/guava/guava/16.0.1/guava-16.0.1.jar:/opt/sds/streaming/lib/org/apache/kafka/kafka_2.10/0.8.1.1/kafka_2.10-0.8.1.1.jar:/opt/sds/streaming/lib/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/opt/sds/streaming/lib/org/xerial/snappy/snappy-java/1.0.5/snappy-java-1.0.5.jar:/opt/sds/streaming/lib/net/sf/jopt-simple/jopt-simple/3.2/jopt-simple-3.2.jar:/opt/sds/streaming/lib/org/scala-lang/scala-library/2.10.1/scala-library-2.10.1.jar:/opt/sds/streaming/lib/com/101tec/zkclient/0.3/zkclient-0.3.jar:/opt/sds/streaming/lib/org/apache/spark/spark-streaming_2.10/1.0.2/spark-streaming_2.10-1.0.2.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-server/8.1.14.v20131031/jetty-server-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.servlet/3.0.0.v201112011016/javax.servlet-3.0.0.v201112011016.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-continuation/8.1.14.v20131031/jetty-continuation-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-http/8.1.14.v20131031/jetty-http-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-io/8.1.14.v20131031/jetty-io-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/apache/spark/spark-core_2.10/1.0.2/spark-core_2.10-1.0.2.jar:/opt/sds/streaming/lib/org/apache/hadoop/hadoop-client/1.0.4/hadoop-client-1.0.4.jar:/opt/sds/streaming/lib/org/apache/hadoop/hadoop-core/1.0.4/hadoop-core-1.0.4.jar:/opt/sds/streaming/lib/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/opt/sds/streaming/lib/org/apache/commons/commons-math/2.1/commons-math-2.1.jar:/opt/sds/streaming/lib/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/opt/sds/streaming/lib/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/opt/sds/streaming/lib/commons-lang/commons-lang/2.4/commons-lang-2.4.jar:/opt/sds/streaming/lib/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/opt/sds/streaming/lib/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/opt/sds/streaming/lib/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/opt/sds/streaming/lib/commons-el/commons-el/1.0/commons-el-1.0.jar:/opt/sds/streaming/lib/hsqldb/hsqldb/1.8.0.10/hsqldb-1.8.0.10.jar:/opt/sds/streaming/lib/oro/oro/2.0.8/oro-2.0.8.jar:/opt/sds/streaming/lib/net/java/dev/jets3t/jets3t/0.7.1/jets3t-0.7.1.jar:/opt/sds/streaming/lib/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-plus/8.1.14.v20131031/jetty-plus-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.transaction/1.1.1.v201105210645/javax.transaction-1.1.1.v201105210645.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-webapp/8.1.14.v20131031/jetty-webapp-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-xml/8.1.14.v20131031/jetty-xml-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-servlet/8.1.14.v20131031/jetty-servlet-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-jndi/8.1.14.v20131031/jetty-jndi-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.mail.glassfish/1.4.1.v201005082020/javax.mail.glassfish-1.4.1.v201005082020.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.activation/1.1.0.v201105071233/javax.activation-1.1.0.v201105071233.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-security/8.1.14.v20131031/jetty-securi
vagrant 7237 3355 0 09:32 pts/0 00:00:00 grep streaming
[vagrant@streaming ~]$ /opt/sds/streaming-shell/bin/shell
/ | | () / | | | | |
| ( | | _ __ ___ __ _ _ __ ___ _ _ __ __ _ | ( | |__ | | |
** | | '/ _ / | '_ | | '_ \ / ` | ___ | ' \ / _ \ | |
_) | || | | __/ (| | | | | | | | | | | (| | _) | | | | **/ | |
|/ || **|**,|| || |||| |_|, | |_____/|| ||**|||
__/ |
|**/
Connection urls:
- Kafka: localhost:9092
- Zookeeper: localhost:2181
Type "help" to see all available commands.
stratio-streaming> list
Command failed -> Unable to connect to statio streaming
stratio-streaming>
from decision.
mariomgal
commented on August 18, 2024
Hi again, zborisha.
We have tried to reproduce the issue but we had no luck. We are considering two scenarios:
a) You're executing shell commands that interact with Streaming Engine (i.e., list) while the engine has not finished the starting process. That would explain the "Unable to connect to stratio streaming" error.
b) In your last retry, there is another error ("UndeclaredException"), not an issue in the connection to the engine. This is a known problem in the sandbox version. Could you try the same scenario, but executing the "list" command again without exiting the shell?
Thanks.
from decision.
zborisha
commented on August 18, 2024
Hi, I am not sure what you mean that I am executing "list" while the engine has not finished starting process? It looks like it has started
[vagrant@streaming ~]$ sudo vi /etc/sds/streaming/config.conf
[vagrant@streaming ~]$ sudo service streaming restart
Stopping Stratio Streaming Starting Stratio Streaming STARTED
[vagrant@streaming ~]$ /opt/sds/streaming-shell/bin/shell
/ | | () / **| | | | |
| (** | | _ __ ___ __ _ _ __ ___ _ _ __ __ _ | (__ | |__ | | |
\ | | '/ _ / ` | ' _ | | '_ \ / _ | ___ | '_ \ / _ \ | |
____) | || | | _/ (| | | | | | | | | | | (| | __) | | | | / | |
|**/ __|| __|**,|| || |||| ||, | |__/|| |||||
/ |
|_/
Connection urls:
- Kafka: localhost:9092
- Zookeeper: localhost:2181
Type "help" to see all available commands.
stratio-streaming> list
Command failed -> Unable to connect to statio streaming
stratio-streaming> exit
[vagrant@streaming ~]$ sudo service streaming status
Checking for Stratio Streaming: Stratio Streaming seems to be running (pid 4812)
[vagrant@streaming ~]$ sudo service streaming restart
Stopping Stratio Streaming Starting Stratio Streaming STARTED
[vagrant@streaming ~]$ sudo service streaming status
Checking for Stratio Streaming: Stratio Streaming seems to be running (pid 5375)
but ok.. let me try again and I will wait few minutes between starting engine and using shell.. that should be enough right?
from decision.
mariomgal
commented on August 18, 2024
Hi again,
The engine may need some time to completely finish starting up, because it has to perform some complex initializations (SparkContext, connections to Kafka and Zookeeper, engine DStream initializations, etc).
Our suggestion is to give it some time after you see the message "Stratio Streaming STARTED" (which only means that the starting process has begun, and the engine has an assigned pid) and the first time you enter a shell command. Also, don't quit the shell immediately if you receive an error (specially if its a "UndeclaredException" error) and try the same command again.
If you continue experiencing the "Unable to connect to stratio streaming" after some time and some retries, please examine and post here the last content of the streaming engine log, located in /var/log/sds/streaming.log. Maybe the engine has some problem when starting up.
Thanks.
from decision.
zborisha
commented on August 18, 2024
Hi, so it works now.. but it took ~6-7 minutes to initialize everything. And the problem is it throws UndeclaredThrowableException if I execute list during initialization - instead of printing proper message.
[vagrant@streaming ~]$ sudo service streaming status
Checking for Stratio Streaming: Stratio Streaming seems to be running (pid 2979)
[vagrant@streaming ~]$ ps -ef | grep streaming
stratio 2979 1 63 05:17 ? 00:01:05 /usr/java/jdk1.7.0_71/bin/java -Xms512m -Xmx512m -Dcom.sun.management.jmxremote.port=7193 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -classpath /etc/sds/streaming:/opt/sds/streaming/lib/org/apache/curator/curator-recipes/2.6.0/curator-recipes-2.6.0.jar:/opt/sds/streaming/lib/org/apache/curator/curator-framework/2.6.0/curator-framework-2.6.0.jar:/opt/sds/streaming/lib/org/apache/curator/curator-client/2.6.0/curator-client-2.6.0.jar:/opt/sds/streaming/lib/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/opt/sds/streaming/lib/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar:/opt/sds/streaming/lib/com/google/guava/guava/16.0.1/guava-16.0.1.jar:/opt/sds/streaming/lib/org/apache/kafka/kafka_2.10/0.8.1.1/kafka_2.10-0.8.1.1.jar:/opt/sds/streaming/lib/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/opt/sds/streaming/lib/org/xerial/snappy/snappy-java/1.0.5/snappy-java-1.0.5.jar:/opt/sds/streaming/lib/net/sf/jopt-simple/jopt-simple/3.2/jopt-simple-3.2.jar:/opt/sds/streaming/lib/org/scala-lang/scala-library/2.10.1/scala-library-2.10.1.jar:/opt/sds/streaming/lib/com/101tec/zkclient/0.3/zkclient-0.3.jar:/opt/sds/streaming/lib/org/apache/spark/spark-streaming_2.10/1.0.2/spark-streaming_2.10-1.0.2.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-server/8.1.14.v20131031/jetty-server-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.servlet/3.0.0.v201112011016/javax.servlet-3.0.0.v201112011016.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-continuation/8.1.14.v20131031/jetty-continuation-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-http/8.1.14.v20131031/jetty-http-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-io/8.1.14.v20131031/jetty-io-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/apache/spark/spark-core_2.10/1.0.2/spark-core_2.10-1.0.2.jar:/opt/sds/streaming/lib/org/apache/hadoop/hadoop-client/1.0.4/hadoop-client-1.0.4.jar:/opt/sds/streaming/lib/org/apache/hadoop/hadoop-core/1.0.4/hadoop-core-1.0.4.jar:/opt/sds/streaming/lib/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/opt/sds/streaming/lib/org/apache/commons/commons-math/2.1/commons-math-2.1.jar:/opt/sds/streaming/lib/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/opt/sds/streaming/lib/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/opt/sds/streaming/lib/commons-lang/commons-lang/2.4/commons-lang-2.4.jar:/opt/sds/streaming/lib/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/opt/sds/streaming/lib/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/opt/sds/streaming/lib/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/opt/sds/streaming/lib/commons-el/commons-el/1.0/commons-el-1.0.jar:/opt/sds/streaming/lib/hsqldb/hsqldb/1.8.0.10/hsqldb-1.8.0.10.jar:/opt/sds/streaming/lib/oro/oro/2.0.8/oro-2.0.8.jar:/opt/sds/streaming/lib/net/java/dev/jets3t/jets3t/0.7.1/jets3t-0.7.1.jar:/opt/sds/streaming/lib/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-plus/8.1.14.v20131031/jetty-plus-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.transaction/1.1.1.v201105210645/javax.transaction-1.1.1.v201105210645.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-webapp/8.1.14.v20131031/jetty-webapp-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-xml/8.1.14.v20131031/jetty-xml-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-servlet/8.1.14.v20131031/jetty-servlet-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-jndi/8.1.14.v20131031/jetty-jndi-8.1.14.v20131031.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.mail.glassfish/1.4.1.v201005082020/javax.mail.glassfish-1.4.1.v201005082020.jar:/opt/sds/streaming/lib/org/eclipse/jetty/orbit/javax.activation/1.1.0.v201105071233/javax.activation-1.1.0.v201105071233.jar:/opt/sds/streaming/lib/org/eclipse/jetty/jetty-security/8.1.14.v20131031/jetty-securi
vagrant 3628 3540 0 05:18 pts/0 00:00:00 grep streaming
[vagrant@streaming ~]$ /opt/sds/streaming-shell/bin/shell
/ | | () / | | | | |
| ( | | _ __ ___ __ _ _ __ ___ _ _ __ __ _ | ( | |__ | | |
** | | '/ _ / | '_ | | '_ \ / ` | ___ | ' \ / _ \ | |
_) | || | | __/ (| | | | | | | | | | | (| | _) | | | | **/ | |
|/ || **|**,|| || |||| |_|, | |_____/|| ||**|||
__/ |
|**/
Connection urls:
- Kafka: localhost:9092
- Zookeeper: localhost:2181
Type "help" to see all available commands.
stratio-streaming> list
Command failed java.lang.reflect.UndeclaredThrowableException
stratio-streaming> ! date
command is:date
Thu Jul 23 05:19:53 UTC 2015
stratio-streaming> ! date
command is:date
Thu Jul 23 05:24:10 UTC 2015
stratio-streaming> list
Command failed java.lang.reflect.UndeclaredThrowableException
stratio-streaming> ! date
command is:date
Thu Jul 23 05:26:15 UTC 2015
stratio-streaming> list
Stream name User defined Queries Elements Active actions
stratio-streaming> list
Stream name User defined Queries Elements Active actions
stratio-streaming> list
Stream name User defined Queries Elements Active actions
stratio-streaming>
from decision.
zborisha
commented on August 18, 2024
Maybe this will be helpful to you: while initialization is happening Kibana UI is showing Oops! IndexMissingException[[stratiostreaming] missing] error on all widgets...
This is the output of log file
stratio-streaming> ! less /var/log/sds/streaming/streaming.log
command is:less /var/log/sds/streaming/streaming.log
[ERROR] 2015-04-15 07:16:44,531 [spark-akka.actor.default-dispatcher-4] org.apache.spark.streaming.scheduler.ReceiverTracker logError - Deregistered receiver for stream 0: Stopped by driver
[ERROR] 2015-07-23 05:32:38,552 [spark-akka.actor.default-dispatcher-14] org.apache.spark.streaming.scheduler.ReceiverTracker logError - Deregistered receiver for stream 0: Stopped by driver
[ERROR] 2015-07-23 05:32:40,102 [Thread-87] org.apache.spark.network.ConnectionManager logError - Corresponding SendingConnectionManagerId not found
[ERROR] 2015-07-23 05:32:40,219 [spark-akka.actor.default-dispatcher-5] org.apache.spark.streaming.scheduler.ReceiverTracker logError - Deregistered receiver for stream 0: Stopped by driver
[ERROR] 2015-07-23 05:32:41,762 [spark-akka.actor.default-dispatcher-15] org.apache.spark.streaming.scheduler.ReceiverTracker logError - Deregistered receiver for stream 0: Stopped by driver
from decision.
david-morales
commented on August 18, 2024
Hi,
Stratio Streaming takes care of all the stuff related to the datastores, so
if you enable an action on a stream involving persistence (save cassandra,
save elasticsearch....), you do not need to previously create the
keyspace/database/index and table/collection and so on... Stratio Streaming
will do it automatically.
This feature includes all the updates required by an alter operation on a
stream, for example.
So, regarding your question, that's the expected behaviour.
- You don't have the index in the ES cluster
- You start creating streams and queries
- You enable the save to ES action
- Stratio Streaming will create the index
In that moment, Kibana will automatically start showing the dashboard.
About the original question, we should improve the messages showed up by
the shell. I am juest going to create some issues.
2015-07-23 7:38 GMT+02:00 zborisha [email protected]:
Maybe this will be helpful to you: while initialization is happening
Kibana UI is showing Oops! IndexMissingException[[stratiostreaming]
missing] error on all widgets...This is the output of log file
stratio-streaming> ! less /var/log/sds/streaming/streaming.log
command is:less /var/log/sds/streaming/streaming.log
[ERROR] 2015-04-15 07:16:44,531 [spark-akka.actor.default-dispatcher-4]
org.apache.spark.streaming.scheduler.ReceiverTracker logError -
Deregistered receiver for stream 0: Stopped by driver
[ERROR] 2015-07-23 05:32:38,552 [spark-akka.actor.default-dispatcher-14]
org.apache.spark.streaming.scheduler.ReceiverTracker logError -
Deregistered receiver for stream 0: Stopped by driver
[ERROR] 2015-07-23 05:32:40,102 [Thread-87]
org.apache.spark.network.ConnectionManager logError - Corresponding
SendingConnectionManagerId not found
[ERROR] 2015-07-23 05:32:40,219 [spark-akka.actor.default-dispatcher-5]
org.apache.spark.streaming.scheduler.ReceiverTracker logError -
Deregistered receiver for stream 0: Stopped by driver
[ERROR] 2015-07-23 05:32:41,762 [spark-akka.actor.default-dispatcher-15]
org.apache.spark.streaming.scheduler.ReceiverTracker logError -
Deregistered receiver for stream 0: Stopped by driver—
Reply to this email directly or view it on GitHub
#37 (comment)
.
David Morales de Frías :: +34 607 010 411 :: @dmoralesdf
https://twitter.com/dmoralesdf
http://www.stratio.com/
Vía de las dos Castillas, 33, Ática 4, 3ª Planta
28224 Pozuelo de Alarcón, Madrid
Tel: +34 91 828 6473 // www.stratio.com // @stratiobd
https://twitter.com/StratioBD
from decision.
Related Issues (20)
- Web site could not be generated under java 8 HOT 4
- Issue with docker sandbox HOT 1
- Is der any document or readme to build and use this on my machie? HOT 5
- how siddhi query Persistent stored ? HOT 1
- siddhimanager instance run in spark-streaming "driver" role ?
- Failed dependencies: osgi(org.sonatype.sisu.guava) is needed by stratio-decision HOT 1
- Siddhi Distributed Mode
- seems “http://docs.stratio.com” closed？
- RabbitMQ output plugin
- Use the Direct Approach in Streaming-Kafka integration. HOT 1
- Failover is not working properly
- Upgrade Spark version to 1.4.1
- Failover in Zookeeper
- upgrade ElasticSearch action to 1.7
- Sandbox is not working on Windows 10
- Add documentation of the streaming language syntax
- Error restarting stratio streaming in sandbox HOT 1
- Config properties should be error resilient
- Improve pom content
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from decision.