Giter Site home page Giter Site logo

webankfintech / streamis Goto Github PK

View Code? Open in Web Editor NEW
97.0 20.0 40.0 71.65 MB

Streaming application development and management system, based on Linkis and DSS, planning to provide the workflow-like graphical drag-and-drop development capability.

License: Apache License 2.0

Java 84.55% Scala 10.77% Shell 0.39% SCSS 4.28%
flink linkis dataspherestudio wedatasphere streamis streaming hudi iceberg datalake warehouse

streamis's People

Contributors

15100399015 avatar alexkun avatar davidhua1996 avatar demonray avatar dlimeng avatar green241 avatar jefftlin avatar kongslove avatar liveipool avatar wushengyeyouya avatar yangwenzea avatar yangzhiyue avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

streamis's Issues

[Feature] Support to collect log event from stream application

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

For stream application, such as Flink/Spark Streaming, cannot fetch the error logs in time. So we should provide an embedded plugin to collect log event from log framework(log4j or log4j2) and send to the Streamis server for storing.

Description

Embedded log collector plugin and log server entry point

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 流式应用的 Yarn 执行日志展示

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

流式应用的 Yarn 执行日志展示

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Solve the problem of inserting two appconn records

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

streamis-appconn module init.sql needs to insert two appconn records to realize page Jump and interface call to streamis in DSS project

Description

Need to adjust the front end of DSS to solve

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Bug] 运行flink.sql报错,java.lang.IllegalStateException: Shutdown in progress

Search before asking

  • I searched the issues and found no similar issues.

Streamis Component

streamis-server

What happened + What you expected to happen

在streamis中运行flinksql报错:java.lang.IllegalStateException: Shutdown in progress,同样的脚本可以在scriptis中正确执行。
2022-03-16 09:19:32.109 INFO [SpringContextShutdownHook] com.netflix.util.concurrent.ShutdownEnabledTimer 72 cancel - Exception caught (might be ok if at shutdown) java.lang.IllegalStateException: Shutdown in progress
at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) ~[?:1.8.0_161]
at java.lang.Runtime.removeShutdownHook(Runtime.java:239) ~[?:1.8.0_161]
at com.netflix.util.concurrent.ShutdownEnabledTimer.cancel(ShutdownEnabledTimer.java:70) [netflix-commons-util-0.1.1.jar:?]
at com.netflix.loadbalancer.BaseLoadBalancer.cancelPingTask(BaseLoadBalancer.java:632) [ribbon-loadbalancer-2.3.0.jar:2.3.0]
at com.netflix.loadbalancer.BaseLoadBalancer.shutdown(BaseLoadBalancer.java:883) [ribbon-loadbalancer-2.3.0.jar:2.3.0]
at com.netflix.loadbalancer.DynamicServerListLoadBalancer.shutdown(DynamicServerListLoadBalancer.java:285) [ribbon-loadbalancer-2.3.0.jar:2.3.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_161]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_161]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_161]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
at org.springframework.beans.factory.support.DisposableBeanAdapter.invokeCustomDestroyMethod(DisposableBeanAdapter.java:280) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DisposableBeanAdapter.destroy(DisposableBeanAdapter.java:214) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroyBean(DefaultSingletonBeanRegistry.java:587) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingleton(DefaultSingletonBeanRegistry.java:559) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.destroySingleton(DefaultListableBeanFactory.java:1092) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingletons(DefaultSingletonBeanRegistry.java:520) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.destroySingletons(DefaultListableBeanFactory.java:1085) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.destroyBeans(AbstractApplicationContext.java:1061) [spring-context-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.doClose(AbstractApplicationContext.java:1030) [spring-context-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.close(AbstractApplicationContext.java:979) [spring-context-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.cloud.context.named.NamedContextFactory.destroy(NamedContextFactory.java:92) [spring-cloud-context-2.2.1.RELEASE.jar:2.2.1.RELEASE]
at org.springframework.beans.factory.support.DisposableBeanAdapter.destroy(DisposableBeanAdapter.java:199) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroyBean(DefaultSingletonBeanRegistry.java:587) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingleton(DefaultSingletonBeanRegistry.java:559) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.destroySingleton(DefaultListableBeanFactory.java:1092) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingletons(DefaultSingletonBeanRegistry.java:520) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.destroySingletons(DefaultListableBeanFactory.java:1085) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.destroyBeans(AbstractApplicationContext.java:1061) [spring-context-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.doClose(AbstractApplicationContext.java:1030) [spring-context-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.doClose(ServletWebServerApplicationContext.java:170) [spring-boot-2.3.2.RELEASE.jar:2.3.2.RELEASE]
at org.springframework.context.support.AbstractApplicationContext$1.run(AbstractApplicationContext.java:949) [spring-context-5.2.8.RELEASE.jar:5.2.8.RELEASE]

2022-03-16 09:19:32.129 INFO [SpringContextShutdownHook] org.apache.linkis.engineconn.acessible.executor.service.DefaultAccessibleService 41 info - executorShutDownHook start to execute.
2022-03-16 09:19:32.129 WARN [SpringContextShutdownHook] org.apache.linkis.engineconn.acessible.executor.service.DefaultAccessibleService 50 warn - EngineConn not ready, do not shutdown
2022-03-16 09:19:32.131 INFO [SpringContextShutdownHook] com.netflix.util.concurrent.ShutdownEnabledTimer 67 cancel - Shutdown hook removed for: NFLoadBalancer-PingTimer-linkis-cg-linkismanager
2022-03-16 09:19:32.131 INFO [SpringContextShutdownHook] com.netflix.util.concurrent.ShutdownEnabledTimer 72 cancel - Exception caught (might be ok if at shutdown) java.lang.IllegalStateException: Shutdown in progress
at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82) ~[?:1.8.0_161]
at java.lang.Runtime.removeShutdownHook(Runtime.java:239) ~[?:1.8.0_161]
at com.netflix.util.concurrent.ShutdownEnabledTimer.cancel(ShutdownEnabledTimer.java:70) [netflix-commons-util-0.1.1.jar:?]
at com.netflix.loadbalancer.BaseLoadBalancer.cancelPingTask(BaseLoadBalancer.java:632) [ribbon-loadbalancer-2.3.0.jar:2.3.0]
at com.netflix.loadbalancer.BaseLoadBalancer.shutdown(BaseLoadBalancer.java:883) [ribbon-loadbalancer-2.3.0.jar:2.3.0]
at com.netflix.loadbalancer.DynamicServerListLoadBalancer.shutdown(DynamicServerListLoadBalancer.java:285) [ribbon-loadbalancer-2.3.0.jar:2.3.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_161]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_161]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_161]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
at org.springframework.beans.factory.support.DisposableBeanAdapter.invokeCustomDestroyMethod(DisposableBeanAdapter.java:280) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DisposableBeanAdapter.destroy(DisposableBeanAdapter.java:214) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroyBean(DefaultSingletonBeanRegistry.java:587) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingleton(DefaultSingletonBeanRegistry.java:559) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.destroySingleton(DefaultListableBeanFactory.java:1092) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingletons(DefaultSingletonBeanRegistry.java:520) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.destroySingletons(DefaultListableBeanFactory.java:1085) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.destroyBeans(AbstractApplicationContext.java:1061) [spring-context-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.doClose(AbstractApplicationContext.java:1030) [spring-context-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.close(AbstractApplicationContext.java:979) [spring-context-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.cloud.context.named.NamedContextFactory.destroy(NamedContextFactory.java:92) [spring-cloud-context-2.2.1.RELEASE.jar:2.2.1.RELEASE]
at org.springframework.beans.factory.support.DisposableBeanAdapter.destroy(DisposableBeanAdapter.java:199) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroyBean(DefaultSingletonBeanRegistry.java:587) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingleton(DefaultSingletonBeanRegistry.java:559) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.destroySingleton(DefaultListableBeanFactory.java:1092) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingletons(DefaultSingletonBeanRegistry.java:520) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.destroySingletons(DefaultListableBeanFactory.java:1085) [spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.destroyBeans(AbstractApplicationContext.java:1061) [spring-context-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.doClose(AbstractApplicationContext.java:1030) [spring-context-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.doClose(ServletWebServerApplicationContext.java:170) [spring-boot-2.3.2.RELEASE.jar:2.3.2.RELEASE]
at org.springframework.context.support.AbstractApplicationContext$1.run(AbstractApplicationContext.java:949) [spring-context-5.2.8.RELEASE.jar:5.2.8.RELEASE]

2022-03-16 09:19:32.910 WARN [Linkis-Default-Scheduler-Thread-3] org.apache.flink.core.plugin.PluginConfig 69 getPluginsDir - The plugins directory [plugins] does not exist.
2022-03-16 09:19:34.490 ERROR [Linkis-Default-Scheduler-Thread-3] org.apache.linkis.engineconnplugin.flink.executor.FlinkCodeOnceExecutor 58 error - Run code failed! org.apache.flink.table.api.TableException: Failed to execute sql
at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:727) ~[flink-table-api-java-1.12.5.jar:1.12.5]
at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeOperation(TableEnvironmentImpl.java:1107) ~[flink-table-api-java-1.12.5.jar:1.12.5]
at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:666) ~[flink-table-api-java-1.12.5.jar:1.12.5]
at org.apache.linkis.engineconnplugin.flink.executor.FlinkCodeOnceExecutor$$anon$2.get(FlinkCodeOnceExecutor.scala:112) ~[linkis-engineconn-plugin-flink-1.0.3.jar:1.0.3]
at org.apache.linkis.engineconnplugin.flink.executor.FlinkCodeOnceExecutor$$anon$2.get(FlinkCodeOnceExecutor.scala:111) ~[linkis-engineconn-plugin-flink-1.0.3.jar:1.0.3]
at org.apache.linkis.engineconnplugin.flink.client.context.ExecutionContext.wrapClassLoader(ExecutionContext.java:164) ~[linkis-engineconn-plugin-flink-1.0.3.jar:1.0.3]
at org.apache.linkis.engineconnplugin.flink.executor.FlinkCodeOnceExecutor.runCode(FlinkCodeOnceExecutor.scala:111) ~[linkis-engineconn-plugin-flink-1.0.3.jar:1.0.3]
at org.apache.linkis.engineconnplugin.flink.executor.FlinkCodeOnceExecutor$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$2.apply(FlinkCodeOnceExecutor.scala:72) ~[linkis-engineconn-plugin-flink-1.0.3.jar:1.0.3]
at org.apache.linkis.engineconnplugin.flink.executor.FlinkCodeOnceExecutor$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$2.apply(FlinkCodeOnceExecutor.scala:72) ~[linkis-engineconn-plugin-flink-1.0.3.jar:1.0.3]
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) ~[scala-library-2.11.12.jar:?]
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) ~[scala-library-2.11.12.jar:?]
at org.apache.linkis.engineconnplugin.flink.executor.FlinkCodeOnceExecutor$$anon$1$$anonfun$run$1.apply$mcV$sp(FlinkCodeOnceExecutor.scala:72) ~[linkis-engineconn-plugin-flink-1.0.3.jar:1.0.3]
at org.apache.linkis.engineconnplugin.flink.executor.FlinkCodeOnceExecutor$$anon$1$$anonfun$run$1.apply(FlinkCodeOnceExecutor.scala:72) ~[linkis-engineconn-plugin-flink-1.0.3.jar:1.0.3]
at org.apache.linkis.engineconnplugin.flink.executor.FlinkCodeOnceExecutor$$anon$1$$anonfun$run$1.apply(FlinkCodeOnceExecutor.scala:72) ~[linkis-engineconn-plugin-flink-1.0.3.jar:1.0.3]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) [linkis-common-1.0.3.jar:1.0.3]
at org.apache.linkis.engineconnplugin.flink.executor.FlinkCodeOnceExecutor$$anon$1.run(FlinkCodeOnceExecutor.scala:72) [linkis-engineconn-plugin-flink-1.0.3.jar:1.0.3]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_161]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_161]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_161]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_161]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_161]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_161]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
Caused by: org.apache.flink.client.deployment.ClusterDeploymentException: Could not deploy Yarn job cluster.
at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:481) ~[flink-yarn_2.11-1.12.5.jar:1.12.5]
at org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:81) ~[flink-clients_2.11-1.12.5.jar:1.12.5]
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:1905) ~[flink-streaming-java_2.11-1.12.5.jar:1.12.5]
at org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:135) ~[flink-clients_2.11-1.12.5.jar:1.12.5]
at org.apache.flink.table.planner.delegation.ExecutorBase.executeAsync(ExecutorBase.java:55) ~[flink-table-planner-blink_2.11-1.12.5.jar:1.12.5]
at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:711) ~[flink-table-api-java-1.12.5.jar:1.12.5]
... 22 more
Caused by: java.lang.IllegalStateException: Shutdown in progress
at java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:66) ~[?:1.8.0_161]
at java.lang.Runtime.addShutdownHook(Runtime.java:211) ~[?:1.8.0_161]
at org.apache.flink.yarn.YarnClusterDescriptor.startAppMaster(YarnClusterDescriptor.java:1175) ~[flink-yarn_2.11-1.12.5.jar:1.12.5]
at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:592) ~[flink-yarn_2.11-1.12.5.jar:1.12.5]
at org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:474) ~[flink-yarn_2.11-1.12.5.jar:1.12.5]
at org.apache.flink.client.deployment.executors.AbstractJobClusterExecutor.execute(AbstractJobClusterExecutor.java:81) ~[flink-clients_2.11-1.12.5.jar:1.12.5]
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:1905) ~[flink-streaming-java_2.11-1.12.5.jar:1.12.5]
at org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:135) ~[flink-clients_2.11-1.12.5.jar:1.12.5]
at org.apache.flink.table.planner.delegation.ExecutorBase.executeAsync(ExecutorBase.java:55) ~[flink-table-planner-blink_2.11-1.12.5.jar:1.12.5]
at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:711) ~[flink-table-api-java-1.12.5.jar:1.12.5]
... 22 more
stdout.log

Relevent platform

DSS1.0.1+Linkis1.0.3+Streamis0.1.0

Reproduction script

oracle-cdc

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 任务启动前检查失败告警人

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

在任务启动前检测是否配置有效的失败告警人参数,若没有配置,则任务无法启动

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Task configuration interface rendering and interface adjustment

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Streamis needs to maintain the configuration information for each stream task. The current configuration information is very large but the front end display is relatively fixed, and the front end interface becomes unavailable when the configuration is passed through the system docking if it is missing.
Streamis需要维护每个流式任务的配置信息,当前的配置信息非常多但前端显示相对固定,同时通过系统对接传递配置时,如果缺漏配置则前端界面将变成不可用的状态。

Description

Reconfigure the configuration interface to make it dynamically configurable, configure the control configuration items displayed in the background, and set a default value for each control configuration item. The control currently only needs to support INPUT, TEXT and SELECT.
The background provides four interfaces to view the task configuration item definition list, view the configuration parameters of the current task, and add or update the configuration parameters of the current task.

重构配置界面,将界面变成动态可配的,后台配置显示的控件配置项,并为每个控件配置项设定一个默认值,控件目前只需支持INPUT, TEXT和SELECT。
后台提供四个接口,查看任务的配置项定义列表,查看当前任务的配置参数,增加/更新当前任务的配置参数。

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 标签筛选

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

可以根据任务标签来查询任务

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 标签批量修改

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

streamis job 可以批量修改标签

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Streamis application parameter configuration import requirement

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

In streamis application configuration, parameter configuration needs to be manually input, which is not convenient for batch configuration.

Description

The previous design of streamis was to separate the import of job applications and the setting of configuration items into two interfaces:

  1. import streamis homework: / streamis streamJobManager/job/upload POST mutilpart - form
  2. streamis homework set of configuration items: / streamis streamJobManager/config/json / {jobId} POST application - json
    The import of jobs is implemented in the form of file upload. The file must be a compressed file with the suffix zip. The compressed file contains the task definition file meta.json.
    {
    "projectName": "", # 项目名
    "jobName": "", # 作业名
    "jobType": "flink.sql", # 目前只支持flink.sql、flink.jar
    "tags": "", # 应用标签
    "description": "" # 作业描述,
    "jobContent": {
    # 不同的jobType,其内容各不相同,具体请往下看
    }
    }

Now we will incorporate the task configuration parameters into the definition file meta-. json, in the following format:
{
"projectName": "", # 项目名
"jobName": "", # 作业名
"jobType": "flink.sql", # 目前只支持flink.sql、flink.jar
"tags": "", # 应用标签
"description": "" # 作业描述,
"jobContent": {
# 不同的jobType,其内容各不相同,具体请往下看
},
"jobConfig": {
{
"wds.linkis.flink.resource": {
"wds.linkis.flink.app.parallelism":"4",
"wds.linkis.flink.jobmanager.memory":"2048",
"wds.linkis.flink.taskmanager.memory":"4096",
"wds.linkis.flink.taskmanager.numberOfTaskSlots":"2",
"wds.linkis.flink.taskmanager.cpus":"2",
"wds.linkis.rm.yarnqueue":"queue_01_02"
},
"wds.linkis.flink.custom": {

    	},
    	"wds.linkis.flink.produce": {
    		"wds.linkis.flink.checkpoint.switch":"OFF",
    		"wds.linkis.flink.alert.failure.user":"test_user",
    		"wds.linkis.flink.app.fail-restart.switch":"ON",
    		"wds.linkis.flink.app.start-auto-restore.switch":"OFF"
    	}
    }

}

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Initialization of job application through interface

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Job application initialization is encapsulated into an interface: including configuration and task upload.
job应用初始化封装成一个接口:包括配置和任务上传

Description

To provide a REST API, you need to provide the parameter job file path and project name.
提供一个REST API,需要提供参数job文件路径和项目名称

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Support multipile versions of Linkis

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

The advanced functions of Streamis are closely related to the Flink EngineConn of Linkis, but the input parameters and characteristics of the Flink EngineConn of different versions of Linkis are quite different, especially after version 1.1.1. We need to try to be compatible with different versions of Linkis.

Description

Compatible with multiple versions of Linkis in Streamis.

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Streamis task abort process adjustment

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Streamis tasks abort in two ways: snapshot generation and abort, or direct abort, which is used to forcibly shut down scenarios with data loss.
Streamis任务中止有两种方式,生成快照并中止,直接中止,后者用于强行关闭场景会有数据丢失。

Description

Add two options, when click stop, the side icon will show two prompts [snapshot and stop], [stop directly].
增加两个选项,当点击停止后,侧边图标出现两个提示【快照并停止】,【直接停止】。

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 任务配置界面的渲染和接口调整

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Streamis需要维护每个流式任务的配置信息,当前的配置信息非常多但前端显示相对固定,同时通过系统对接传递配置时,如果缺漏配置则前端界面将变成不可用的状态。

Description

重构配置界面,将界面变成动态可配的,后台配置显示的控件配置项,并为每个控件配置项设定一个默认值,控件目前只需支持INPUT, TEXT和SELECT。

后台提供四个接口,查看任务的配置项定义列表,查看当前任务的配置参数,增加/更新当前任务的配置参数。

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Optimization of stream log collector module

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Several performance problems occurred in collecting stream log:

  1. The TPS of the streaming application drops due to the bottleneck of the log collector service under high traffic conditions.
  2. Not support multi-drive storage in log module.

Description

No response

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 实现流应用自动重启并优化幂问题

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Streamis的任务可能会因为各种环境问题发生失败终止的情况(特别是目前Streamis的Flink任务不支持HA自动拉起的情况),所以要识别出Streamis任务异常终止后程序自动重启改任务。

Description

1)先尝试拿到checkpoint信息,如果没有checkpoint信息则查看任务是否有配置checkpoint策略,如果没有则忽略。

2)将checkpoint信息作为task参数放到task信息里,异步启动task任务。

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Streamis任务中止流程调整

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Streamis任务中止有两种方式,生成快照并中止,直接中止,后者用于强行关闭场景会有数据丢失。

Description

前端增加两个选项,当点击停止后,侧边图标出现两个提示【快照并停止】,【直接停止】

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 启动作业时,会自动检查yarn上同名应用

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

启动作业时,会自动检查yarn上同名应用

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Streamis AppConn access

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Currently, the Streamis project is dependent on the DSS project, but there is no project to synchronize the Streamis, and there is no permission information to synchronize the Streamis.
目前Streamis的项目是依赖DSS项目,但没有同步streamis的项目,也没有同步对应的权限信息。

Description

Implement a StreamIS related AppConn plug-in, AppConn plug-in has three specification interfaces, currently only need to implement the second specification (organizational structure specification interface) project engineering specification, Corresponding specific interface class StructureIntegrationStandard - > ProjectServcie, the interface class has four operation method, only need to implement.
ProjectCreateOperation and ProjectUpdateOperation, DSS project permissions (accessUsers, editUsers, releaseUsers) are synchronized to Streamis at project creation and update time.
实现一个streamis相关的AppConn插件,AppConn插件有三大规范接口,目前仅需要实现第二规范(组织结构规范接口)下属的项目工程规范,对应具体的接口类StructureIntegrationStandard -> ProjectServcie,该接口类有四个操作方法,仅需要实现
ProjectCreateOperation和ProjectUpdateOperation两个操作方法,在项目创建和更新时候将DSS工程的权限信息(accessUsers, editUsers, releaseUsers)同步到Streamis中来。

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Supports flink task checkpoint self-recovery

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

A problem is encountered during the process of self-recovery: If a task is restarted for several times in a row, only the checkpoint of the last time point can be obtained each time. When the restarted task exits abnormally before creating the checkpoint, the subsequent restarted task will lose data because it cannot obtain the checkpoint information.

Description

Every time a task starts successfully, used checkpoint information should not be discarded and should be passed on to the next task.
To enable checkpoint information to be passed between job tasks, we will do the following design:

  1. When a task is started, the selected checkpoint/savepoint information is saved in the jobInfo object property of the task. After the successful launch of each task, the jobInfo object is persisted.
  2. After task recovery, check checkpoint data from three places: map object, checkpoint path, and savepoint path after task reverse-parsing based on jobInfo field; The checkpoint data obtained from the three places is sorted together, taking the most recent bit of the creation/modification time.

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Automatic restart of streaming applications and optimization of power problems

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Streamis tasks can fail and terminate due to various environmental issues (especially Streamis Flink tasks that currently do not support automatic HA pull-up), so it is important to recognize that the Streamis task automatically restarts if it fails abnormally.
Streamis的任务可能会因为各种环境问题发生失败终止的情况(特别是目前Streamis的Flink任务不支持HA自动拉起的情况),所以要识别出Streamis任务异常终止后程序自动重启改任务。

Description

  1. Try to obtain the checkpoint information. If no checkpoint information is available, check whether the checkpoint policy is configured. If no checkpoint policy is configured, ignore it.
  2. Add the checkpoint information as a task parameter to the task and start the task asynchronously.
    Note: Task start jobs are unique, so restart/start operations are idempotent and only one job can start at a time
    1)先尝试拿到checkpoint信息,如果没有checkpoint信息则查看任务是否有配置checkpoint策略,如果没有则忽略。
    2)将checkpoint信息作为task参数放到task信息里,异步启动task任务。
    注:任务启动作业是惟一的,所以要求重启/启动操作的幂等性,同一时间内只能有一个作业启动

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Bug] 任务运行失败

Search before asking

  • I searched the issues and found no similar issues.

Streamis Component

streamis-job-manager

What happened + What you expected to happen

运行从一个mysql表读数据写到另外一个mysql表,如:
CREATE TABLE IF NOT EXISTS cold_45a_mod_x7(column_lgbm String, column_yyzzbh String, column_dwmc String)
WITH ('connector' = 'jdbc','url' = 'jdbc:mysql://101.30.9.14:3306/dmp','table-name' = 'tb_modeltest','username' = 'pieeco','password' = 'pi-7988100');

CREATE TABLE IF NOT EXISTS cold_45t_mod_x7(column_lgbm String, column_yyzzbh String, column_dwmc String)
WITH ('connector' = 'jdbc','url' = 'jdbc:mysql://101.30.9.14:3306/dmp','table-name' = 'tb_dh','username' = 'pieeco','password' = 'pi-7988100');

INSERT INTO cold_45t_mod_x7
SELECT column_lgbm,column_yyzzbh,column_dwmc FROM cold_45b_mod_x7;

任务运行成功,但是最后任务显示失败。

Relevent platform

linux

Reproduction script

CREATE TABLE IF NOT EXISTS cold_45a_mod_x7(column_lgbm String, column_yyzzbh String, column_dwmc String)
WITH ('connector' = 'jdbc','url' = 'jdbc:mysql://101.30.9.14:3306/dmp','table-name' = 'tb_modeltest','username' = 'pieeco','password' = 'pi-7988100');

CREATE TABLE IF NOT EXISTS cold_45t_mod_x7(column_lgbm String, column_yyzzbh String, column_dwmc String)
WITH ('connector' = 'jdbc','url' = 'jdbc:mysql://101.30.9.14:3306/dmp','table-name' = 'tb_dh','username' = 'pieeco','password' = 'pi-7988100');

INSERT INTO cold_45t_mod_x7
SELECT column_lgbm,column_yyzzbh,column_dwmc FROM cold_45b_mod_x7;

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 流式任务批量重启操作

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

目前生产的流式任务有大量的需要配置重启的场景,目前任务重启人工操作工作量大,有很高的丢数漏数的可能性,故将此功能自动化。

Description

提供批量操作的功能

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 增加flink管理ec支持

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

增加flink管理ec支持

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

streamis task list display, increase job creation time

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

The streamis task list displays the job creation time at the same time, and only the release time before

Description

No response

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Streamis automatically obtains Checkpoint file information

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

Flink applications maintained by Streamis may lose job status (data) when they fail to automatically pull up or stop active pull up. Checkpoint files are required to save and recover job status. Therefore, methods to obtain checkpoint file information are required.
Streamis维护的Flink应用作业在失败自动拉起和停止主动拉起的过程中,可能会发生作业状态(数据)丢失的现象,需要借助checkpoint文件来对作业的状态进行保存和恢复,所以要提供获取checkpoint文件信息的方法。

Description

  1. Use Linkis HttpClient, GetDirFileTrees method under FsRestfulApi entry class of linkis-storage-script-dev-server module of Linkis; Construct the corresponding client Request and Response. On the Streamis side, the default checkpoint/savepoint file root directory should be saved in configuration files. After concatenating the file with the task name, the checkpoint/savepoint root directory of the task can be obtained and used as the request parameter. Call the getDirFileTrees method to get the subdirectory tree under that directory.
  2. Obtain a list of qualified subdirectories based on the subdirectory tree. Use the latest subdirectory as the recovery directory.

1 使用Linkis的HttpClient,对应Linkis的linkis-storage-script-dev-server模块的FsRestfulApi入口类下的getDirFileTrees方法,构建相应的客户端Request和Response。Streamis侧应该通过配置文件等形式保存默认的checkpoint/savepoint文件根目录,与具体的任务名称做拼接后,得到该任务的checkpoint/savepoint根目录,并以此为请求参数入参,调用getDirFileTrees方法,获得该目录下的子目录树。
2 根据子目录树,拿到符合要求的子目录列表,取最新的子目录作为恢复目录,该子目录的信息即为最新的checkpoint文件信息。

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 日志界面显示

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

日志界面显示

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Display Yarn execution logs of streaming applications

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

On the log details page, add a select to the front of the search criteria to select the log type
日志详情页面,在查询条件最前面加一个 select,用于选择日志类型

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 采集端增加关键字过滤策略

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

流作业日志管理,采集端增加关键字过滤策略

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 支持多盘符存储流应用日志

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

流作业日志管理,支持多盘符存储流应用日志

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Streamis数据接口权限调整

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

在打通DSS权限数据后,需要利用权限数据调整streamis现有的数据接口。

总共分为发布,编辑和查看权限,其中发布和编辑权限涵盖查看权限。

Description

整理当前接口的对应权限关系

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Bug] Fix the problem in uploading dependent jar files to yarn

Search before asking

  • I searched the issues and found no similar issues.

Streamis Component

streamis-job-manager

What happened + What you expected to happen

when we define the dependent jars in job's meta.json, such as
{ "projectName": "{projectName}", "jobType": "flink.jar", "jobName": "BDP_STREMIS_DEMO", "tags": "stream-demo", "description": "BDP STRAMIS DEMO JOB", "jobContent": { "main.class.jar": "demo-stream-app-0.1.1.jar", "main.class": "com.webank.wedatasphere.stream.apps.core.entrance.StreamAppEntrance", "args": ["--kafka.bootstrap.servers", "{address}", "--user", "hadoop", "--kafka.topic", "topic"], "hdfs.jars": [], "resources": [], "dependency.jars": ["dependencies.jar"] } }
After submitting the job, we cannot find the 'dependencies.jar' in yarn container (but it exists in Linkis EngineConn certainly)

Relevent platform

Linux Centos 7

Reproduction script

None

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 上传项目资源文件添加md5

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

上传项目资源文件添加md5

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Batch restart of streaming tasks

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

At present, a large number of production streaming tasks need to configure restart scenarios. At present, manual operation of task restart is heavy, and there is a high possibility of missing data, so this function is automated.
目前生产的流式任务有大量的需要配置重启的场景,目前任务重启人工操作工作量大,有很高的丢数漏数的可能性,故将此功能自动化。

Description

Added the batch operation option. You can select multiple tasks to perform operations and connect to the batch operation interface. The batch operation interface should be made to return quickly and obtain the current status of tasks through periodic refresh in the front end.
增加批量操作的选项,可以复选多个任务进行操作,对接批量操作接口,该批量操作接口应该做成可快速返回,通过前端定时刷新获取任务当前状态。

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 配合DSS切换代理用户

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

权限管理,配合DSS切换代理用户

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Bug] When I submit my flink task I meet some errors

Search before asking

  • I searched the issues and found no similar issues.

Streamis Component

streamis-server

What happened + What you expected to happen

There are my meta.json and flink.jar (with dependencies)

Snipaste_2022-11-28_10-11-52

There are the errors of my streamis

Snipaste_2022-11-28_10-17-10

what should I do ? in this time

Relevent platform

Flink 1.12.2
Linkis 1.1.1
Dss 1.1.0

Reproduction script

Snipaste_2022-11-28_10-11-52

Snipaste_2022-11-28_10-17-10

Anything else

no

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Bug] 刚部署好streamis,streamis页面可正常打开,但在dss中创建streamis的工作流报错

Search before asking

  • I searched the issues and found no similar issues.

Streamis Component

streamis-commons

What happened + What you expected to happen

Q: [streamis]Expected BEGIN_OBJECT but was STRING at line 1 column 1 path $
背景:刚部署好streamis,streamis页面可正常打开,但在dss中创建streamis的工作流报错。
image

dss-framework-project-server.out
2022-09-07 16:04:19.120 ERROR [qtp21779075-23] org.apache.linkis.server.restful.SpringRestfulCatchAOP 71 apply - error code(错误码): 71000, error message(错误信息): 向第三方应用发起检查工程名是否重复失败,原因:IllegalStateException: Expected BEGIN_OBJECT but was STRING at line 1 column 1 path $. com.webank.wedatasphere.dss.framework.project.exception.DSSProjectErrorException: errCode: 71000 ,desc: 向第三方应用发起检查工程名是否重复失败,原因:IllegalStateException: Expected BEGIN_OBJECT but was STRING at line 1 column 1 path $ ,ip: c0 ,port: 9202 ,serviceKind: dss-framework-project-server
at com.webank.wedatasphere.dss.framework.project.service.impl.DSSFrameworkProjectServiceImpl.createProject(DSSFrameworkProjectServiceImpl.java:104) ~[dss-framework-project-server-1.1.0.jar:?]
at com.webank.wedatasphere.dss.framework.project.service.impl.DSSFrameworkProjectServiceImpl$$FastClassBySpringCGLIB$$a5dfd62a.invoke() ~[dss-framework-project-server-1.1.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:779) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:750) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:367) ~[spring-tx-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:118) ~[spring-tx-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:750) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:692) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at com.webank.wedatasphere.dss.framework.project.service.impl.DSSFrameworkProjectServiceImpl$$EnhancerBySpringCGLIB$$ebf724eb.createProject() ~[dss-framework-project-server-1.1.0.jar:?]
at com.webank.wedatasphere.dss.framework.project.restful.DSSFrameworkProjectRestfulApi.createProject(DSSFrameworkProjectRestfulApi.java:95) ~[dss-framework-project-server-1.1.0.jar:?]
at com.webank.wedatasphere.dss.framework.project.restful.DSSFrameworkProjectRestfulApi$$FastClassBySpringCGLIB$$4de6772a.invoke() ~[dss-framework-project-server-1.1.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:779) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:750) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:88) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.apache.linkis.server.restful.SpringRestfulCatchAOP$$anonfun$1.apply(SpringRestfulCatchAOP.scala:39) ~[linkis-module-1.1.1.jar:1.1.1]
at org.apache.linkis.server.restful.SpringRestfulCatchAOP$$anonfun$1.apply(SpringRestfulCatchAOP.scala:39) ~[linkis-module-1.1.1.jar:1.1.1]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
at org.apache.linkis.server.package$.catchMsg(package.scala:56) ~[linkis-module-1.1.1.jar:1.1.1]
at org.apache.linkis.server.package$.catchIt(package.scala:88) ~[linkis-module-1.1.1.jar:1.1.1]
at org.apache.linkis.server.restful.SpringRestfulCatchAOP.dealResponseRestful(SpringRestfulCatchAOP.scala:38) ~[linkis-module-1.1.1.jar:1.1.1]
at sun.reflect.GeneratedMethodAccessor134.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_201]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_201]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:644) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:633) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:750) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:750) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:692) ~[spring-aop-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at com.webank.wedatasphere.dss.framework.project.restful.DSSFrameworkProjectRestfulApi$$EnhancerBySpringCGLIB$$24bb0c7.createProject() ~[dss-framework-project-server-1.1.0.jar:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_201]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_201]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_201]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_201]
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:190) ~[spring-web-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:138) ~[spring-web-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:105) ~[spring-webmvc-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:878) ~[spring-webmvc-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:792) ~[spring-webmvc-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) ~[spring-webmvc-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1040) ~[spring-webmvc-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:943) ~[spring-webmvc-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) ~[spring-webmvc-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) ~[spring-webmvc-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:517) ~[jakarta.servlet-api-4.0.4.jar:4.0.4]
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) ~[spring-webmvc-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:584) ~[jakarta.servlet-api-4.0.4.jar:4.0.4]
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1626) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:228) ~[websocket-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.apache.linkis.server.security.SecurityFilter.doFilter(SecurityFilter.scala:104) ~[linkis-module-1.1.1.jar:1.1.1]
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) ~[spring-web-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) ~[spring-web-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) ~[spring-web-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) ~[spring-web-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) ~[spring-web-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) ~[spring-web-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:97) ~[spring-boot-actuator-2.3.12.RELEASE.jar:2.3.12.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) ~[spring-web-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) ~[spring-web-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) ~[spring-web-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) ~[jetty-security-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1435) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) ~[jetty-servlet-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1350) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.Server.handle(Server.java:516) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:388) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:633) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:380) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) ~[jetty-server-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) ~[jetty-io-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) ~[jetty-io-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) ~[jetty-io-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) ~[jetty-util-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) ~[jetty-util-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) ~[jetty-util-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) ~[jetty-util-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:383) ~[jetty-util-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:882) ~[jetty-util-9.4.42.v20210604.jar:9.4.42.v20210604]
at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1036) ~[jetty-util-9.4.42.v20210604.jar:9.4.42.v20210604]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_201]
Caused by: com.google.gson.JsonSyntaxException: java.lang.IllegalStateException: Expected BEGIN_OBJECT but was STRING at line 1 column 1 path $
at com.google.gson.Gson.fromJson(Gson.java:939) ~[gson-2.8.5.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:892) ~[gson-2.8.5.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:841) ~[gson-2.8.5.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:813) ~[gson-2.8.5.jar:?]
at com.webank.wedatasphere.dss.standard.common.entity.ref.ResponseRefBuilder$InternalResponseRefBuilder.build(ResponseRefBuilder.java:38) ~[dss-standard-common-1.1.0.jar:?]
at com.webank.wedatasphere.streamis.dss.appconn.utils.StreamisCommonUtil.getInternalResponseRef(StreamisCommonUtil.java:50) ~[?:?]
at com.webank.wedatasphere.streamis.dss.appconn.structure.project.StreamisProjectSearchOperation.searchProject(StreamisProjectSearchOperation.java:31) ~[?:?]
at com.webank.wedatasphere.streamis.dss.appconn.structure.project.StreamisProjectSearchOperation.searchProject(StreamisProjectSearchOperation.java:16) ~[?:?]
at com.webank.wedatasphere.dss.framework.project.service.impl.DSSFrameworkProjectServiceImpl.lambda$isExistSameProjectName$9(DSSFrameworkProjectServiceImpl.java:215) ~[dss-framework-project-server-1.1.0.jar:?]
at com.webank.wedatasphere.dss.framework.project.utils.ProjectOperationUtils.lambda$null$4(ProjectOperationUtils.java:54) ~[dss-framework-project-server-1.1.0.jar:?]
at com.webank.wedatasphere.dss.standard.app.structure.utils.StructureOperationUtils.tryStructureOperation(StructureOperationUtils.java:49) ~[dss-structure-integration-standard-1.1.0.jar:?]
at com.webank.wedatasphere.dss.standard.app.structure.utils.StructureOperationUtils.tryProjectOperation(StructureOperationUtils.java:65) ~[dss-structure-integration-standard-1.1.0.jar:?]
at com.webank.wedatasphere.dss.framework.project.utils.ProjectOperationUtils.lambda$null$5(ProjectOperationUtils.java:48) ~[dss-framework-project-server-1.1.0.jar:?]
at java.util.ArrayList.forEach(ArrayList.java:1257) ~[?:1.8.0_201]
at com.webank.wedatasphere.dss.framework.project.utils.ProjectOperationUtils.lambda$tryProjectOperation$6(ProjectOperationUtils.java:46) ~[dss-framework-project-server-1.1.0.jar:?]
at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) ~[?:1.8.0_201]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_201]
at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) ~[?:1.8.0_201]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_201]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_201]
at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) ~[?:1.8.0_201]
at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) ~[?:1.8.0_201]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_201]
at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) ~[?:1.8.0_201]
at com.webank.wedatasphere.dss.framework.project.utils.ProjectOperationUtils.tryProjectOperation(ProjectOperationUtils.java:44) ~[dss-framework-project-server-1.1.0.jar:?]
at com.webank.wedatasphere.dss.framework.project.service.impl.DSSFrameworkProjectServiceImpl.isExistSameProjectName(DSSFrameworkProjectServiceImpl.java:212) ~[dss-framework-project-server-1.1.0.jar:?]
at com.webank.wedatasphere.dss.framework.project.service.impl.DSSFrameworkProjectServiceImpl.createProject(DSSFrameworkProjectServiceImpl.java:102) ~[dss-framework-project-server-1.1.0.jar:?]
... 113 more
Caused by: java.lang.IllegalStateException: Expected BEGIN_OBJECT but was STRING at line 1 column 1 path $
at com.google.gson.stream.JsonReader.beginObject(JsonReader.java:385) ~[gson-2.8.5.jar:?]
at com.google.gson.internal.bind.MapTypeAdapterFactory$Adapter.read(MapTypeAdapterFactory.java:183) ~[gson-2.8.5.jar:?]
at com.google.gson.internal.bind.MapTypeAdapterFactory$Adapter.read(MapTypeAdapterFactory.java:145) ~[gson-2.8.5.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:927) ~[gson-2.8.5.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:892) ~[gson-2.8.5.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:841) ~[gson-2.8.5.jar:?]
at com.google.gson.Gson.fromJson(Gson.java:813) ~[gson-2.8.5.jar:?]
at com.webank.wedatasphere.dss.standard.common.entity.ref.ResponseRefBuilder$InternalResponseRefBuilder.build(ResponseRefBuilder.java:38) ~[dss-standard-common-1.1.0.jar:?]
at com.webank.wedatasphere.streamis.dss.appconn.utils.StreamisCommonUtil.getInternalResponseRef(StreamisCommonUtil.java:50) ~[?:?]
at com.webank.wedatasphere.streamis.dss.appconn.structure.project.StreamisProjectSearchOperation.searchProject(StreamisProjectSearchOperation.java:31) ~[?:?]
at com.webank.wedatasphere.streamis.dss.appconn.structure.project.StreamisProjectSearchOperation.searchProject(StreamisProjectSearchOperation.java:16) ~[?:?]
at com.webank.wedatasphere.dss.framework.project.service.impl.DSSFrameworkProjectServiceImpl.lambda$isExistSameProjectName$9(DSSFrameworkProjectServiceImpl.java:215) ~[dss-framework-project-server-1.1.0.jar:?]
at com.webank.wedatasphere.dss.framework.project.utils.ProjectOperationUtils.lambda$null$4(ProjectOperationUtils.java:54) ~[dss-framework-project-server-1.1.0.jar:?]
at com.webank.wedatasphere.dss.standard.app.structure.utils.StructureOperationUtils.tryStructureOperation(StructureOperationUtils.java:49) ~[dss-structure-integration-standard-1.1.0.jar:?]
at com.webank.wedatasphere.dss.standard.app.structure.utils.StructureOperationUtils.tryProjectOperation(StructureOperationUtils.java:65) ~[dss-structure-integration-standard-1.1.0.jar:?]
at com.webank.wedatasphere.dss.framework.project.utils.ProjectOperationUtils.lambda$null$5(ProjectOperationUtils.java:48) ~[dss-framework-project-server-1.1.0.jar:?]
at java.util.ArrayList.forEach(ArrayList.java:1257) ~[?:1.8.0_201]
at com.webank.wedatasphere.dss.framework.project.utils.ProjectOperationUtils.lambda$tryProjectOperation$6(ProjectOperationUtils.java:46) ~[dss-framework-project-server-1.1.0.jar:?]
at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) ~[?:1.8.0_201]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_201]
at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) ~[?:1.8.0_201]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_201]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_201]
at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) ~[?:1.8.0_201]
at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) ~[?:1.8.0_201]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_201]
at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) ~[?:1.8.0_201]
at com.webank.wedatasphere.dss.framework.project.utils.ProjectOperationUtils.tryProjectOperation(ProjectOperationUtils.java:44) ~[dss-framework-project-server-1.1.0.jar:?]
at com.webank.wedatasphere.dss.framework.project.service.impl.DSSFrameworkProjectServiceImpl.isExistSameProjectName(DSSFrameworkProjectServiceImpl.java:212) ~[dss-framework-project-server-1.1.0.jar:?]
at com.webank.wedatasphere.dss.framework.project.service.impl.DSSFrameworkProjectServiceImpl.createProject(DSSFrameworkProjectServiceImpl.java:102) ~[dss-framework-project-server-1.1.0.jar:?]
... 113 more

提问人微信:M.旭东
提问时间:2022-09-07

Relevent platform

·

Reproduction script

·

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Bug] DSS集成streamis打开首页老是报工程名为空的错误

Search before asking

  • I searched the issues and found no similar issues.

Streamis Component

streamis-server, streamis-web

What happened + What you expected to happen

93d62e48745ca0400bd331be20d032e

593c810cfd6fa2256695b6411f7d8b7

Relevent platform

linkis -1.2.0
streamis-0.2.0
flink-1.12.2
cdh5.12.1

Reproduction script

image

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Bug] Run ClassNotFoundException with logging after compiling

Search before asking

  • I searched the issues and found no similar issues.

Streamis Component

streamis-server

What happened + What you expected to happen

Error starting ApplicationContext. To display the conditions report re-run your application with 'debug' enabled.
2022-07-14 21:17:14.859 [ERROR] [main ] o.s.b.SpringApplication (834) [reportFailure] - Application run failed org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'restfulCatchAOP' defined in URL [jar:file:/home/hadoop/application/streamis/streamis/streamis-server/lib/dss-common-1.0.1.jar!/com/webank/wedatasphere/dss/common/RestfulCatchAOP.class]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.webank.wedatasphere.dss.common.RestfulCatchAOP]: Constructor threw exception; nested exception is java.lang.NoClassDefFoundError: org/apache/linkis/common/utils/Logging$class
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateBean(AbstractAutowireCapableBeanFactory.java:1323) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1218) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:556) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:516) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:324) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:322) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:897) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:879) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:551) ~[spring-context-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:143) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE]
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:755) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE]
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:747) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE]
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:402) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE]
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312) ~[spring-boot-2.3.12.RELEASE.jar:2.3.12.RELEASE]
at org.apache.linkis.DataWorkCloudApplication.main(DataWorkCloudApplication.java:121) ~[linkis-module-1.1.1.jar:1.1.1]
Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.webank.wedatasphere.dss.common.RestfulCatchAOP]: Constructor threw exception; nested exception is java.lang.NoClassDefFoundError: org/apache/linkis/common/utils/Logging$class
at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:217) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:87) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateBean(AbstractAutowireCapableBeanFactory.java:1315) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
... 16 more
Caused by: java.lang.NoClassDefFoundError: org/apache/linkis/common/utils/Logging$class
at com.webank.wedatasphere.dss.common.RestfulCatchAOP.(RestfulCatchAOP.scala:28) ~[dss-common-1.0.1.jar:?]
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_202]
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:1.8.0_202]
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:1.8.0_202]
at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[?:1.8.0_202]
at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:204) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:87) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateBean(AbstractAutowireCapableBeanFactory.java:1315) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
... 16 more
Caused by: java.lang.ClassNotFoundException: org.apache.linkis.common.utils.Logging$class
at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_202]
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_202]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) ~[?:1.8.0_202]
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_202]
at com.webank.wedatasphere.dss.common.RestfulCatchAOP.(RestfulCatchAOP.scala:28) ~[dss-common-1.0.1.jar:?]
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_202]
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:1.8.0_202]
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:1.8.0_202]
at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[?:1.8.0_202]
at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:204) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:87) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateBean(AbstractAutowireCapableBeanFactory.java:1315) ~[spring-beans-5.2.15.RELEASE.jar:5.2.15.RELEASE]
... 16 more

Relevent platform

Dependencies

Reproduction script

Run after compiling the release-0.2.0 branch

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Bug] 任务配置保存失败

Search before asking

  • I searched the issues and found no similar issues.

Streamis Component

streamis-job-launcher

What happened + What you expected to happen

image

配置任务参数,保存失败,日志如下

2022-03-18 12:03:04.554 ERROR [qtp1016689071-23] org.apache.linkis.server.restful.SpringRestfulCatchAOP 82 apply - operation failed(操作失败)s org.springframework.dao.DataIntegrityViolationException: 
### Error updating database.  Cause: java.sql.SQLException: Field 'id' doesn't have a default value
### The error may exist in URL [jar:file:/home/DSS101/DSS-LinkisFamilyMeals20220214/dss/dss-appconns/streamis/streamis-server/lib/streamis-job-launcher-base-0.1.0.jar!/com/webank/wedatasphere/streamis/jobmanager/launcher/dao/impl/ConfigMapper.xml]
### The error may involve com.webank.wedatasphere.streamis.jobmanager.launcher.dao.ConfigMapper.insertValue-Inline
### The error occurred while setting parameters
### SQL: INSERT INTO linkis_stream_configuration_config_value(`configkey_id`,`config_value`,`type`,`job_id`,`job_name`,`config_key`)         VALUES(?,?,?,?,?,?)
### Cause: java.sql.SQLException: Field 'id' doesn't have a default value
; Field 'id' doesn't have a default value; nested exception is java.sql.SQLException: Field 'id' doesn't have a default value
        at org.springframework.jdbc.support.SQLErrorCodeSQLExceptionTranslator.doTranslate(SQLErrorCodeSQLExceptionTranslator.java:251) ~[spring-jdbc-5.2.15.RELEASE.jar:5.2.15.RELEASE]
        at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72) ~[spring-jdbc-5.2.15.RELEASE.jar:5.2.15.RELEASE]
        at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) ~[mybatis-spring-2.0.5.jar:2.0.5]
        at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) ~[mybatis-spring-2.0.5.jar:2.0.5]
        at com.sun.proxy.$Proxy119.insert(Unknown Source) ~[?:?]
        at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) ~[mybatis-spring-2.0.5.jar:2.0.5]
        at com.baomidou.mybatisplus.core.override.MybatisMapperMethod.execute(MybatisMapperMethod.java:60) ~[mybatis-plus-core-3.4.1.jar:3.4.1]
        at com.baomidou.mybatisplus.core.override.MybatisMapperProxy$PlainMethodInvoker.invoke(MybatisMapperProxy.java:148) ~[mybatis-plus-core-3.4.1.jar:3.4.1]
        at com.baomidou.mybatisplus.core.override.MybatisMapperProxy.invoke(MybatisMapperProxy.java:89) ~[mybatis-plus-core-3.4.1.jar:3.4.1]
        at com.sun.proxy.$Proxy124.insertValue(Unknown Source) ~[?:?]
        at com.webank.wedatasphere.streamis.jobmanager.launcher.service.ConfigurationService$$anonfun$addKeyValue$1.apply(ConfigurationService.scala:61) ~[streamis-job-launcher-service-0.1.0.jar:?]
        at com.webank.wedatasphere.streamis.jobmanager.launcher.service.ConfigurationService$$anonfun$addKeyValue$1.apply(ConfigurationService.scala:53) ~[streamis-job-launcher-service-0.1.0.jar:?]
        at scala.collection.Iterator$class.foreach(Iterator.scala:891) ~[scala-library-2.11.12.jar:?]
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1334) ~[scala-library-2.11.12.jar:?]
        at scala.collection.IterableLike$class.foreach(IterableLike.scala:72) ~[scala-library-2.11.12.jar:?]
        at scala.collection.AbstractIterable.foreach(Iterable.scala:54) ~[scala-library-2.11.12.jar:?]
        at com.webank.wedatasphere.streamis.jobmanager.launcher.service.ConfigurationService.addKeyValue(ConfigurationService.scala:53) ~[streamis-job-launcher-service-0.1.0.jar:?]
        at com.webank.wedatasphere.streamis.jobmanager.launcher.service.ConfigurationService$$FastClassBySpringCGLIB$$7d802c1a.invoke(<generated>) ~[streamis-job-launcher-service-0.1.0.jar:?]
        at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.15.RELEASE.jar:5.2.15.RELEASE]
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:367) ~[spring-tx-5.2.15.RELEASE.jar:5.2.15.RELEASE]
        at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:118) ~[spring-tx-5.2.15.RELEASE.jar:5.2.15.RELEASE]
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at com.webank.wedatasphere.streamis.jobmanager.launcher.service.ConfigurationService$$EnhancerBySpringCGLIB$$252affcd.addKeyValue(<generated>) ~[streamis-job-launcher-service-0.1.0.jar:?]
        at com.webank.wedatasphere.streamis.jobmanager.restful.api.ConfigurationRestfulApi.saveFullTree(ConfigurationRestfulApi.java:83) ~[streamis-jobmanager-server-0.1.0.jar:?]
        at com.webank.wedatasphere.streamis.jobmanager.restful.api.ConfigurationRestfulApi$$FastClassBySpringCGLIB$$d2520582.invoke(<generated>) ~[streamis-jobmanager-server-0.1.0.jar:?]
        at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.15.RELEASE.jar:5.2.15.RELEASE]
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:88) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.apache.linkis.server.restful.SpringRestfulCatchAOP$$anonfun$1.apply(SpringRestfulCatchAOP.scala:39) ~[linkis-module-1.0.3.jar:1.0.3]
        at org.apache.linkis.server.restful.SpringRestfulCatchAOP$$anonfun$1.apply(SpringRestfulCatchAOP.scala:39) ~[linkis-module-1.0.3.jar:1.0.3]
        at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) [linkis-common-1.0.3.jar:1.0.3]
        at org.apache.linkis.server.package$.catchMsg(package.scala:56) [linkis-module-1.0.3.jar:1.0.3]
        at org.apache.linkis.server.package$.catchIt(package.scala:88) [linkis-module-1.0.3.jar:1.0.3]
        at org.apache.linkis.server.restful.SpringRestfulCatchAOP.dealResponseRestful(SpringRestfulCatchAOP.scala:38) [linkis-module-1.0.3.jar:1.0.3]
        at sun.reflect.GeneratedMethodAccessor111.invoke(Unknown Source) ~[?:?]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_162]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_162]
        at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:644) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:633) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at com.webank.wedatasphere.streamis.jobmanager.restful.api.ConfigurationRestfulApi$$EnhancerBySpringCGLIB$$3f128e48.saveFullTree(<generated>) [streamis-jobmanager-server-0.1.0.jar:?]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_162]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_162]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_162]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_162]
        at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:190) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:138) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:105) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:878) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:792) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1040) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:943) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:517) [jakarta.servlet-api-4.0.4.jar:4.0.4]
        at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:584) [jakarta.servlet-api-4.0.4.jar:4.0.4]
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:852) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) [websocket-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.apache.linkis.server.security.SecurityFilter.doFilter(SecurityFilter.scala:104) [linkis-module-1.0.3.jar:1.0.3]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:93) [spring-boot-actuator-2.3.2.RELEASE.jar:2.3.2.RELEASE]
        at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:542) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:536) [jetty-security-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1581) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1307) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:482) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1549) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1204) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.Server.handle(Server.java:494) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:374) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:268) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) [jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) [jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) [jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) [jetty-util-9.4.30.v20200611.jar:9.4.30.v20200611]
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) [jetty-util-9.4.30.v20200611.jar:9.4.30.v20200611]
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) [jetty-util-9.4.30.v20200611.jar:9.4.30.v20200611]
        at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) [jetty-util-9.4.30.v20200611.jar:9.4.30.v20200611]
        at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) [jetty-util-9.4.30.v20200611.jar:9.4.30.v20200611]
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) [jetty-util-9.4.30.v20200611.jar:9.4.30.v20200611]
        at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) [jetty-util-9.4.30.v20200611.jar:9.4.30.v20200611]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_162]
Caused by: java.sql.SQLException: Field 'id' doesn't have a default value
        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:965) ~[mysql-connector-java-5.1.49.jar:5.1.49]
        at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3933) ~[mysql-connector-java-5.1.49.jar:5.1.49]
        at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3869) ~[mysql-connector-java-5.1.49.jar:5.1.49]
        at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2524) ~[mysql-connector-java-5.1.49.jar:5.1.49]
        at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2675) ~[mysql-connector-java-5.1.49.jar:5.1.49]
        at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2465) ~[mysql-connector-java-5.1.49.jar:5.1.49]
        at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1915) ~[mysql-connector-java-5.1.49.jar:5.1.49]
        at com.mysql.jdbc.PreparedStatement.execute(PreparedStatement.java:1254) ~[mysql-connector-java-5.1.49.jar:5.1.49]
        at org.apache.commons.dbcp.DelegatingPreparedStatement.execute(DelegatingPreparedStatement.java:172) ~[commons-dbcp-1.4.jar:1.4]
        at org.apache.commons.dbcp.DelegatingPreparedStatement.execute(DelegatingPreparedStatement.java:172) ~[commons-dbcp-1.4.jar:1.4]
        at org.apache.commons.dbcp.DelegatingPreparedStatement.execute(DelegatingPreparedStatement.java:172) ~[commons-dbcp-1.4.jar:1.4]
        at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) ~[mybatis-3.5.6.jar:3.5.6]
        at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) ~[mybatis-3.5.6.jar:3.5.6]
        at com.baomidou.mybatisplus.core.executor.MybatisSimpleExecutor.doUpdate(MybatisSimpleExecutor.java:56) ~[mybatis-plus-core-3.4.1.jar:3.4.1]
        at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) ~[mybatis-3.5.6.jar:3.5.6]
        at com.baomidou.mybatisplus.core.executor.MybatisCachingExecutor.update(MybatisCachingExecutor.java:85) ~[mybatis-plus-core-3.4.1.jar:3.4.1]
        at sun.reflect.GeneratedMethodAccessor149.invoke(Unknown Source) ~[?:?]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_162]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_162]
        at org.apache.ibatis.plugin.Plugin.invoke(Plugin.java:63) ~[mybatis-3.5.6.jar:3.5.6]
        at com.sun.proxy.$Proxy169.update(Unknown Source) ~[?:?]
        at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) ~[mybatis-3.5.6.jar:3.5.6]
        at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) ~[mybatis-3.5.6.jar:3.5.6]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_162]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_162]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_162]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_162]
        at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ~[mybatis-spring-2.0.5.jar:2.0.5]
        ... 117 more

Relevent platform

streamis 0.1.0

Reproduction script

配置任务并保存就会触发

Anything else

看了下 ddl,这张表 linkis_stream_configuration_config_value 中 id 字段不是自增的。

DROP TABLE IF EXISTS `linkis_stream_configuration_config_value`;
CREATE TABLE `linkis_stream_configuration_config_value`  (
  `id` bigint(20) NOT NULL,
  `configkey_id` bigint(20) NULL DEFAULT NULL,
  `config_value` varchar(50) CHARACTER SET utf8 COLLATE utf8_general_ci NULL DEFAULT NULL,
  `type` int(10) NULL DEFAULT NULL,
  `job_id` bigint(20) NULL DEFAULT NULL,
  `job_name` varchar(50) CHARACTER SET utf8 COLLATE utf8_general_ci NULL DEFAULT NULL,
  `config_key` varchar(50) CHARACTER SET utf8 COLLATE utf8_general_ci NULL DEFAULT NULL,
  PRIMARY KEY (`id`) USING BTREE,
  INDEX `key`(`config_key`) USING BTREE,
  INDEX `keyid`(`configkey_id`) USING BTREE
) ENGINE = InnoDB CHARACTER SET = utf8 COLLATE = utf8_general_ci COMMENT = '配置信息' ROW_FORMAT = Compact;

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Streamis application initialization supports online application import and versioning

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

When upgrading the FLINK master JAR package or changing startup parameters, you need to re-import the job. Currently, streamis cannot import the latest application configurations online for flink applications that are already running, so you need to kill the application before the import. For applications that consume a large amount of TPS, consumption accumulation or meltdown will occur during the re-import process of kill application.
In addition, the streamis does not have version management for the application configuration. If the application starts abnormally after the configuration is updated, the application configuration of the previous version cannot be quickly rolled back.

Description

streamis application configuration initialization supports online application import and takes effect after restart.
streamis application configurations and user-defined parameters can be modified online and take effect after restart.

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] flink任务增加分离式管理模式

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

flink任务增加分离式管理模式

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] 上传job zip包自动清理

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

streamis 上传的job后 ,自动清晰服务器的缓存zip包。

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

[Feature] Streamis的AppConn接入

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

No response

Description

目前Streamis的项目是依赖DSS项目,但没有同步streamis的项目,也没有同步对应的权限信息。

需求内容:

实现一个streamis相关的AppConn插件,AppConn插件有三大规范接口,目前仅需要实现第二规范(组织结构规范接口)下属的项目工程规范,对应具体的接口类StructureIntegrationStandard -> ProjectServcie,该接口类有四个操作方法,仅需要实现

ProjectCreateOperation和ProjectUpdateOperation两个操作方法,在项目创建和更新时候将DSS工程的权限信息(accessUsers, editUsers, releaseUsers)同步到Streamis中来。

Use case

No response

solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Who is using Streamis?

Who is using Streamis

We’d like to thank everyone in this community for your constant support of Streamis. We’re confident that, with our effort and your support, this community could grow more prosperous and serve a greater number of users.

Our Intentions

  1. Streamis cannot grow without the voice from the community.
  2. Streamis desires more contributions from more partners.
  3. We hope to get closer to the practical scenarios to plan the roadmap for future releases of Streamis.

Our Expectation

We would appreciate it if you could leave us a comment with the following information:

  • Your company, colleage or any other organizations
  • Your city & nation
  • Your contact infomation: Weibo, email or WeChat
  • Your practical business scenarios

Sample:

  • Organization:Webank
  • Location:Shenzhen, China
  • Contact information:[email protected]
  • Business scenario:As a streaming application development and management system, it integrates with DSS and Linkis, provides easier way to develop and manage streaming applications.

Thanks again!!!
Your support is the biggest motivator for facilitating the progress of open-sourcing the Streamis!

Yours sincerely,
Streamis Team


谁在使用Streamis

感谢社区每一位关注并使用 Streamis 的伙伴。我们会持续投入,争取将 Streamis 社区和生态打造的更加繁荣,让更多伙伴从 Streamis 中受益。

此Issue初衷

  1. Streamis 的成长,离不开社区的声音
  2. Streamis 需要更多伙伴参与进来一起贡献
  3. Streamis 作为流式应用开发管理系统,提供了非常多的企业级特性,我们希望了解大家的实际应用场景,以便规划 Streamis 的后续版本

期待

期望您提交一条评论, 内容包括:

  • 您所在公司、学校或组织
  • 您所在的国家和城市
  • 您的联系方式: 微博、邮箱或微信
  • 您的实际业务场景

示例:

  • 公司:微众银行
  • 地点:**深圳
  • 联系方式:[email protected]
  • 业务场景:作为流式应用开发管理系统,集成打通 DSS 和 Linkis,为用户提供更加简单的方式去开发和管理流式应用。

再次感谢!!!
您的支持是 Streamis 开源前进的最大动力!!

Streamis 团队拜上

[Bug] flink任务启动异常

Search before asking

  • I searched the issues and found no similar issues.

Streamis Component

streamis-job-manager

What happened + What you expected to happen

导入任务后,点击启动异常
image

`
2022-04-18 14:34:28.822 [ERROR] [qtp1462809875-161 ] c.w.w.s.j.r.a.JobRestfulApi (129) [executeJob] - hadoop execute job 1 failed! java.lang.reflect.UndeclaredThrowableException: null
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:759) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:367) ~[spring-tx-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:118) ~[spring-tx-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at com.webank.wedatasphere.streamis.jobmanager.manager.service.TaskService$$EnhancerBySpringCGLIB$$6e90a67a.executeJob() ~[streamis-job-manager-service-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.restful.api.JobRestfulApi.executeJob(JobRestfulApi.java:127) [streamis-jobmanager-server-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.restful.api.JobRestfulApi$$FastClassBySpringCGLIB$$b3f0fd49.invoke() [streamis-jobmanager-server-0.1.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) [spring-core-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:88) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.apache.linkis.server.restful.SpringRestfulCatchAOP$$anonfun$1.apply(SpringRestfulCatchAOP.scala:39) [linkis-module-1.0.3.jar:1.0.3]
at org.apache.linkis.server.restful.SpringRestfulCatchAOP$$anonfun$1.apply(SpringRestfulCatchAOP.scala:39) [linkis-module-1.0.3.jar:1.0.3]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) [linkis-common-1.0.3.jar:1.0.3]
at org.apache.linkis.server.package$.catchMsg(package.scala:56) [linkis-module-1.0.3.jar:1.0.3]
at org.apache.linkis.server.package$.catchIt(package.scala:88) [linkis-module-1.0.3.jar:1.0.3]
at org.apache.linkis.server.restful.SpringRestfulCatchAOP.dealResponseRestful(SpringRestfulCatchAOP.scala:38) [linkis-module-1.0.3.jar:1.0.3]
at sun.reflect.GeneratedMethodAccessor70.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_161]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:644) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:633) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at com.webank.wedatasphere.streamis.jobmanager.restful.api.JobRestfulApi$$EnhancerBySpringCGLIB$$db423817.executeJob() [streamis-jobmanager-server-0.1.0.jar:?]
at sun.reflect.GeneratedMethodAccessor214.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_161]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:190) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:138) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:105) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:878) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:792) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1040) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:943) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) [javax.servlet-api-3.1.0.jar:3.1.0]
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) [javax.servlet-api-3.1.0.jar:3.1.0]
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:852) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) [websocket-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.apache.linkis.server.security.SecurityFilter.doFilter(SecurityFilter.scala:104) [linkis-module-1.0.3.jar:1.0.3]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:93) [spring-boot-actuator-2.3.2.RELEASE.jar:2.3.2.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:542) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:536) [jetty-security-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1581) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1307) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:482) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1549) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1204) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.Server.handle(Server.java:494) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:374) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:268) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) [jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) [jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) [jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) [jetty-util-9.4.30.v20200611.jar:9.4.30.v20200611]
at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) [jetty-util-9.4.30.v20200611.jar:9.4.30.v20200611]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
Caused by: org.apache.linkis.ujes.client.exception.UJESJobException: errCode: 20300 ,desc: Cannot get applicationId from EngineConn ServiceInstance(linkis-cg-engineconn, t3-dev-cq-ecs-dtpbu-realtime-cdh-mansger-01:45422). ,ip: dev-cq-ecs-dtpbu-realtime-cdh-mansger-01 ,port: 9400 ,serviceKind: streamis-server
at org.apache.linkis.computation.client.operator.impl.EngineConnApplicationInfoOperator$$anonfun$resultToObject$1.apply(EngineConnApplicationInfoOperator.scala:32) ~[linkis-computation-client-1.0.3.jar:1.0.3]
at org.apache.linkis.computation.client.operator.impl.EngineConnApplicationInfoOperator$$anonfun$resultToObject$1.apply(EngineConnApplicationInfoOperator.scala:32) ~[linkis-computation-client-1.0.3.jar:1.0.3]
at scala.Option.getOrElse(Option.scala:121) ~[scala-library-2.11.12.jar:?]
at org.apache.linkis.computation.client.operator.impl.EngineConnApplicationInfoOperator.resultToObject(EngineConnApplicationInfoOperator.scala:32) ~[linkis-computation-client-1.0.3.jar:1.0.3]
at org.apache.linkis.computation.client.operator.impl.EngineConnApplicationInfoOperator.resultToObject(EngineConnApplicationInfoOperator.scala:25) ~[linkis-computation-client-1.0.3.jar:1.0.3]
at org.apache.linkis.computation.client.operator.OnceJobOperator$class.apply(OnceJobOperator.scala:79) ~[linkis-computation-client-1.0.3.jar:1.0.3]
at org.apache.linkis.computation.client.operator.impl.EngineConnApplicationInfoOperator.apply(EngineConnApplicationInfoOperator.scala:25) ~[linkis-computation-client-1.0.3.jar:1.0.3]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.SimpleFlinkJobManager$$anonfun$1.apply(SimpleFlinkJobManager.scala:86) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.SimpleFlinkJobManager$$anonfun$1.apply(SimpleFlinkJobManager.scala:86) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.0.3.jar:1.0.3]
at org.apache.linkis.common.utils.RetryHandler$class.retry(RetryHandler.scala:55) ~[linkis-common-1.0.3.jar:1.0.3]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.SimpleFlinkJobManager$$anon$1.retry(SimpleFlinkJobManager.scala:81) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.SimpleFlinkJobManager.fetchApplicationInfo(SimpleFlinkJobManager.scala:86) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.SimpleFlinkJobManager.createJobInfo(SimpleFlinkJobManager.scala:71) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.FlinkJobManager$$anonfun$1.apply(FlinkJobManager.scala:63) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.FlinkJobManager$$anonfun$1.apply(FlinkJobManager.scala:63) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.0.3.jar:1.0.3]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.FlinkJobManager$class.launch(FlinkJobManager.scala:63) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.SimpleFlinkJobManager.launch(SimpleFlinkJobManager.scala:34) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.manager.service.TaskService.executeJob(TaskService.scala:78) ~[streamis-job-manager-service-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.manager.service.TaskService$$FastClassBySpringCGLIB$$d96f76ca.invoke() ~[streamis-job-manager-service-0.1.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
... 93 more

`

Relevent platform

streamis

Reproduction script

`
2022-04-18 14:34:28.822 [ERROR] [qtp1462809875-161 ] c.w.w.s.j.r.a.JobRestfulApi (129) [executeJob] - hadoop execute job 1 failed! java.lang.reflect.UndeclaredThrowableException: null
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:759) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:367) ~[spring-tx-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:118) ~[spring-tx-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at com.webank.wedatasphere.streamis.jobmanager.manager.service.TaskService$$EnhancerBySpringCGLIB$$6e90a67a.executeJob() ~[streamis-job-manager-service-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.restful.api.JobRestfulApi.executeJob(JobRestfulApi.java:127) [streamis-jobmanager-server-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.restful.api.JobRestfulApi$$FastClassBySpringCGLIB$$b3f0fd49.invoke() [streamis-jobmanager-server-0.1.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) [spring-core-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:88) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.apache.linkis.server.restful.SpringRestfulCatchAOP$$anonfun$1.apply(SpringRestfulCatchAOP.scala:39) [linkis-module-1.0.3.jar:1.0.3]
at org.apache.linkis.server.restful.SpringRestfulCatchAOP$$anonfun$1.apply(SpringRestfulCatchAOP.scala:39) [linkis-module-1.0.3.jar:1.0.3]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) [linkis-common-1.0.3.jar:1.0.3]
at org.apache.linkis.server.package$.catchMsg(package.scala:56) [linkis-module-1.0.3.jar:1.0.3]
at org.apache.linkis.server.package$.catchIt(package.scala:88) [linkis-module-1.0.3.jar:1.0.3]
at org.apache.linkis.server.restful.SpringRestfulCatchAOP.dealResponseRestful(SpringRestfulCatchAOP.scala:38) [linkis-module-1.0.3.jar:1.0.3]
at sun.reflect.GeneratedMethodAccessor70.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_161]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:644) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:633) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) [spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at com.webank.wedatasphere.streamis.jobmanager.restful.api.JobRestfulApi$$EnhancerBySpringCGLIB$$db423817.executeJob() [streamis-jobmanager-server-0.1.0.jar:?]
at sun.reflect.GeneratedMethodAccessor214.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_161]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:190) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:138) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:105) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:878) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:792) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1040) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:943) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) [javax.servlet-api-3.1.0.jar:3.1.0]
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) [spring-webmvc-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) [javax.servlet-api-3.1.0.jar:3.1.0]
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:852) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) [websocket-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.apache.linkis.server.security.SecurityFilter.doFilter(SecurityFilter.scala:104) [linkis-module-1.0.3.jar:1.0.3]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:93) [spring-boot-actuator-2.3.2.RELEASE.jar:2.3.2.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1591) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:542) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:536) [jetty-security-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1581) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1307) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:482) [jetty-servlet-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1549) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1204) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.Server.handle(Server.java:494) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:374) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:268) [jetty-server-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) [jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) [jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) [jetty-io-9.4.20.v20190813.jar:9.4.20.v20190813]
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) [jetty-util-9.4.30.v20200611.jar:9.4.30.v20200611]
at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) [jetty-util-9.4.30.v20200611.jar:9.4.30.v20200611]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
Caused by: org.apache.linkis.ujes.client.exception.UJESJobException: errCode: 20300 ,desc: Cannot get applicationId from EngineConn ServiceInstance(linkis-cg-engineconn, t3-dev-cq-ecs-dtpbu-realtime-cdh-mansger-01:45422). ,ip: dev-cq-ecs-dtpbu-realtime-cdh-mansger-01 ,port: 9400 ,serviceKind: streamis-server
at org.apache.linkis.computation.client.operator.impl.EngineConnApplicationInfoOperator$$anonfun$resultToObject$1.apply(EngineConnApplicationInfoOperator.scala:32) ~[linkis-computation-client-1.0.3.jar:1.0.3]
at org.apache.linkis.computation.client.operator.impl.EngineConnApplicationInfoOperator$$anonfun$resultToObject$1.apply(EngineConnApplicationInfoOperator.scala:32) ~[linkis-computation-client-1.0.3.jar:1.0.3]
at scala.Option.getOrElse(Option.scala:121) ~[scala-library-2.11.12.jar:?]
at org.apache.linkis.computation.client.operator.impl.EngineConnApplicationInfoOperator.resultToObject(EngineConnApplicationInfoOperator.scala:32) ~[linkis-computation-client-1.0.3.jar:1.0.3]
at org.apache.linkis.computation.client.operator.impl.EngineConnApplicationInfoOperator.resultToObject(EngineConnApplicationInfoOperator.scala:25) ~[linkis-computation-client-1.0.3.jar:1.0.3]
at org.apache.linkis.computation.client.operator.OnceJobOperator$class.apply(OnceJobOperator.scala:79) ~[linkis-computation-client-1.0.3.jar:1.0.3]
at org.apache.linkis.computation.client.operator.impl.EngineConnApplicationInfoOperator.apply(EngineConnApplicationInfoOperator.scala:25) ~[linkis-computation-client-1.0.3.jar:1.0.3]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.SimpleFlinkJobManager$$anonfun$1.apply(SimpleFlinkJobManager.scala:86) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.SimpleFlinkJobManager$$anonfun$1.apply(SimpleFlinkJobManager.scala:86) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.0.3.jar:1.0.3]
at org.apache.linkis.common.utils.RetryHandler$class.retry(RetryHandler.scala:55) ~[linkis-common-1.0.3.jar:1.0.3]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.SimpleFlinkJobManager$$anon$1.retry(SimpleFlinkJobManager.scala:81) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.SimpleFlinkJobManager.fetchApplicationInfo(SimpleFlinkJobManager.scala:86) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.SimpleFlinkJobManager.createJobInfo(SimpleFlinkJobManager.scala:71) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.FlinkJobManager$$anonfun$1.apply(FlinkJobManager.scala:63) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.FlinkJobManager$$anonfun$1.apply(FlinkJobManager.scala:63) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.0.3.jar:1.0.3]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.FlinkJobManager$class.launch(FlinkJobManager.scala:63) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.launcher.linkis.manager.SimpleFlinkJobManager.launch(SimpleFlinkJobManager.scala:34) ~[streamis-job-launcher-linkis-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.manager.service.TaskService.executeJob(TaskService.scala:78) ~[streamis-job-manager-service-0.1.0.jar:?]
at com.webank.wedatasphere.streamis.jobmanager.manager.service.TaskService$$FastClassBySpringCGLIB$$d96f76ca.invoke() ~[streamis-job-manager-service-0.1.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.2.15.RELEASE.jar:5.2.15.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) ~[spring-aop-5.2.8.RELEASE.jar:5.2.8.RELEASE]
... 93 more

`

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.