Comments (2)
can you find any log like this:
pipeline({}) start with savePoint on checkPointId({})
Create CheckpointCoordinator for job({}@{}) with plan({})
Restore job({}@{}) with checkpoint({}), data: {}
from seatunnel.
有的,如下日志
2024-07-25 13:59:48,030 INFO [o.a.s.e.s.m.JobMaster ] [seatunnel-coordinator-service-890] - Init JobMaster for Job sync-smart-ops-sheng-dev-job1 (2000012)
2024-07-25 13:59:48,030 INFO [o.a.s.e.s.m.JobMaster ] [seatunnel-coordinator-service-890] - Job sync-smart-ops-sheng-dev-job1 (2000012) needed jar urls [file:/mnt/sdb1/apache-seatunnel-2.3.5/connectors/connector-starrocks-2.3.5.jar, file:/mnt/sdb1/apache-seatunnel-2.3.5/connectors/connector-cdc-mysql-2.3.5.jar]
2024-07-25 13:59:48,031 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-890] - Create classloader for job 2000012 with jars [file:/mnt/sdb1/apache-seatunnel-2.3.5/connectors/connector-starrocks-2.3.5.jar, file:/mnt/sdb1/apache-seatunnel-2.3.5/connectors/connector-cdc-mysql-2.3.5.jar]
2024-07-25 13:59:48,084 INFO [.c.c.DefaultClassLoaderService] [seatunnel-coordinator-service-890] - Release classloader for job 2000012 with jars [file:/mnt/sdb1/apache-seatunnel-2.3.5/connectors/connector-starrocks-2.3.5.jar, file:/mnt/sdb1/apache-seatunnel-2.3.5/connectors/connector-cdc-mysql-2.3.5.jar]
2024-07-25 13:59:48,142 INFO [o.a.s.e.s.c.CheckpointManager ] [seatunnel-coordinator-service-890] - pipeline(1) start with savePoint on checkPointId(44541)
2024-07-25 13:59:48,144 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-890] - Create CheckpointCoordinator for job(1@2000012) with plan(CheckpointPlan(pipelineId=1, pipelineSubtasks=[TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=360000}, taskID=350000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=240000}, taskID=230000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30007}, taskID=40007, index=7}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30002}, taskID=40002, index=2}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=120000}, taskID=110000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=390000}, taskID=380000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30003}, taskID=40003, index=3}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=330000}, taskID=320000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=210000}, taskID=200000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=1}, taskID=20000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30005}, taskID=40005, index=5}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=90000}, taskID=80000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30000}, taskID=40000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30006}, taskID=40006, index=6}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=300000}, taskID=290000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30001}, taskID=40001, index=1}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=180000}, taskID=170000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=450000}, taskID=440000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=60000}, taskID=50000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30008}, taskID=40008, index=8}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=270000}, taskID=260000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30009}, taskID=40009, index=9}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30004}, taskID=40004, index=4}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=150000}, taskID=140000, index=0}, TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=420000}, taskID=410000, index=0}], startingSubtasks=[TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=1}, taskID=20000, index=0}], pipelineActions={ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.plan_device])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_record_day])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_device_fluency_result])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.plan_info])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.check_item])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_last_task_record])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_device_state_result])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_video_result])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]])=10, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_info])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC])=10, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_record])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_video_storage_result])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.performance_rule_config])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.performance_report])=1, ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_video_pic])=1}, subtaskActions={TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=360000}, taskID=350000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.task_info -> pipeline-1 [Sink[0]-StarRocks-smart_ops.task_info]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_info]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30007}, taskID=40007, index=7}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]]), 7), (ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), 7)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=120000}, taskID=110000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_device_state_result]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.task_device_state_result -> pipeline-1 [Sink[0]-StarRocks-smart_ops.task_device_state_result]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=390000}, taskID=380000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.task_record -> pipeline-1 [Sink[0]-StarRocks-smart_ops.task_record]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_record]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30003}, taskID=40003, index=3}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]]), 3), (ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), 3)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=330000}, taskID=320000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_record_day]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.task_record_day -> pipeline-1 [Sink[0]-StarRocks-smart_ops.task_record_day]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=90000}, taskID=80000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.plan_info]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.plan_info -> pipeline-1 [Sink[0]-StarRocks-smart_ops.plan_info]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30000}, taskID=40000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=300000}, taskID=290000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_last_task_record]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.device_last_task_record -> pipeline-1 [Sink[0]-StarRocks-smart_ops.device_last_task_record]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30001}, taskID=40001, index=1}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]]), 1), (ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), 1)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=450000}, taskID=440000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_device_fluency_result]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.task_device_fluency_result -> pipeline-1 [Sink[0]-StarRocks-smart_ops.task_device_fluency_result]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=60000}, taskID=50000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.plan_device]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.plan_device -> pipeline-1 [Sink[0]-StarRocks-smart_ops.plan_device]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30008}, taskID=40008, index=8}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), 8), (ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]]), 8)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30004}, taskID=40004, index=4}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]]), 4), (ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), 4)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=150000}, taskID=140000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_video_result]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.task_video_result -> pipeline-1 [Sink[0]-StarRocks-smart_ops.task_video_result]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=240000}, taskID=230000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.performance_rule_config -> pipeline-1 [Sink[0]-StarRocks-smart_ops.performance_rule_config]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.performance_rule_config]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30002}, taskID=40002, index=2}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]]), 2), (ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), 2)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=210000}, taskID=200000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.task_video_storage_result -> pipeline-1 [Sink[0]-StarRocks-smart_ops.task_video_storage_result]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_video_storage_result]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=1}, taskID=20000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), -1)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30005}, taskID=40005, index=5}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]]), 5), (ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), 5)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30006}, taskID=40006, index=6}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]]), 6), (ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), 6)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=180000}, taskID=170000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.check_item]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.check_item -> pipeline-1 [Sink[0]-StarRocks-smart_ops.check_item]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=270000}, taskID=260000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.performance_report -> pipeline-1 [Sink[0]-StarRocks-smart_ops.performance_report]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.performance_report]), 0)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=30009}, taskID=40009, index=9}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), 9), (ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]]), 9)], TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=2000012, pipelineId=1, taskGroupId=420000}, taskID=410000, index=0}=[(ActionStateKey(name=ActionStateKey - pipeline-1 [Shuffle [Source[0]-MySQL-CDC]] -> smart_ops.task_video_pic -> pipeline-1 [Sink[0]-StarRocks-smart_ops.task_video_pic]), 0), (ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.task_video_pic]), 0)]}))
2024-07-25 13:59:48,145 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-890] - Restore job(1@2000012) with checkpoint(44541), data: CompletedCheckpoint(jobId=2000012, pipelineId=1, checkpointId=44541, triggerTimestamp=1721386235795, checkpointType=CHECKPOINT_TYPE, completedTimestamp=1721386235798, taskStates={ActionStateKey(name=ActionStateKey - pipeline-1 [TransformChain[Transform[0]-FilterRowKind]])=ActionState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [TransformChain[Transform[0]-FilterRowKind]]), subtaskStates=[ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [TransformChain[Transform[0]-FilterRowKind]]), index=0), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [TransformChain[Transform[0]-FilterRowKind]]), index=1), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [TransformChain[Transform[0]-FilterRowKind]]), index=2), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [TransformChain[Transform[0]-FilterRowKind]]), index=3), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [TransformChain[Transform[0]-FilterRowKind]]), index=4), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [TransformChain[Transform[0]-FilterRowKind]]), index=5), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [TransformChain[Transform[0]-FilterRowKind]]), index=6), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [TransformChain[Transform[0]-FilterRowKind]]), index=7), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [TransformChain[Transform[0]-FilterRowKind]]), index=8), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [TransformChain[Transform[0]-FilterRowKind]]), index=9)], coordinatorState=null, parallelism=10), ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC])=ActionState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), subtaskStates=[ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), index=0), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), index=1), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), index=2), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), index=3), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), index=4), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), index=5), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), index=6), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), index=7), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), index=8), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), index=9)], coordinatorState=ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Source[0]-MySQL-CDC]), index=-1), parallelism=10), ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_offline_record])=ActionState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_offline_record]), subtaskStates=[ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_offline_record]), index=0), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_offline_record]), index=1), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_offline_record]), index=2), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_offline_record]), index=3), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_offline_record]), index=4), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_offline_record]), index=5), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_offline_record]), index=6), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_offline_record]), index=7), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_offline_record]), index=8), ActionSubtaskState(stateKey=ActionStateKey(name=ActionStateKey - pipeline-1 [Sink[0]-StarRocks-smart_ops.device_offline_record]), index=9)], coordinatorState=null, parallelism=10)}, taskStatistics={2=TaskStatistics(jobVertexId=2, subtaskStats=[SubtaskStatistics(subtaskIndex=0, ackTimestamp=1721386235797, stateSize=1, subtaskStatus=RUNNING)], subtaskCompleted=[false], numAcknowledgedSubtasks=1, latestAckedSubtaskStatistics=null), 4=TaskStatistics(jobVertexId=4, subtaskStats=[SubtaskStatistics(subtaskIndex=0, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=1, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=2, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=3, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=4, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=5, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=6, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=7, ackTimestamp=1721386235797, stateSize=1, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=8, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=9, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING)], subtaskCompleted=[false, false, false, false, false, false, false, false, false, false], numAcknowledgedSubtasks=10, latestAckedSubtaskStatistics=null), 5=TaskStatistics(jobVertexId=5, subtaskStats=[SubtaskStatistics(subtaskIndex=0, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=1, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=2, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=3, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=4, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=5, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=6, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=7, ackTimestamp=1721386235798, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=8, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING), SubtaskStatistics(subtaskIndex=9, ackTimestamp=1721386235797, stateSize=0, subtaskStatus=RUNNING)], subtaskCompleted=[false, false, false, false, false, false, false, false, false, false], numAcknowledgedSubtasks=10, latestAckedSubtaskStatistics=null)}, isRestored=true)
2024-07-25 13:59:48,145 INFO [.s.e.s.c.CheckpointCoordinator] [seatunnel-coordinator-service-890] - Turn checkpoint_state_2000012_1 state from null to RUNNING
2024-07-25 13:59:48,146 INFO [o.a.s.e.s.d.p.PhysicalVertex ] [seatunnel-coordinator-service-890] - The task Job sync-smart-ops-sheng-dev-job1 (2000012), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-MySQL-CDC]-SourceTask (1/10)] is in state CREATED when init state future
2024-07-25 13:59:48,148 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-890] - Job sync-smart-ops-sheng-dev-job1 (2000012) state process is start
2024-07-25 13:59:48,148 INFO [o.a.s.e.s.d.p.PhysicalPlan ] [seatunnel-coordinator-service-890] - Job sync-smart-ops-sheng-dev-job1 (2000012) turned from state CREATED to SCHEDULED.
2024-07-25 13:59:48,148 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-890] - Job sync-smart-ops-sheng-dev-job1 (2000012), Pipeline: [(1/1)] state process is start
2024-07-25 13:59:48,149 INFO [o.a.s.e.s.d.p.SubPlan ] [seatunnel-coordinator-service-890] - Job sync-smart-ops-sheng-dev-job1 (2000012), Pipeline: [(1/1)] turned from state CREATED to SCHEDULED.
from seatunnel.
Related Issues (20)
- [Bug] [Paimon] The isNullable attribute is true when the primary key field in the Paimon table converts the Column object.
- [Feature][Activemq] Support Activemq connector source/sink HOT 2
- SeaTunnel community meeting Topic collect HOT 4
- [Bug] [Zeta] TaskGroup Failed MSG lost when job restore time more than one
- The result was achieved, but the printed result was not successfully written
- [Feature][Connector-V2][Iceberg] Support Iceberg Kerberos HOT 1
- [Feature][Hudi Sink] Hudi sink supports catalog and typeconverter features.
- 把influxdb里面的数据同步到doris
- [Bug][Generate Sink SQL]重复插入数据,关闭hadoop环境,提示hadoop.home.dir are unset
- [Bug] [seatunnel-translation-flink] Seatunnel Flink translation doesn't support 1.19.1
- [Improve][Catalog] Catalog table not found or library not found error message enhanced HOT 1
- CDC的场景是否支持MySQL的分库分表
- [Feature][Transform] Support JOIN operations in transform and create complex graph ETL
- [Bug] [connector-file-s3] Lack of dependencies HOT 1
- [Bug] [plugin-discovery] Jar found with same prefix HOT 1
- [Feature][Transform] Convert a single row to multiple rows
- [Bug] [seatunnel-engine] separated-cluster-deployment imap config not effective
- [Bug] [Seatunnel-config-sql] No exception for error config
- [Bug] [connector-doris] doris sink config: `doris.batch.size` not meeting expectations
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from seatunnel.