automq / automq-for-rocketmq Goto Github PK
View Code? Open in Web Editor NEWA cloud native implementation for Apache RocketMQ 5.0
Home Page: https://www.automq.com
automq-for-rocketmq's Issues
Can not reopen stream
2023-10-10 14:55:04 INFO Controller-Async_9 - Create and open topic: 1 queue: 0
2023-10-10 14:55:04 ERROR Controller-Async_0 - openStream run with unexpected exception
org.apache.ibatis.exceptions.PersistenceException:
### Error updating database. Cause: java.sql.SQLIntegrityConstraintViolationException: Duplicate entry '1-0' for key 'range.idx_stream_start_offset'
### The error may exist in database/mapper/RangeMapper.xml
### The error may involve com.automq.rocketmq.controller.metadata.database.mapper.RangeMapper.create-Inline
### The error occurred while setting parameters
### SQL: INSERT INTO `range` (range_id, stream_id, epoch, start_offset, end_offset, broker_id) VALUES ( ?, ?, ?, ?, ?, ? )
### Cause: java.sql.SQLIntegrityConstraintViolationException: Duplicate entry '1-0' for key 'range.idx_stream_start_offset'
at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:30)
at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:199)
at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184)
at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62)
at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:142)
at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:86)
at jdk.proxy2/jdk.proxy2.$Proxy15.create(Unknown Source)
at com.automq.rocketmq.controller.metadata.database.DefaultMetadataStore.openStream(DefaultMetadataStore.java:1223)
at com.automq.rocketmq.metadata.DefaultStoreMetadataService.openStream(DefaultStoreMetadataService.java:156)
at com.automq.rocketmq.store.S3StreamManager.openStream(S3StreamManager.java:50)
at com.automq.stream.s3.S3StreamClient.openStream0(S3StreamClient.java:106)
at com.automq.stream.s3.S3StreamClient.lambda$openStream$2(S3StreamClient.java:78)
at com.automq.stream.utils.FutureUtil.exec(FutureUtil.java:60)
at com.automq.stream.s3.S3StreamClient.openStream(S3StreamClient.java:78)
at com.automq.rocketmq.store.S3StreamStore.open(S3StreamStore.java:143)
at com.automq.rocketmq.store.StreamTopicQueue.lambda$open$0(StreamTopicQueue.java:88)
at java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:1150)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run$$$capture(CompletableFuture.java:1773)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1589)
Caused by: java.sql.SQLIntegrityConstraintViolationException: Duplicate entry '1-0' for key 'range.idx_stream_start_offset'
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:118)
at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
at com.mysql.cj.jdbc.ClientPreparedStatement.executeInternal(ClientPreparedStatement.java:916)
at com.mysql.cj.jdbc.ClientPreparedStatement.execute(ClientPreparedStatement.java:354)
at com.zaxxer.hikari.pool.ProxyPreparedStatement.execute(ProxyPreparedStatement.java:44)
at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.execute(HikariProxyPreparedStatement.java)
at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:48)
at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:75)
at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50)
at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117)
at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76)
at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197)
... 21 common frames omitted
Implement S3StreamManager for S3Stream
Replay ack and changeInvisibleDuration operation failed
2023-10-10 21:31:18 ERROR s3-storage-main - [DefaultStateMachine-1-0]: Replay ack operation failed
com.automq.rocketmq.store.exception.StoreException: Ack operation failed, check point not found
at com.automq.rocketmq.store.DefaultMessageStateMachine.replayAckOperation(DefaultMessageStateMachine.java:289)
at com.automq.rocketmq.store.service.StreamOperationLogService.replay(StreamOperationLogService.java:166)
at com.automq.rocketmq.store.service.StreamOperationLogService.doReplay(StreamOperationLogService.java:148)
at com.automq.rocketmq.store.service.StreamOperationLogService.lambda$logAckOperation$5(StreamOperationLogService.java:113)
at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:646)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at com.automq.stream.s3.S3Storage.handleAppendCallback0(S3Storage.java:313)
at com.automq.stream.s3.S3Storage.lambda$handleAppendCallback$13(S3Storage.java:301)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
at java.base/java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:264)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:31:22 ERROR s3-storage-main - [DefaultStateMachine-1-0]: Replay ack operation failed
com.automq.rocketmq.store.exception.StoreException: Ack operation failed, check point not found
at com.automq.rocketmq.store.DefaultMessageStateMachine.replayAckOperation(DefaultMessageStateMachine.java:289)
at com.automq.rocketmq.store.service.StreamOperationLogService.replay(StreamOperationLogService.java:166)
at com.automq.rocketmq.store.service.StreamOperationLogService.doReplay(StreamOperationLogService.java:148)
at com.automq.rocketmq.store.service.StreamOperationLogService.lambda$logAckOperation$5(StreamOperationLogService.java:113)
at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:646)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at com.automq.stream.s3.S3Storage.handleAppendCallback0(S3Storage.java:313)
at com.automq.stream.s3.S3Storage.lambda$handleAppendCallback$13(S3Storage.java:301)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
at java.base/java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:264)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:32:10 ERROR s3-storage-main - [DefaultStateMachine-1-0]: Replay ack operation failed
com.automq.rocketmq.store.exception.StoreException: Ack operation failed, check point not found
at com.automq.rocketmq.store.DefaultMessageStateMachine.replayAckOperation(DefaultMessageStateMachine.java:289)
at com.automq.rocketmq.store.service.StreamOperationLogService.replay(StreamOperationLogService.java:166)
at com.automq.rocketmq.store.service.StreamOperationLogService.doReplay(StreamOperationLogService.java:148)
at com.automq.rocketmq.store.service.StreamOperationLogService.lambda$logAckOperation$5(StreamOperationLogService.java:113)
at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:646)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at com.automq.stream.s3.S3Storage.handleAppendCallback0(S3Storage.java:313)
at com.automq.stream.s3.S3Storage.lambda$handleAppendCallback$13(S3Storage.java:301)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
at java.base/java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:264)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
Support specific message type in CreateTopic command
chore: KVServiceTest::testIterate forgets to destroy test RocksDB store
[WAL] Add group commit feature to reduce the number of IO operations
Migrate from AutoMQ/automq#212
Recover records issue with restart broker
2023-10-08 14:27:54 INFO main - S3Storage starting
2023-10-08 14:27:54 INFO main - start to recover from ungraceful shutdown, recoverStartOffset: 2147495936, recoverRemainingBytes: 1073733632
2023-10-08 14:27:55 INFO main - recovered from ungraceful shutdown, WALHeader: WALHeader{magicCode=305419896, capacity=1073741824, trimOffset=1073737728, lastWriteTimestamp=157874965472250, nextWriteOffset=3221229568, slidingWindowStartOffset=3221229568, slidingWindowMaxLength=1048576, shutdownType=UNGRACEFULLY, crc=1629916851}
2023-10-08 14:27:55 INFO main - block WAL service started, cost: 769 ms
2023-10-08 14:27:56 INFO main - try recover from crash, recover records bytes size 1880
2023-10-08 14:27:56 INFO sdk-async-response-0-0 - Commit WAL object: object_id: -1
sequence_id: -1
, along with split stream objects: [stream_id: 1
end_offset: 5
object_id: 2
object_size: 2139
], compacted objects: []
2023-10-08 14:27:56 ERROR sdk-async-response-0-0 - Unexpected exception when commit WAL object
java.util.concurrent.CompletionException: java.lang.NullPointerException: Cannot invoke "com.automq.rocketmq.controller.metadata.database.dao.S3Object.getState()" because "s3Object" is null
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)
at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)
at java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:1159)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2179)
at com.automq.stream.s3.WALObjectUploadTask.lambda$upload0$5(WALObjectUploadTask.java:134)
at java.base/java.util.concurrent.CompletableFuture$UniAccept.tryFire$$$capture(CompletableFuture.java:718)
at java.base/java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2179)
at com.automq.stream.s3.operator.DefaultS3Operator$DefaultWriter.lambda$close0$11(DefaultS3Operator.java:425)
at java.base/java.util.concurrent.CompletableFuture$UniAccept.tryFire$$$capture(CompletableFuture.java:718)
at java.base/java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2179)
at software.amazon.awssdk.core.internal.http.pipeline.stages.AsyncApiCallMetricCollectionStage.lambda$execute$0(AsyncApiCallMetricCollectionStage.java:56)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2179)
at software.amazon.awssdk.core.internal.http.pipeline.stages.AsyncApiCallTimeoutTrackingStage.lambda$execute$2(AsyncApiCallTimeoutTrackingStage.java:69)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2179)
at software.amazon.awssdk.core.internal.http.pipeline.stages.AsyncRetryableStage$RetryingExecutor.lambda$attemptExecute$1(AsyncRetryableStage.java:177)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2179)
at software.amazon.awssdk.core.internal.http.pipeline.stages.MakeAsyncHttpRequestStage.lambda$null$0(MakeAsyncHttpRequestStage.java:105)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2179)
at software.amazon.awssdk.core.internal.http.pipeline.stages.MakeAsyncHttpRequestStage.completeResponseFuture(MakeAsyncHttpRequestStage.java:238)
at software.amazon.awssdk.core.internal.http.pipeline.stages.MakeAsyncHttpRequestStage.lambda$executeHttpRequest$3(MakeAsyncHttpRequestStage.java:163)
at java.base/java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:934)
at java.base/java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:911)
at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:482)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1589)
Init an admin module
Make ControllerException unchecked
Setup Controller gRPC Service
Create topic queue failed when recover from crash
2023-10-10 20:42:01 INFO Controller-Async_2 - Create and open topic: 1 queue: 0
2023-10-10 20:42:01 ERROR Controller-Async_4 - [BUG] fail to read, expect objects not empty, streamId=2, startOffset=0, endOffset=10
2023-10-10 20:42:01 ERROR Controller-Async_4 - Create topic: 1 queue: 0 failed.
java.util.concurrent.CompletionException: java.lang.IllegalStateException: fail to read, expect objects not empty
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)
at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)
at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:649)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run$$$capture(CompletableFuture.java:1773)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1589)
Caused by: java.lang.IllegalStateException: fail to read, expect objects not empty
at com.automq.stream.s3.cache.DefaultS3BlockCache.lambda$readFromS3$8(DefaultS3BlockCache.java:143)
at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:646)
... 6 common frames omitted
2023-10-10 20:42:01 ERROR Controller-Async_4 - read 2 [0, 10) from block cache fail
java.util.concurrent.CompletionException: java.lang.IllegalStateException: fail to read, expect objects not empty
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)
at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)
at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:649)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run$$$capture(CompletableFuture.java:1773)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1589)
Caused by: java.lang.IllegalStateException: fail to read, expect objects not empty
at com.automq.stream.s3.cache.DefaultS3BlockCache.lambda$readFromS3$8(DefaultS3BlockCache.java:143)
at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:646)
... 6 common frames omitted
The deliveryTimestamp of consumed messages is missed
Introduce StreamStore interface for store module
List S3 objects in atomic way
CompletableFuture<List<S3StreamObject>> streamObjectsFuture = metadataStore.listStreamObjects(streamId, startOffset, endOffset, limit);
CompletableFuture<List<S3WALObject>> walObjectsFuture = metadataStore.listWALObjects(streamId, startOffset, endOffset, limit);
return CompletableFuture.allOf(streamObjectsFuture, walObjectsFuture)
.thenApplyAsync(v -> new Pair<>(streamObjectsFuture.join(), walObjectsFuture.join()));Currently, we need two function calls to achieve a list s3 objects with two types.
Couldn't open retry stream when starting simple consumer
2023-10-10 13:25:41 ERROR Controller-Async_7 - Failed to open stream 5
java.util.concurrent.CompletionException: com.automq.rocketmq.controller.exception.ControllerException: Stream[stream-id=5] is not found
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:332)
at java.base/java.util.concurrent.CompletableFuture.uniApplyNow(CompletableFuture.java:674)
at java.base/java.util.concurrent.CompletableFuture.uniApplyStage(CompletableFuture.java:662)
at java.base/java.util.concurrent.CompletableFuture.thenApply(CompletableFuture.java:2168)
at com.automq.rocketmq.store.S3StreamManager.openStream(S3StreamManager.java:50)
at com.automq.stream.s3.S3StreamClient.openStream0(S3StreamClient.java:106)
at com.automq.stream.s3.S3StreamClient.lambda$openStream$2(S3StreamClient.java:78)
at com.automq.stream.utils.FutureUtil.exec(FutureUtil.java:60)
at com.automq.stream.s3.S3StreamClient.openStream(S3StreamClient.java:78)
at com.automq.rocketmq.store.S3StreamStore.open(S3StreamStore.java:143)
at com.automq.rocketmq.store.StreamTopicQueue.lambda$retryStreamId$12(StreamTopicQueue.java:162)
at java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:1150)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1773)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: com.automq.rocketmq.controller.exception.ControllerException: Stream[stream-id=5] is not found
at com.automq.rocketmq.controller.metadata.database.DefaultMetadataStore.openStream(DefaultMetadataStore.java:1122)
at com.automq.rocketmq.metadata.DefaultStoreMetadataService.openStream(DefaultStoreMetadataService.java:156)
... 13 common frames omitted
WAL based on block device cannot run
Migrate from AutoMQ/automq#224
Unexpected new range is created when rebooting server
Failed to revive message when rebooting server ungracefully
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 21:12:46 ERROR ReviveService - [ReviveService]: Failed to revive message
com.automq.rocketmq.store.exception.StoreException: Not found check point
at com.automq.rocketmq.store.service.ReviveService.lambda$tryRevive$0(ReviveService.java:121)
at com.automq.rocketmq.store.service.RocksDBKVService.iterate(RocksDBKVService.java:245)
at com.automq.rocketmq.store.service.api.KVService.iterate(KVService.java:74)
at com.automq.rocketmq.store.service.ReviveService.tryRevive(ReviveService.java:109)
at com.automq.rocketmq.store.service.ReviveService.run(ReviveService.java:93)
at java.base/java.lang.Thread.run(Thread.java:833)
Connection leak detection triggered for ibatis
2023-10-10 14:17:37 WARN HikariPool-1 housekeeper - Connection leak detection triggered for com.mysql.cj.jdbc.ConnectionImpl@1e812b22 on thread Controller_5, stack trace follows
java.lang.Exception: Apparent connection leak detected
at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:100)
at org.apache.ibatis.transaction.jdbc.JdbcTransaction.openConnection(JdbcTransaction.java:145)
at org.apache.ibatis.transaction.jdbc.JdbcTransaction.getConnection(JdbcTransaction.java:67)
at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:345)
at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:89)
at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:64)
at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:333)
at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:158)
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:110)
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:90)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:154)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:147)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:142)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectOne(DefaultSqlSession.java:75)
at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:87)
at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:142)
at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:86)
at jdk.proxy2/jdk.proxy2.$Proxy7.current(Unknown Source)
at com.automq.rocketmq.controller.metadata.database.tasks.LeaseTask.run(LeaseTask.java:43)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-10-10 14:17:37 WARN HikariPool-1 housekeeper - Connection leak detection triggered for com.mysql.cj.jdbc.ConnectionImpl@2d8f4e6a on thread Controller_2, stack trace follows
java.lang.Exception: Apparent connection leak detected
at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:100)
at org.apache.ibatis.transaction.jdbc.JdbcTransaction.openConnection(JdbcTransaction.java:145)
at org.apache.ibatis.transaction.jdbc.JdbcTransaction.getConnection(JdbcTransaction.java:67)
at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:345)
at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:89)
at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:64)
at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:333)
at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:158)
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:110)
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:90)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:154)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:147)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:142)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectOne(DefaultSqlSession.java:75)
at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:87)
at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:142)
at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:86)
at jdk.proxy2/jdk.proxy2.$Proxy7.currentWithShareLock(Unknown Source)
at com.automq.rocketmq.controller.metadata.database.DefaultMetadataStore.maintainLeadershipWithSharedLock(DefaultMetadataStore.java:284)
at com.automq.rocketmq.controller.metadata.database.tasks.SchedulerTask.run(SchedulerTask.java:49)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
Optimize WAL recovery to improve speed
Migrate from AutoMQ/automq#226
- Feat: Have
recoverscan window size instead of scanning the entire disk. - Refactor: Execute
recoverat startup and only run it once.
Add java test coverage check action
In the early development stage, the API may be fickle, so hold on for a while!
Implement stream store based on s3stream
[WAL] Writing multiple records in one block to support RocketMQ
Migrate from AutoMQ/automq#108
Check if testcontainer works or not on github action
Split controller to a separate port
Remove offset from pop interface
For pop behavior, the offset is the inner implementation, no need to expose the offset to the interface.
Add checkstyle and codestyle
Trim sub-streams when compacting WAL objects
StoreMetadataService#retryStreamOf retruns an invalid stream id
The stream retrieved from StoreMetadataService#retryStreamOf can not be opened.
2023-10-10 14:39:13 ERROR Controller-Async_5 - Failed to open stream 17
java.util.concurrent.CompletionException: com.automq.rocketmq.controller.exception.ControllerException: Stream[stream-id=17] is not found
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:332)
at java.base/java.util.concurrent.CompletableFuture.uniApplyNow(CompletableFuture.java:674)
at java.base/java.util.concurrent.CompletableFuture.uniApplyStage(CompletableFuture.java:662)
at java.base/java.util.concurrent.CompletableFuture.thenApply(CompletableFuture.java:2200)
at com.automq.rocketmq.store.S3StreamManager.openStream(S3StreamManager.java:50)
at com.automq.stream.s3.S3StreamClient.openStream0(S3StreamClient.java:106)
at com.automq.stream.s3.S3StreamClient.lambda$openStream$2(S3StreamClient.java:78)
at com.automq.stream.utils.FutureUtil.exec(FutureUtil.java:60)
at com.automq.stream.s3.S3StreamClient.openStream(S3StreamClient.java:78)
at com.automq.rocketmq.store.S3StreamStore.open(S3StreamStore.java:143)
at com.automq.rocketmq.store.StreamTopicQueue.lambda$retryStreamId$12(StreamTopicQueue.java:162)
at java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:1150)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run$$$capture(CompletableFuture.java:1773)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1589)
Caused by: com.automq.rocketmq.controller.exception.ControllerException: Stream[stream-id=17] is not found
at com.automq.rocketmq.controller.metadata.database.DefaultMetadataStore.openStream(DefaultMetadataStore.java:1122)
at com.automq.rocketmq.metadata.DefaultStoreMetadataService.openStream(DefaultStoreMetadataService.java:156)
... 14 common frames omitted
Support shutdown broker gracefully
Excessive logging filled up the disk when an error occurred
Migrate from AutoMQ/automq#257
Implement S3Object lifecycle manager to clean expired S3 objects
Close stream in two phases
- Phase 1: fence stream and update the length to metadata.
- Phase 2: update data to s3
Add Java CI action
Flaky test: `AsyncTokenBucketThrottleTest::testThrottleQuickly`
Support snapshot stream
Implement a memory stream for development
UnsupportedOperationException thrown when getObjects from meta
2023-10-10 15:59:31 ERROR Controller-Async_7 - read 1 [0, 20) from block cache fail
java.util.concurrent.CompletionException: java.lang.UnsupportedOperationException
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)
at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)
at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:649)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1773)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: java.lang.UnsupportedOperationException: null
at java.base/java.util.ImmutableCollections.uoe(ImmutableCollections.java:142)
at java.base/java.util.ImmutableCollections$AbstractImmutableList.sort(ImmutableCollections.java:261)
at com.automq.rocketmq.store.S3ObjectManager.lambda$getObjects$7(S3ObjectManager.java:151)
at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:646)
... 5 common frames omitted
fetch operation returns out of stream bound
Each fetch will expand the end offset and may exceed the confirmed offset, leading to an out-of-stream bound error.
Add java code analysis
Introduce put message feature for store module
base_data_timestamp is missed for s3 objects
Introduce the blob stream models for controller
introduce S3Stream related controller APIs
Implement a memory WAL for development
Add RPC, allowing brokers to notify leader controller of message queue being assignable
After all data has been uploaded to S3, the message queue may be reassigned to a second broker and marked writable again.
Commmit WAL object falied
2023-10-10 13:31:29 INFO sdk-async-response-0-25 - Commit WAL object: object_id: -1
sequence_id: -1
, along with split stream objects: [stream_id: 1
start_offset: 7130
end_offset: 9683
object_id: 2
object_size: 104962087
], compacted objects: []
2023-10-10 13:31:29 WARN sdk-async-response-0-25 - Stream[stream-id=1]'s current range[range-id=0]'s end offset[0] is not equal to request start offset[7130]
2023-10-10 13:31:29 ERROR sdk-async-response-0-25 - S3WALObject[object-id=-1]'s stream advance check failed
2023-10-10 13:31:29 ERROR sdk-async-response-0-25 - Unexpected exception when commit WAL object
java.util.concurrent.CompletionException: com.automq.rocketmq.controller.exception.ControllerException: S3WALObject[object-id=-1]'s stream advance check failed
at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:332)
at java.base/java.util.concurrent.CompletableFuture.uniApplyNow(CompletableFuture.java:674)
at java.base/java.util.concurrent.CompletableFuture.uniApplyStage(CompletableFuture.java:662)
at java.base/java.util.concurrent.CompletableFuture.thenApply(CompletableFuture.java:2168)
at com.automq.rocketmq.store.S3ObjectManager.commitWALObject(S3ObjectManager.java:101)
at com.automq.stream.s3.WALObjectUploadTask.lambda$commit$8(WALObjectUploadTask.java:142)
at java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:1150)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at com.automq.stream.s3.WALObjectUploadTask.lambda$upload0$5(WALObjectUploadTask.java:134)
at java.base/java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:718)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at com.automq.stream.s3.operator.DefaultS3Operator$DefaultWriter.lambda$close0$11(DefaultS3Operator.java:424)
at java.base/java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:718)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at software.amazon.awssdk.core.internal.http.pipeline.stages.AsyncApiCallMetricCollectionStage.lambda$execute$0(AsyncApiCallMetricCollectionStage.java:56)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at software.amazon.awssdk.core.internal.http.pipeline.stages.AsyncApiCallTimeoutTrackingStage.lambda$execute$2(AsyncApiCallTimeoutTrackingStage.java:69)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at software.amazon.awssdk.core.internal.http.pipeline.stages.AsyncRetryableStage$RetryingExecutor.lambda$attemptExecute$1(AsyncRetryableStage.java:177)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at software.amazon.awssdk.core.internal.http.pipeline.stages.MakeAsyncHttpRequestStage.lambda$null$0(MakeAsyncHttpRequestStage.java:105)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at software.amazon.awssdk.core.internal.http.pipeline.stages.MakeAsyncHttpRequestStage.completeResponseFuture(MakeAsyncHttpRequestStage.java:238)
at software.amazon.awssdk.core.internal.http.pipeline.stages.MakeAsyncHttpRequestStage.lambda$executeHttpRequest$3(MakeAsyncHttpRequestStage.java:163)
at java.base/java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:934)
at java.base/java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:911)
at java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:482)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: com.automq.rocketmq.controller.exception.ControllerException: S3WALObject[object-id=-1]'s stream advance check failed
at com.automq.rocketmq.controller.metadata.database.DefaultMetadataStore.commitWalObject(DefaultMetadataStore.java:1458)
at com.automq.rocketmq.metadata.DefaultStoreMetadataService.commitWalObject(DefaultStoreMetadataService.java:177)
... 41 common frames omitted
Implement ObjectManager for S3Stream
[WAL] Make wal testable
Migrate from AutoMQ/automq#109
Close stream in S3StreamStore
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.