Comments (2)
My proposal is not good, because the ByteBufInputStream will usually survive after the LedgerHandle#close.
We need to find a solution at least for errors during asyncAddEntry callback execution
But I think that we could introduce some leaks in existing downstream applications, because in 4.4 it clients are not required to fully consume every read entry
The best would be not to return a simple "Enumeration" but at least a subclass with an explicit "close" method (implementing AutoCloseable for instance) and document that such 'resource' must be closed
public interface EntriesEnumeration extends Enumeration, AutoCloseable {
...
}
This will be a breaking change, but I think that we already have introduced many breaking changes in the API (PlacementPolicy and Netty4 HashedWheelTimer.....)
a breaking API change will make downstream application need to be reviewed
from bookkeeper.
After discussion on the mailing list we decided to:
- create a configuration option to use pooled/unpooled netty buffers
- document in LedgerEntry that in case of v2 wire protocol the application is responsible for 'releasing' the ByteBuf
from bookkeeper.
Related Issues (20)
- bin/bookkeeper failed on windows11 HOT 1
- [site][bugfix] BK website version 4.17.0, missing sidebar
- Owasp CI is broken
- ByteBuf returned by BookKeeper triggers CRC Checksum calculation when calling "readBytes" HOT 6
- Bookie server lost some metrics of OrderedExecutor
- BP-67: Support skipping compaction at busy times
- Startup issue HOT 1
- Task: upgrade RocksDB HOT 4
- Flaky-test: BookieAutoRecoveryTest.testEmptyLedgerLosesQuorumEventually flakes on CI (fail, then passes on rerun)
- Flaky-test: BookieAutoRecoveryTest.testClosedLedgers times out (but may succeed on re-run)
- Flaky-test: org.apache.bookkeeper.client.SlowBookieTest
- /api/v1/bookie/entry_location_compact NPE HOT 4
- 4.17.0 tag is missing for apache/bookkeeper image on Docker Hub HOT 7
- Dead lock error. HOT 6
- ensemble change may cause pendingAddOps of ledgerHandle to be unable to be resent, and the pulsar partition may become unavailable. HOT 1
- Permission denied in the docker image
- The maxPendingAddRequestsPerThread configuration is inconsistent with the actual behavior, resulting in netty direct memory OOM HOT 3
- Async log appender not print log when bookie starting error
- Optimal configuration for the cloud (with SSDs)
- Upgrade RocksDB default format_version to 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bookkeeper.