Comments (1)
ivankelly
commented on June 25, 2024
@sijie to confirm what the comment says, it proposes that when we write to the journal for an entry, we take a mark of the point of the journal(called LSN here) at which the entry was persisted, and pass this along with the entry to the ledger storage. The ledger storage can then make it's own decision on when to sync, and when it does, it can just inform the journal of the LSN up to which all data has been persisted. This can be either push or pull from the journal PoV. Correct?
I think this is a good change, and wouldn't be particularly big. Now is a good time to do it too, or maybe once the per ledger entrylog stuff is in, which should be fairly soon.
from bookkeeper.
Related Issues (20)
- Bookie translate to readonly mode due to NullPointerException while flushing mem table.
- No such ledger exists on Bookies but ledgermetadata exist HOT 9
- Replacement for `bookie_journal_JOURNAL_CB_QUEUE_SIZE`
- ArrayIndexOutOfBoundsException on ConcurrentLongHashMap if autoshrink is true. HOT 5
- [Bug] Bookkeeper concurrent containers has concurrency issues HOT 2
- Migrate tests from junit4 to junit5 HOT 6
- Spammy stacetrace happened for LedgerFencedException
- bin/bookkeeper failed on windows11 HOT 1
- [site][bugfix] BK website version 4.17.0, missing sidebar
- Owasp CI is broken
- ByteBuf returned by BookKeeper triggers CRC Checksum calculation when calling "readBytes" HOT 6
- Bookie server lost some metrics of OrderedExecutor
- BP-67: Support skipping compaction at busy times
- Startup issue HOT 1
- Task: upgrade RocksDB HOT 4
- Flaky-test: BookieAutoRecoveryTest.testEmptyLedgerLosesQuorumEventually flakes on CI (fail, then passes on rerun)
- Flaky-test: BookieAutoRecoveryTest.testClosedLedgers times out (but may succeed on re-run)
- Flaky-test: org.apache.bookkeeper.client.SlowBookieTest
- /api/v1/bookie/entry_location_compact NPE HOT 2
- 4.17.0 tag is missing for apache/bookkeeper image on Docker Hub HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bookkeeper.