Comments (2)
Hmm, that's not good. Debugging failing integrity checks can be complicated and there's not built in debugging tooling in Litestream. Do you know if you're using any extensions with your SQLite database? It shouldn't matter but I figured I'd ask to double check.
from litestream.
No extensions are used.
What is interesting is that this occurs with an hours-old snapshot and just a few WALs:
➜ /tmp litestream restore -v -o scorekeeper.db s3://xxxxxxxxxxxxxxxx/sync_server
2024/04/22 13:54:48.459675 s3: restoring snapshot 0734a376671bf473/00000003 to scorekeeper.db.tmp
2024/04/22 13:54:48.550590 s3: restoring wal files: generation=0734a376671bf473 index=[00000003,00000004]
2024/04/22 13:54:48.655964 s3: downloaded wal 0734a376671bf473/00000004 elapsed=104.373292ms
2024/04/22 13:54:50.779728 s3: downloaded wal 0734a376671bf473/00000003 elapsed=2.228415666s
2024/04/22 13:54:50.792547 s3: applied wal 0734a376671bf473/00000003 elapsed=12.437458ms
2024/04/22 13:54:50.793711 s3: applied wal 0734a376671bf473/00000004 elapsed=1.15025ms
2024/04/22 13:54:50.793721 s3: renaming database from temporary location
I downloaded the snapshot from S3 and decompressed it (🎉 that stock lz4
worked). Integrity checks passed fine. I don't know how do to anything with the WAL files though. I'm happy to ship any of these files to a team member for dissection.
from litestream.
Related Issues (20)
- Verbose parameter removed in version 0.3.13 HOT 3
- Extracting the executable file from the .deb release package HOT 3
- Storj S3 restore Error: "cannot find max wal index for restore: missing initial wal segment:" HOT 13
- snapshot successfully sent to S3, but not WAL segments HOT 2
- Question re: running litestream in docker warning at top of doc page HOT 1
- Clarify autocheckpoints consequences HOT 5
- Website menu truncated on mobile HOT 2
- Feature request: Reverse replication HOT 2
- Crash with invalid memory address or nil pointer dereference when restoring HOT 6
- Crash on writing (deleting?) snapshot HOT 1
- Memory leak when replication targets are unhealthy HOT 4
- Is -timestamp broken when restoring? HOT 1
- Continous restore / Restartable restore HOT 2
- `plndr-cp-lock` failure with kube-vip pod when backing up K3s sqlite database
- Switch to HEAD instead of get-bucket-location in S3 init routine HOT 2
- Browser support HOT 1
- Update or remove the "blog" at https://litestream.io/blog/ HOT 1
- Timestamp issue while restoring HOT 1
- Azure Blob Storage Retention Error When Deleting Generation
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from litestream.