Comments (5)
Thanks for the tip, I had forgotten about that project. I noticed that the author chose not to utilize the hash verification upon upload (at least from my quick perusal of the S3 and GCS implementations). This would not make it an ideal candidate to use directly, but you can probably get away with using the supported file://
target in this project to point to a mounted path from rclone (e.g. using their FUSE mounting feature). I haven't tested this myself but I'd assume it should work?
from zfsbackup-go.
from zfsbackup-go.
I'd be using the integration to b2 using this project: https://github.com/kurin/blazer
The project appears to be doing a good job integrating using BackBlaze's integration checklist, which is the best I could ask for other than an SDK from BackBlaze themselves.
Generally, I don't write any API integrations with a target cloud provider I'm working on integrating to the application. My integrations more/less just use the SDKs available from the cloud provider which implement best practices for integrating against their own services, this includes retry/backoff logic, resumeable or multipart upload logic, etc. I write simple wrappers for coordinating the uploads with the rest of the backup/restore processes and options passed by the user (e.g. max parallel uploads) and do my research to ensure I utilize all options available for a resilient and verified upload/download.
I'll hopefully have something in the next day or two for you to test! I'm sure you're already aware of this, but this sort of backup is block-level, not file-level like Crashplan is.
from zfsbackup-go.
Release for B2 has been added with the latest release: https://github.com/someone1/zfsbackup-go/releases/tag/v0.3-rc1
Please give it a go and let me know what you think!
from zfsbackup-go.
from zfsbackup-go.
Related Issues (20)
- GPG encryption problem HOT 2
- Parallel processing not working
- How are people managing deletion of older snapshots? HOT 6
- Issue With Receiving Encrypted Snapshot From S3 - "tag byte does not have MSB set" HOT 7
- Typo in README.md examples HOT 2
- Multiple Concurrent Requests on Receive? HOT 1
- [Feature Request] Use backends in round-robin to add up their capacity. HOT 1
- S3: Upload with storage class HOT 4
- cooperate with autosnap generated snapshots? HOT 2
- INSTALL: azure_backend.go:217:34: not enough arguments in call to blobURL.CommitBlockList HOT 9
- Allow for sending a local volume name that differs from the remote volume name HOT 1
- unexpected ZFS error causes zfsbackup-go process to hang
- Allow for intermediary incrementals to be saved when using smart options to send
- Support matching snapshots with a regex?
- not building on ubuntu 20.04 HOT 2
- Any way to clean up local manifests? "There are N manifests found locally that are not on the target destination."
- Restore process failed with io: read/write on closed pipe HOT 1
- Pipes in filenames cause problems for NTFS/SMB HOT 1
- Show progress
- [Question] Incremental snapshot backups and usage HOT 12
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from zfsbackup-go.