Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

change stash/restic backup target and offsite replication behaviour #97

Open
C0nsultant opened this issue Jan 24, 2025 · 0 comments
Open

Comments

@C0nsultant
Copy link
Owner

C0nsultant commented Jan 24, 2025

Right now, stash/restic is configured with BackBlaze as a direct storage backend. This is fine expect for the additional use of prune: true. This causes excessive download bandwith since restic downloads the entire repo for repacking after the prune. That bandwidth is (at least) 4x as expensive as the actual storage. More details in this thread.

Some ideas:

  • Back up to a local target with prune and simply replicate (i.e. 1:1 sync) this to BackBlaze after
  • Pruning is intended to remove data from the bucket that is not referenced by any snapshot. Considering that the backups here are append-only for the most part (databases, long-term storage of photos, documents, ...), running restic forget without --prune or a separate --prune schedule wit significantly reduced frequency should be fine. This would potentially result in the bucket size being larger as they then contain files that are not part of any active backup/snapshot. But again: The storage cost is only a small fraction of the data transfer cost.
C0nsultant added a commit that referenced this issue Feb 3, 2025
See #97. Turns out it's not bandwidth that is costly right now, but
API calls to 'download file by name'... probably due to 'restic check'
without cache?!
C0nsultant added a commit that referenced this issue Feb 3, 2025
See #97. Turns out it's not bandwidth that is costly right now, but
API calls to 'download file by name'... probably due to 'restic check'
without cache?!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant