Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Option for double write of S3 objects for extra durability #171

Open
purplefox opened this issue Jul 16, 2024 · 1 comment
Open

Option for double write of S3 objects for extra durability #171

purplefox opened this issue Jul 16, 2024 · 1 comment

Comments

@purplefox
Copy link
Contributor

purplefox commented Jul 16, 2024

S3 claims a durability of 11 nines (99.999999999%) - which allegedly means you can expect to lose 0.000000001% of your objects per year. If you store billions of objects, the probability of loss becomes non-negligible.

We should allow an option of double writing S3 objects - so, we write two copies of each object to the store, so that, if one is lost, we still have the other. And, hopefully, the chance of loss of both objects would be vanishingly small.

This would apply to Master record

@purplefox purplefox added the good first issue Good for newcomers label Jul 23, 2024
@rajatkb
Copy link
Contributor

rajatkb commented Sep 24, 2024

Hey, can I take this up if not being actively worked upon ?

@purplefox purplefox added this to the 1.0 milestone Oct 3, 2024
@purplefox purplefox removed the good first issue Good for newcomers label Oct 3, 2024
@purplefox purplefox removed this from the 1.0 milestone Oct 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants