Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Add S3 as an alternative type to EFS to use inside the Volumes list - Large Dataset Support #10

Open
Cameronsplaze opened this issue Aug 6, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@Cameronsplaze
Copy link
Owner

Is your feature request related to a problem? Please describe.

For small games like Valheim or Minecraft (~4GB I think?), this means nothing. However if you look at something like Plex, this can explode.

Describe the solution you'd like
S3 has a problem with random read-writes that you get from Games. However EFS (even single zone) is much more expensive than S3. Maybe have an option in the config, on which paths should be backed by S3, and which by EFS. Only use S3 for large-data folders like a Plex media directory (but not it's metadata directory).

  • Stretch goal if this works out: Only create the EFS object itself if they have a mount type for it. Same for the S3 bucket.

Describe alternatives you've considered
Just leave as is, and either don't support Plex-like stuff, or be okay with the cost. This isn't a blocker if it doesn't work out, just a nice-to-have.

Additional context
We DON'T want to use DataSync. That will duplicate the data to both s3 and efs, then you're paying for both at once.

Docs/Guides on this:

@Cameronsplaze Cameronsplaze added the enhancement New feature or request label Aug 6, 2024
@Cameronsplaze Cameronsplaze changed the title [Feature] Option to use S3 for mount paths *instead of* EFS - Large Dataset Support [Feature] Add S3 as an alternative type to EFS to use inside the Volumes list - Large Dataset Support Dec 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant