Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for downloader middleware to read WACZ files from Google Cloud Storage #24

Open
4 tasks
leewesleyv opened this issue Dec 31, 2024 · 0 comments
Open
4 tasks
Labels
enhancement New feature or request

Comments

@leewesleyv
Copy link
Collaborator

leewesleyv commented Dec 31, 2024

Currently, the downloader middleware supports reading WACZ files from local storage and Amazon S3. To enhance the flexibility of the middleware, it would be beneficial to add support for reading WACZ files stored in Google Cloud Storage (GCS).

Proposed Changes

Implement a new GCSZipStorageHandler class extending the ZipStorageHandler base class.
Use the Google Cloud Storage API to fetch files and metadata using range requests for optimal performance. Update the ZipStorageHandlerFactory to recognize gs:// URIs and return the GCSZipStorageHandler.

Tasks

  • Create GCSZipStorageHandler with methods for fetching files and metadata.
  • Update the ZipStorageHandlerFactory to handle gs:// URIs.
  • Write unit tests for GCSZipStorageHandler.
  • Update documentation to include GCS support.
@leewesleyv leewesleyv added the enhancement New feature or request label Dec 31, 2024
@leewesleyv leewesleyv changed the title Add support for downloader middleware to read WACZ files from Google Cloud Add support for downloader middleware to read WACZ files from Google Cloud Storage Dec 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant