You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, the downloader middleware supports reading WACZ files from local storage and Amazon S3. To enhance the flexibility of the middleware, it would be beneficial to add support for reading WACZ files stored in Google Cloud Storage (GCS).
Proposed Changes
Implement a new GCSZipStorageHandler class extending the ZipStorageHandler base class.
Use the Google Cloud Storage API to fetch files and metadata using range requests for optimal performance. Update the ZipStorageHandlerFactory to recognize gs:// URIs and return the GCSZipStorageHandler.
Tasks
Create GCSZipStorageHandler with methods for fetching files and metadata.
Update the ZipStorageHandlerFactory to handle gs:// URIs.
Write unit tests for GCSZipStorageHandler.
Update documentation to include GCS support.
The text was updated successfully, but these errors were encountered:
leewesleyv
changed the title
Add support for downloader middleware to read WACZ files from Google Cloud
Add support for downloader middleware to read WACZ files from Google Cloud Storage
Dec 31, 2024
Currently, the downloader middleware supports reading WACZ files from local storage and Amazon S3. To enhance the flexibility of the middleware, it would be beneficial to add support for reading WACZ files stored in Google Cloud Storage (GCS).
Proposed Changes
Implement a new
GCSZipStorageHandler
class extending theZipStorageHandler
base class.Use the Google Cloud Storage API to fetch files and metadata using range requests for optimal performance. Update the
ZipStorageHandlerFactory
to recognizegs://
URIs and return theGCSZipStorageHandler
.Tasks
gs://
URIs.The text was updated successfully, but these errors were encountered: