August 31, 2025: This Week in OpenDAL

[github-actions[bot]]

This weekly update is generated by LLMs. You're welcome to join our Discord for in-depth discussions.

Overall Activity Summary

The apache/opendal repository has been highly active over the past week, with contributors focusing on backend service enhancements, CI pipeline modernization, and expanding language bindings. Notable progress has been made in improving configurability for services like S3, GCS, and Azure Blob, while discussions around new features and refactoring continue to shape the project's future.

Key Ongoing Projects

• Backend Service Enhancements:

  • feat(services/s3): add S3 tagging write support #6532 by @jackye1995 adds S3 tagging write support, enabling users to write object tags for better compatibility.
  • feat(services/gcs): Add HTTP client configuration features #6529 by @jackye1995 implements comprehensive HTTP client configuration features for GCS, providing feature parity with the object_store crate.
  • feat(services/s3): add configuration aliases for better Arrow object_store compatibility #6524 by @jackye1995 introduces configuration aliases for S3 to improve compatibility with Apache Arrow's object_store.

• CI Pipeline Modernization:

  • chore(ci): migrate etcd, memcached, redis, and redis-cluster images to new sources #6435 by @kingsword09 migrates CI images for etcd, memcached, and Redis to new sources, addressing Bitnami's upcoming restrictions on free image access.

• Language Binding Expansion:

  • Fix: make cpp binding build robust #6460 by @devillove084 improves the robustness of the C++ binding build, paving the way for better support for asynchronous features.

Priority Items

• Critical Features Awaiting Review:

  • feat(services/s3): add S3 tagging write support #6532 by @jackye1995 (S3 tagging support) and feat(services/gcs): Add HTTP client configuration features #6529 by @jackye1995 (GCS HTTP client configuration) are essential for enhancing backend capabilities.
  • feat(services/s3): add configuration aliases for better Arrow object_store compatibility #6524 by @jackye1995 (S3 configuration aliases) is crucial for improving compatibility with Apache Arrow's object_store.

• Bug Fixes:

  • bug: write operation won't split payload into chunks following configuration #6521 by @leiysky addresses a critical bug where write operations fail to split payloads into chunks as configured.

• Pending Refactor:

  • refactor!: Remove stat_has_xxx and list_has_xxx #6313 by @Xuanwo removes stat_has_xxx and list_has_xxx capabilities, requiring downstream projects to adapt.

Notable Discussions

• Replacement for Removed Capabilities:

  • Repacment API for capabilities such as list_has_content_length etc. #6522: @killme2008 raised concerns about the removal of list_has_content_length and similar capabilities, seeking guidance on alternatives.

• GitHub Models for Weekly Summaries:

  • new feature: Use GitHub Models for weekly summary generation #6519: @kingsword09 proposed migrating the weekly summary generation from OpenAI to GitHub Models for better integration and security.

• Creating Operators from Resource URIs:

  • [Feature Request] Support creating operator from resource URI #1494: @frostming suggested enabling operator creation directly from resource URIs, simplifying initialization and improving language binding support.

Emerging Trends

• Backend Configurability: Several PRs (e.g., feat(services/s3): add S3 tagging write support #6532, feat(services/gcs): Add HTTP client configuration features #6529, feat(services/s3): add configuration aliases for better Arrow object_store compatibility #6524) focus on enhancing backend configurability, reflecting a user-centric approach to storage solutions.
• CI Sustainability: Efforts like chore(ci): migrate etcd, memcached, redis, and redis-cluster images to new sources #6435 highlight the community's focus on long-term CI stability and compatibility with external dependencies.
• Language Binding Expansion: Updates to C++ (Fix: make cpp binding build robust #6460) and Python bindings indicate a push to make OpenDAL accessible across diverse programming ecosystems.

Good First Issues

• new feature: Allow s3 service to configure assume role's tags #4975: Allow S3 service to configure assume role's tags. This issue introduces contributors to S3 backend configuration and access control.
• Implement Write Returns Metadata for all services #5693: Implement Write Returns Metadata for all services. Start with simpler services like fs to extend metadata extraction.
• new feature: publish the source and lock files for binaries (oli, oay...) #6198: Publish the source and lock files for binaries. Ideal for contributors interested in improving build and release processes.
• Tracking issue: Refactor services to use the backend.rs and core.rs convention #5702: Refactor services to use the backend.rs and core.rs convention. A good entry point for contributors looking to improve code organization.
• Tracking issues of RFC-5479: Context #5480: Refactor services to adopt the new Context convention. This task is approachable and helps improve consistency across the codebase.