Skip to content

Concurrency (Map/Parallel) Comprehensive Sweep #37

@yaythomas

Description

@yaythomas

Context

GitHub Reference: concurrency.py#L354

Comprehensive update to map/parallel operations including multiple sub-tasks.

Sub-tasks

7.1 Summary Generator (Add to runInChildContext)

  • Add summary generation capability to runInChildContext

7.2 Map/Parallel Top-level Serdes

  • Implement top-level serialization/deserialization for map/parallel operations

item_serdes - item/child level

If top-level serdes not specified, should serialize BatchResult by default (with each child item serialized already using the default serializer or item_serdes serializer).

7.3 Latest Logic Updates for Task Completion

  • Update task completion logic to match latest service behavior
  • Ensure proper handling of partial completions
  • Implement correct timeout and cancellation behavior
  • Address code quality issues at line 354 and surrounding areas
  • Improve error handling and logging
  • Optimize performance for large parallel operations

Implementation Details

  • File: src/aws_durable_execution_sdk_python/concurrency.py
  • Focus Areas: Lines around 106 and 354
  • Dependencies: May require updates to serdes.py and state.py

Acceptance Criteria

  • Summary generator integrated into runInChildContext
  • Map/parallel serialization works correctly
  • Task completion logic matches service behavior
  • Code quality issues resolved
  • Performance optimized for large operations
  • Comprehensive test coverage

Priority: High
Estimated Effort: 2 days

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions