[Improve][Flink]supports multiple parallelisms and remove flink-specific logic from API #10107
+916
−802
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Purpose of this pull request: Fixes #9980
Problem
After implementing CDC schema evolution support in Flink engine, several issues were identified:
Solution
This PR made some minor adjustments to the architecture.:
Key Changes:
1. Enhanced LocalSchemaCoordinator
Map<String, WeakReference<LocalSchemaCoordinator>>3. Streamlined BroadcastSchemaSinkOperator
lastProcessedEpochusing Flink state4. API Compliance (Addresses #9980)
SupportSchemaEvolutionSinkWritercontains only genericapplySchemaChange()methodTesting
Breaking Changes
None. This is a refactoring that maintains API compatibility while improving internal implementation.
Related Issues
Check list
[New License Guide](https://github.com/apache/seatunnel/blob/dev/docs/en/contribution/new-license.md)
incompatible-changes.mdto describe the incompatibility caused by this PR.