Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FLINK-37236] Flink 2.0 preview support #938

Merged
merged 3 commits into from
Feb 5, 2025
Merged

Conversation

gyfora
Copy link
Contributor

@gyfora gyfora commented Jan 30, 2025

What is the purpose of the change

This PR adds support for the 2.0 preview release of Flink. As a necessary prerequisite it also includes a bumping of the operator Flink dependency to 1.20.

The major incompatibility that was addressed here is related to the YAML config handling. Flink 2.0 only supports the new standardized yaml runtime config while 1.20 and older versions supported both the old and the new.

The operator previously only used the legacy flat yaml config. Now a new logic has been put in place for Flink 2.0 and above to automatically convert and use the new yaml configs.

Brief change log

  • Bump Flink dependency to 1.20
  • Update examples to 1.20
  • Update NOTICE Files
  • Update e2e version matrix to include 2.0
  • Introduce custom FlinkConfMountDecorator to support standard yaml configs

Verifying this change

  • Existing e2es,
  • [TODO] unit tests for FlinkConfMountDecorator

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): yes
  • The public API, i.e., is any changes to the CustomResourceDescriptors: yes
  • Core observer or reconciler logic that is regularly executed: yes

Documentation

  • Does this pull request introduce a new feature? yes
  • If yes, how is the feature documented? JavaDocs

@gyfora gyfora requested review from mxm, afedulov and 1996fanrui January 30, 2025 06:12
@gyfora gyfora force-pushed the FLINK-37236 branch 9 times, most recently from df66432 to 954893b Compare February 3, 2025 16:11
@1996fanrui 1996fanrui self-assigned this Feb 5, 2025
Copy link
Member

@1996fanrui 1996fanrui left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM assuming all tests are green.

@gyfora gyfora merged commit 3dfa820 into apache:main Feb 5, 2025
115 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants