Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FLINK-34930] Fork existing code from bahir-flink #1

Merged
merged 44 commits into from
May 14, 2024
Merged

[FLINK-34930] Fork existing code from bahir-flink #1

merged 44 commits into from
May 14, 2024

Commits on Mar 26, 2024

  1. [FLINK-34930] Initialize tools/ and vcs.xml

    @ferenc-csaky
    ferenc-csaky committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    afd3f13 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. [FLINK-34930] Remove Python CI

    @ferenc-csaky
    ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    3e1045b View commit details
    Browse the repository at this point in the history

  2. [BAHIR-99] kudu connector

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    64df367 View commit details
    Browse the repository at this point in the history

  3. [BAHIR-179] Fail Docker integration tests silently 

    When running docker based integration tests locally,
fail silentily if env requirements not available.

Closes #38
Closes #35
    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    380d979 View commit details
    Browse the repository at this point in the history

  4. [BAHIR-194] bump kudu version to 1.8.0 

    Closes 44
    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    d09e3d7 View commit details
    Browse the repository at this point in the history

  5. [BAHIR-180] Improve eventual consistence for Kudu connector 

    Closes #40
    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    cee8a73 View commit details
    Browse the repository at this point in the history

  6. [BAHIR-199] Bump kudu version to 1.9.0 

    Closes #48
    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    90c0660 View commit details
    Browse the repository at this point in the history

  7. [BAHIR-202] Improve KuduSink throughput using async FlushMode 

    By default, KuduSink processing message one by one
without checkpoint. When checkoint is enabled, throughput
is improved by using FlushMode.AUTO_FLUSH_BACKGROUND,
and use checkpoint to ensure at-least-once.

Closes #50
    @suxinglee @ferenc-csaky
    suxinglee authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    2b34864 View commit details
    Browse the repository at this point in the history

  8. [BAHIR-200] Move tests from docker to kudu-test-utils (#49)

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    83ae04b View commit details
    Browse the repository at this point in the history

  9. [BAHIR-209] upgrade kudu version to 1.10.0 (#61)

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    1799957 View commit details
    Browse the repository at this point in the history

  10. [BAHIR-207] Add tests for scala 2.12 on travis (#59)

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    4e71c17 View commit details
    Browse the repository at this point in the history

  11. [BAHIR-214] Improve speed and solve eventual consistence issues (#64) 

    * resolve eventual consistency issues
* improve speed special on eventual consistency stream
* Update Readme
    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    eb7d959 View commit details
    Browse the repository at this point in the history

  12. Add support "upsert part of columns of a kudu table" (#70) 

    Sometimes we don't want to upsert all columns of a kudu table. 
So we need to support the function that upsert part of columns
of a kudu table.
    @lintingbin @ferenc-csaky
    lintingbin authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    e9c1f21 View commit details
    Browse the repository at this point in the history

  13. Fix "the client has already been closed" bug (#75) 

    Fix the problem "Caused by: java.lang.IllegalStateException:
Cannot proceed, the client has already been closed" when 
running in Flink local mode
    @CruxWW @ferenc-csaky
    CruxWW authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    e58d42f View commit details
    Browse the repository at this point in the history

  14. Fix NotSerializableException in Kudu connector (#74)

    @lintingbin @ferenc-csaky
    lintingbin authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    113e78c View commit details
    Browse the repository at this point in the history

  15. Kudu Connector rework (#78) 

    Kudu connector rework including the addition of a
connector to the Table API for it. 

Co-authored-by: Gyula Fora <[email protected]>
Co-authored-by: Balazs Varga <[email protected]>
    @mbalassi @thebalu @ferenc-csaky
    3 people authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    f58f0d9 View commit details
    Browse the repository at this point in the history

  16. Add batch table env support and filter push down to Kudu connector (#82) 

    Update the KuduTableSource to inherit from InputFormatTableSource
in order to support both streaming SQL and Batch SQL at the same time.
In order to reduce unnecessary data transmission, the filter push down
was also added to the KuduTableSource.
    @sebastianliu @ferenc-csaky
    sebastianliu authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    0bb7c4f View commit details
    Browse the repository at this point in the history

  17. BAHIR-240: replace docker test by testcontainer (#89)

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    0edb468 View commit details
    Browse the repository at this point in the history

  18. [BAHIR-241] Upgrade all connectors to Flink 1.11 (#99) 

    Co-authored-by: Gyula Fora <[email protected]>
    @gyfora @ferenc-csaky
    2 people authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    1344d41 View commit details
    Browse the repository at this point in the history

  19. [BAHIR-263] Update flink to 1.12.2 (#115)

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    4f38647 View commit details
    Browse the repository at this point in the history

  20. [BAHIR-260] Add kudu table writer config (#109)

    @hackergin @ferenc-csaky
    hackergin authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    49cbc96 View commit details
    Browse the repository at this point in the history

  21. [BAHIR-293] Fix documentation tables

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    625568e View commit details
    Browse the repository at this point in the history

  22. [BAHIR-291] Bump flink to 1.14.0 (#136)

    @RocMarshal @ferenc-csaky
    RocMarshal authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    29fdcf7 View commit details
    Browse the repository at this point in the history

  23. [BAHIR-296] Unify log4j libs

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    0619722 View commit details
    Browse the repository at this point in the history

  24. BAHIR-296: Unify mockito version to 1.10.19

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    e22b414 View commit details
    Browse the repository at this point in the history

  25. [BAHIR-302] Add enforcers

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    cc90226 View commit details
    Browse the repository at this point in the history

  26. [BAHIR-243] Change KuduTestHarness with TestContainers

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    02d2990 View commit details
    Browse the repository at this point in the history

  27. [BAHIR-302] Group declaration of flink dependencies on parent pom

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    a45f81d View commit details
    Browse the repository at this point in the history

  28. [maven-release-plugin] prepare for next development iteration

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    191070a View commit details
    Browse the repository at this point in the history

  29. [BAHIR-305] Kudu Flink SQL Support DynamicSource/Sink&LookupFunction

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    575eb1a View commit details
    Browse the repository at this point in the history

  30. [BAHIR-312] Add license header to README.md files

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    258b8fe View commit details
    Browse the repository at this point in the history

  31. [BAHIR-321] Make KuduFilterInfo handle String literals

    @thebalu @ferenc-csaky
    thebalu authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    606b16f View commit details
    Browse the repository at this point in the history

  32. [BAHIR-308] Remove support for scala 2.11

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    011e8fa View commit details
    Browse the repository at this point in the history

  33. [BAHIR-308] Bump flink version to 1.15.3

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    228330f View commit details
    Browse the repository at this point in the history

  34. [BAHIR-308] Remove scala prefix where we can

    @eskabetxe @ferenc-csaky
    eskabetxe authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    1970751 View commit details
    Browse the repository at this point in the history

  35. [BAHIR-324] Closing KuduReader at JobManager

    @collabH @ferenc-csaky
    collabH authored and ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    b58b690 View commit details
    Browse the repository at this point in the history

  36. [FLINK-34930] Adapt POM files to the new structure, remove flink-shad… 

    …ed Guava usage
    @ferenc-csaky
    ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    a4d2fb9 View commit details
    Browse the repository at this point in the history

  37. [FLINK-34930] Apply spotless code format and checkstyle rules

    @ferenc-csaky
    ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    c70031d View commit details
    Browse the repository at this point in the history

  38. [FLINK-34930] Rename base package

    @ferenc-csaky
    ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    58bf05e View commit details
    Browse the repository at this point in the history

  39. [FLINK-34930] Fix KuduTableSourceITCase

    @ferenc-csaky
    ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    0d8e1c4 View commit details
    Browse the repository at this point in the history

  40. [FLINK-34930] State Bahir fork

    @ferenc-csaky
    ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    73178c8 View commit details
    Browse the repository at this point in the history

  41. [FLINK-34930] Skip spotless for JDK 21+

    @ferenc-csaky
    ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    2385c8e View commit details
    Browse the repository at this point in the history

  42. [FLINK-34930] Enable module opens for tests for newer JDKs

    @ferenc-csaky
    ferenc-csaky committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    121eecb View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. [FLINK-34930] Migrate Bahir NOTICE

    @ferenc-csaky
    ferenc-csaky committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    519e0af View commit details
    Browse the repository at this point in the history