Skip to content

Test Databricks 17.3 LTS in Delta Lake connector #27100

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 3 commits into
base: master
Choose a base branch
from
Draft

Test Databricks 17.3 LTS in Delta Lake connector #27100

wants to merge 3 commits into from
+115 −21

Conversation

@ebyhr
Copy link
Member

@ebyhr ebyhr commented Oct 25, 2025 •
edited
Loading

Description

Test Databricks 17.3 LTS in Delta Lake connector

Release notes

## Delta Lake
* Fix failure when writing to tables written by Databricks 17.3. ({issue}`27100`)

Summary by Sourcery

Introduce testing for Databricks 17.3 LTS in the Delta Lake connector by adding a new test suite, environment configuration, and CI support.

New Features:

  • Add SuiteDeltaLakeDatabricks173 and EnvSinglenodeDeltaLakeDatabricks173 to enable product testing against Databricks Runtime 17.3 LTS.

Enhancements:

  • Extend test group constants to include DELTA_LAKE_DATABRICKS_164 and rename the exclusion group to DELTA_LAKE_EXCLUDE_173.
  • Update existing Delta Lake product tests to include the new 16.4 group and remove outdated exclusions where applicable.

Build:

  • Update CI workflow to run the suite-delta-lake-databricks173 job and configure the DATABRICKS_173_JDBC_URL environment variable.

Documentation:

  • Update connector documentation to list support for Databricks Runtime 17.3 LTS.

@cla-bot cla-bot bot added the cla-signed label Oct 25, 2025
@github-actions github-actions bot added the docs label Oct 25, 2025
@sourcery-ai

This comment was marked as spam.

Sign in to view
ebyhr
ebyhr commented Oct 25, 2025
View reviewed changes
.github/workflows/ci.yml
DATABRICKS_143_JDBC_URL: ${{ vars.DATABRICKS_143_JDBC_URL }}
DATABRICKS_154_JDBC_URL: ${{ vars.DATABRICKS_154_JDBC_URL }}
DATABRICKS_164_JDBC_URL: ${{ vars.DATABRICKS_164_JDBC_URL }}
DATABRICKS_173_JDBC_URL: jdbc:databricks://dbc-88a53597-967a.cloud.databricks.com:443/default;transportMode=http;ssl=1;httpPath=sql/protocolv1/o/336535122231371/1025-002500-3q7gmg8y;AuthMech=3;EnableArrow=0
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TODO: Replace with ${{ vars.DATABRICKS_173_JDBC_URL }} once the var is added.

@ebyhr ebyhr force-pushed the ebi/databricks-173 branch from 9d0313e to 0786c46 Compare October 25, 2025 07:34
@ebyhr ebyhr force-pushed the ebi/databricks-173 branch from 0786c46 to d0a937a Compare October 27, 2025 00:23
@github-actions github-actions bot added the delta-lake Delta Lake connector label Oct 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

cla-signed delta-lake Delta Lake connector docs

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@ebyhr