Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Spark 4.0 build failure - value cannotSaveIntervalIntoExternalStorageError is not a member of object org.apache.spark.sql.errors.QueryCompilationErrors #11611

Closed
tgravescs opened this issue Oct 15, 2024 · 1 comment · Fixed by #11610
Closed

[BUG] Spark 4.0 build failure - value cannotSaveIntervalIntoExternalStorageError is not a member of object org.apache.spark.sql.errors.QueryCompilationErrors #11611

tgravescs opened this issue Oct 15, 2024 · 1 comment · Fixed by #11610
Assignees
@jlowe @razajafri
Labels
bug Something isn't working P0 Must have for release

Comments

@tgravescs
Copy link
Collaborator

Describe the bug
Spark 4.0.0 Scala 2.13 nightly build is failing with:
[ERROR] [Error] /home/jenkins/agent/workspace/jenkins-rapids_scala213_nightly-dev-github-290/sql-plugin/src/main/spark332db/scala/org/apache/spark/sql/rapids/shims/GpuDataSource.scala:126: value cannotSaveIntervalIntoExternalStorageError is not a member of object org.apache.spark.sql.errors.QueryCompilationErrors

Looks like Spark 4.0 removed that function - apache/spark@560748c

We need to create a shim for that file.
@tgravescs tgravescs added ? - Needs Triage Need team to review and classify bug Something isn't working P0 Must have for release labels Oct 15, 2024
@razajafri razajafri self-assigned this Oct 15, 2024
@jlowe jlowe linked a pull request Oct 15, 2024 that will close this issue
Change DataSource calendar interval error to fix spark400 build [databricks] #11610
Merged
@jlowe
Copy link
Member

jlowe commented Oct 15, 2024

PR is up at #11610

@sameerz sameerz removed the ? - Needs Triage Need team to review and classify label Oct 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jlowe jlowe

@razajafri razajafri

Labels
bug Something isn't working P0 Must have for release
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Change DataSource calendar interval error to fix spark400 build [databricks] jlowe/spark-rapids
4 participants
@jlowe @tgravescs @sameerz @razajafri