Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update hive dependency to 2.9.3 for backwards compatibility with older hive versions #213

Merged
merged 1 commit into from
Aug 24, 2021

Conversation

Prathibha-m
Copy link
Contributor

@Prathibha-m Prathibha-m commented Aug 24, 2021

Problem

confluentinc/kafka-connect-hdfs#578

Solution

Upgrade hive to 2.9.3

Does this solution apply anywhere else?
  • yes
  • no
If yes, where?

Test Strategy

Testing done:
  • Unit tests
  • Integration tests
  • System tests
  • Manual tests

Reproduced in HDFS

[2021-08-19 17:29:33,908] INFO ugi=prathibha    ip=unknown-ip-addr      cmd=create_database: Database(name:default, description:Database created by Kafka Connect, locationUri:null, parameters:null)    (org.apache.hadoop.hive.metastore.HiveMetaStore.audit:371)
[2021-08-19 17:29:33,913] ERROR AlreadyExistsException(message:Database default already exists)
        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_database(HiveMetaStore.java:891)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
        at com.sun.proxy.$Proxy29.create_database(Unknown Source)
        at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createDatabase(HiveMetaStoreClient.java:645)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)

Release Plan

@Prathibha-m Prathibha-m requested a review from a team as a code owner August 24, 2021 05:09
@kpatelatwork
Copy link
Member

@dosvath could you please review this one?

@kpatelatwork kpatelatwork requested a review from dosvath August 24, 2021 14:18
Copy link

@dosvath dosvath left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, @Prathibha-m how was it confirmed that it solved the issue reported by the user?

@Prathibha-m
Copy link
Contributor Author

LGTM, @Prathibha-m how was it confirmed that it solved the issue reported by the user?

Thanks @dosvath, did not reproduce this issue and test. Making the fix based on the AK ticket, it makes sense to upgrade to this dependency version https://issues.apache.org/jira/browse/HIVE-24608

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants