Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Flink 1.13.x DynmicTableSource/Sink #16

Open
Tracked by #15
collabH opened this issue Dec 17, 2021 · 15 comments
Open
Tracked by #15

Support Flink 1.13.x DynmicTableSource/Sink #16

collabH opened this issue Dec 17, 2021 · 15 comments
Assignees
Labels

Comments

@collabH
Copy link
Owner

collabH commented Dec 17, 2021

No description provided.

@collabH collabH self-assigned this Dec 17, 2021
@collabH
Copy link
Owner Author

collabH commented Dec 18, 2021

supprot 1.13.x branch:feature_support_with_flink113x!

@duokaluo88
Copy link

大佬,支持kudu1.10不,编译出错

@collabH
Copy link
Owner Author

collabH commented Dec 18, 2021

大佬,支持kudu1.10不,编译出错

支持的改下对应的kudu-client version就行

@duokaluo88
Copy link

刚试了下,还要将RowDataUpsertOperationMapper将newDeleteIgnore 改回newDelete

@collabH
Copy link
Owner Author

collabH commented Dec 18, 2021

嗯嗯,目前flink1.13.x只兼容kudu1.12以上的版本,1.12以下的可以看下readMe去1.12的tag版本然后check pickly flink1.13增加的代码

@duokaluo88
Copy link

image
flink版本1.13.5,用flink sql 创建catalog会出现这样的错误

@collabH
Copy link
Owner Author

collabH commented Dec 20, 2021

image flink版本1.13.5,用flink sql 创建catalog会出现这样的错误

看着像是依赖问题

@duokaluo88
Copy link

image
image
image
在TableFactoryService里有这么一段判断,但我看这两个说移除了?在KuduCatalogFactory 重新加上后问题解决-。-

@collabH
Copy link
Owner Author

collabH commented Dec 20, 2021

不是flink1.13版本的吗,1.13这俩个被过期了的

@collabH
Copy link
Owner Author

collabH commented Dec 20, 2021

image image image 在TableFactoryService里有这么一段判断,但我看这两个说移除了?在KuduCatalogFactory 重新加上后问题解决-。-

看了,这个flink1.13的tableService有些问题,他升级的catalogFactory提供了新的方法替代了这俩个过期的,但是tableFactoryService里却还是使用的旧的
image

@Dkbei
Copy link

Dkbei commented Feb 9, 2022

请问能提供一个基于sql 的kudu catalog创建示例吗?

@collabH
Copy link
Owner Author

collabH commented Feb 9, 2022

请问能提供一个基于sql 的kudu catalog创建示例吗?

CREATE CATALOG catalog_name
  WITH (key1=val1, key2=val2, ...)

这种语法硬就可以,with里的key可以看下KuduCatalogFactory这个类

@collabH
Copy link
Owner Author

collabH commented Feb 9, 2022

请问能提供一个基于sql 的kudu catalog创建示例吗?

CREATE CATALOG catalog_name
  WITH (key1=val1, key2=val2, ...)

这种语法硬就可以,with里的key可以看下KuduCatalogFactory这个类

public class KuduCatalogFactory implements CatalogFactory {

@Dkbei
Copy link

Dkbei commented Feb 9, 2022

请问能提供一个基于sql 的kudu catalog创建示例吗?

CREATE CATALOG catalog_name
  WITH (key1=val1, key2=val2, ...)

这种语法硬就可以,with里的key可以看下KuduCatalogFactory这个类

public class KuduCatalogFactory implements CatalogFactory {

多谢,基于kudu1.10.0成功创建

@opoioa
Copy link

opoioa commented Mar 4, 2022

时态表无法关联
Exception in thread "main" org.apache.flink.table.api.ValidationException: Could not determine a type inference for lookup function 'default_catalog.default_database.kudu_source'. Lookup functions support regular type inference. However, for convenience, the output class can simply be a Row or RowData class in which case the input and output types are derived from the table's schema with default conversion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants