Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

After capturing DDL statements, DML statements cannot be captured #99

Open
liujiyu-fighting opened this issue Jan 12, 2021 · 2 comments

Comments

@liujiyu-fighting
Copy link

After modifying the table structure of the source database, DDL statements are captured normally, but continue to test the DML statements and report an error if they are invalid

Is there any solution?

Can DDL capture be turned off?

thank

dml:
{"SCN":2951732,"SEG_OWNER":"WHTEST","TABLE_NAME":"T1","TIMESTAMP":1610443493000,"SQL_REDO":"update "WHTEST"."T1" set "NAME" = '123333 ' where "ID" = 1589033 and "NAME" = '123 ' and "CREATETIME" = TIMESTAMP ' 2020-12-24 16:18:48' and "COL4" = 123","OPERATION":"UPDATE","data":{"ID":1589033.0,"NAME":"123333","CREATETIME":1608797928000,"COL4":123.0},"before":{"ID":1589033.0,"NAME":"123","CREATETIME":1608797928000,"COL4":123.0},"DATABASE":"dhpoc"}

ddl:
{"SCN":2951746,"SEG_OWNER":"WHTEST","TABLE_NAME":"_GENERIC_DDL","TIMESTAMP":1610443520000,"SQL_REDO":"ALTER TABLE "WHTEST"."T1" ADD (col5 INTEGER)","OPERATION":"DDL","data":null,"before":null,"DATABASE":"dhpoc"}

error information:
ERROR Error during poll on topic cdczztar SQL :update "WHTEST"."T1" set "COL 2" = HEXTORAW('31202020202020202020') where "COL 1" = HEXTORAW('c4023b5b22') and "COL 2" = HEXTORAW('31323333333320202020') and "COL 3" = HEXTORAW('78780c18111331') and "COL 4" = HEXTORAW('c20218') and "COL 5" IS NULL (com.ecer.kafka.connect.oracle.OracleSourceTask:298)
java.lang.NullPointerException

this is my connect information:

curl -X POST -H "Content-Type: application/json" --data "{
"name":"C_DHWX_DHWSC_WHTEST",
"config":{
"topic":"cdczztar",
"connector.class":"com.ecer.kafka.connect.oracle.OracleSourceConnector",
"db.name":"dhpoc",
"db.hostname":"10.248.1.1",
"db.port":"1521",
"db.user":"kminer",
"db.user.password":"kminerpass",
"db.name.alias":"dhpoc",
"tasks.max":"6",
"db.fetch.size":"1",
"table.whitelist":"WHTEST.*",
"table.blacklist":"",
"parse.dml.data":"true",
"reset.offset":"false",
"transforms":"InsertSource",
"transforms.InsertSource.type":"org.apache.kafka.connect.transforms.InsertField$Value",
"transforms.InsertSource.static.field":"DATABASE",
"transforms.InsertSource.static.value":"dhpoc",
"multitenant":"false"}
}" http://0.248.1.1:8083/connectors/

@liujiyu-fighting liujiyu-fighting changed the title After capturing DML statements, DDL statements cannot be captured After capturing DDL statements, DML statements cannot be captured Jan 12, 2021
@erdemcer
Copy link
Owner

Hi,
I am checking this issue.
Thanks

@wangkun-s
Copy link

Hello, I have the same problem. Have you solved it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants