Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure Camel Kafka Sink Connector - Avro File Format Issue #1609

Open
chethan-bs opened this issue Mar 19, 2024 · 3 comments
Open

Azure Camel Kafka Sink Connector - Avro File Format Issue #1609

chethan-bs opened this issue Mar 19, 2024 · 3 comments

Comments

@chethan-bs
Copy link

chethan-bs commented Mar 19, 2024

We are using Data Lake Sink connector for Azure storage account . We would like to store the files where it will be serialized in Avroformat. Is there any sample connector configurations that you can share for the same. @valdar

@oscerd
Copy link
Contributor

oscerd commented Mar 19, 2024

Write your own SMT. It's the faster solution.

@chethan-bs
Copy link
Author

@oscerd we have built custom smt , and post custom connect record , though we send avrobyte (Binary encoded) value , the connector sink worker is deserailizing when it creates the file for storage account. Is there any connector configuration which will send the custom record as such to Storage account . Is it something like marshal or unmarshal config or somethign else. Can you give an example connector config if in case you address this.

@oscerd
Copy link
Contributor

oscerd commented Mar 27, 2024

The upload operation in the component will use an InputStream. Also without see what you're doing with the smt it's impossible to help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants