Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[rocketmq-replicator] Realize consumption offset synchronization #844

Open
Git-Yang opened this issue Oct 27, 2021 · 3 comments
Open

[rocketmq-replicator] Realize consumption offset synchronization #844

Git-Yang opened this issue Oct 27, 2021 · 3 comments

Comments

@Git-Yang
Copy link
Member

  1. Please describe the feature you are requesting.
  • Provide MetaSinkTask, call MetaSinkTask in WorkerDirectTask to write data directly to the target cluster.
  • In MetaSinkTask, the updateConsumeOffset method will be called to update the target cluster consumeOffset.
  1. Provide any additional detail on your proposed use case for this feature.
  1. Indicate the importance of this issue to you (blocker, must-have, should-have, nice-to-have). Are you currently using any workarounds to address this issue?
  • should-have
  1. If there are some sub-tasks using -[] for each subtask and create a corresponding issue to map to the sub task:
  • Maintain BrokerName mapping(ISSUE has not been submitted)
  • Maintain the ConsumeOffset deviation between the target cluster and the source cluster(ISSUE has not been submitted)
@Git-Yang
Copy link
Member Author

@lizhiboo Hello, do you think the above implementation is not in line with the original intention of the community design? Can I have a brief conversation with you?

@lizhiboo
Copy link
Contributor

lizhiboo commented Nov 2, 2021

@lizhiboo Hello, do you think the above implementation is not in line with the original intention of the community design? Can I have a brief conversation with you?

My apologize, I think all tasks is finished.

@lizhiboo lizhiboo reopened this Nov 2, 2021
@Git-Yang Git-Yang changed the title [rocketmq-replicator] Add MetaSinkTask [rocketmq-replicator] Realize consumption offset synchronization Nov 15, 2021
@odbozhou
Copy link
Contributor

rocketmq-connect already has an independent repository, you can go to this repository to submit PR, issue.
https://github.com/apache/rocketmq-connect

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants