Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

每天凌晨增量备份到hive/hbase #1

Open
gouchaoer opened this issue Aug 19, 2017 · 2 comments
Open

每天凌晨增量备份到hive/hbase #1

gouchaoer opened this issue Aug 19, 2017 · 2 comments

Comments

@gouchaoer
Copy link

由于是增量备份所以每天备份一次就ok了，现在是用php脚本去查询数据库然后插入hive的，能通过binlog做么，不需要实时
@jilieryuyi
Copy link
Owner

可以的，自行使用php解析binlog，得到对应的数据，wing-binlog就是这么实现的，可以用wing-binlog去实现，现在wing-binlog优化的性能很好了，可以试试！ 只需要实现一个订阅者就行了

@jilieryuyi
Copy link
Owner

另外我平时测试100万级别的数据变更，监控丢失率为0，稳定性也很好了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jilieryuyi @gouchaoer