Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can twemproxy a solution for stale data handling when using consistent hashing #134

Closed
ryanc4 opened this issue Aug 9, 2013 · 1 comment

Comments

@ryanc4
Copy link

ryanc4 commented Aug 9, 2013

Hi,

I am new to twemproxy but we have extensively using memcached in the past.

One of the problem that force us not using memcached with consistent hashing is the network partitioning problem:

a. we have a lot of memcached clients and servers
b. if a particular client failed to connect to one server (say. OldM), consistent hashing will map into another server (NewM), new data will write to the NewM from the client
c. if other servers are able to connect to the OldM, so now clients have different hashing.
d. Stale data then will occur

I am thinking if using twemproxy in a ACTIVE-PASSIVE would solve the issue for me. Anyone mind to share your experience.?

@TysonAndre
Copy link
Collaborator

The "failover" patch planned in #608 may help with that - instead of failing over to a host within the pool (auto_eject_hosts: true), fail over to a host in a different pool.

Then automatically clear the failover pool when the failover pool stops getting traffic, to avoid storing the data after all hosts in the main pool recover

I am thinking if using twemproxy in a ACTIVE-PASSIVE would solve the issue for me. Anyone mind to share your experience.?

I'm not certain what this means

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants