Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

load_gen improvement w/ more statistics #177

Closed
emaxerrno opened this issue Dec 9, 2017 · 1 comment
Closed

load_gen improvement w/ more statistics #177

emaxerrno opened this issue Dec 9, 2017 · 1 comment

Comments

@emaxerrno
Copy link
Collaborator

Currently the RPC project comes with built-in load generator and statistics of latency only.

It also has average bytes per second per core and other minor ones.

We need new framework for extending the statistics

Facebook's Threadmill https://github.com/facebook/treadmill/blob/master/ContinuousStatistic.cpp

has an interesting design we should study and see what would could be ported in a way that is:

  1. Seastar friendly (no locks, atomics, synchronization)
  2. Does not add too much overhead to the measured system

Our histograms are very friendly as we preallocate 158KB per core - for all latency metrics, so updating them is very cheap

Future additional improvements also from Iago: twitter's load tester is different load distributions.

exponential, sustained, spiky, etc

with a WARM-up step

Currently we measure latencies of ALL requests. This is problematic because the first connection is very costly - usualy - since we do lazy initialization of most things, including cache fetching etc.

@emaxerrno
Copy link
Collaborator Author

Duplicate of #257

@emaxerrno emaxerrno marked this as a duplicate of #257 Nov 28, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant