Setting up FrameworkBenchmarks for running Ratpack benchmark locally

1. Install VirtualBox
2. Download Ubuntu Server 12.04LTS 64bit
3. Create a new 64bit VM and install the downloaded Ubuntu on it.
4. Login as the main user into the VM.
5. Generate a ssh key: ssh-keygen -t rsa
6. Ensure you can ssh into localhost without a password: cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
7. Edit sudoers file (sudo visudo) so that password is not required for sudo: %sudo ALL=NOPASSWD: ALL
8. Install git: sudo apt-get install git
9. Clone Ratpack's FrameworkBenchmar repo: git clone [email protected]:ratpack/FrameworkBenchmarks.git and cd into it. You might also want to switch to the right branch, currently it's called ratpack-dev.
10. Install benchmark dependencies: toolset/run-tests.py -s localhost -c localhost -i /home/<username>/.ssh/id_rsa -u <username> --install-software --list-tests. This will take a while. Probably more than an hour.
11. Run a benchmark for one framework: toolset/run-tests.py -s localhost -c localhost -i /home/<username>/.ssh/id_rsa -u <username> --max-threads 8 --test ratpack --duration 10. Note that plaintext benchmark is currently broken.
12. Checkout results inside of results directory

Ensure you rm -rf results before running the benchmark again - otherwise it will detect that it has previously run and won't do anything.

You can checkout other options for run-tests.py here.