Source code to help people reproduce the graphs presented at Data Berlin.
The test_methods notebook is a sandbox to play around with for different scenarios.
You can tweak the following parameter set:
NN: Number of experiments
N: Number of users per variant
uplift_purchase_rate: the uplift in number of purchases per player
uplift_purchase_amount: the uplift in purchase value per player
If you want to adapt the generated dataset itself to tweak it more to your needs, you have to adapt the generation.py script.