From 04d495dd08d89cecf48fecf27d963c796c001484 Mon Sep 17 00:00:00 2001 From: Juraj Majerik Date: Tue, 16 Jul 2024 15:06:03 +0200 Subject: [PATCH] fix --- contents/docs/experiments/experiment-significance.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/contents/docs/experiments/experiment-significance.mdx b/contents/docs/experiments/experiment-significance.mdx index d4ffbed4d6ba..18ed2b0c753c 100644 --- a/contents/docs/experiments/experiment-significance.mdx +++ b/contents/docs/experiments/experiment-significance.mdx @@ -93,7 +93,7 @@ To calculate significance, we measure p-values using a [Poisson means test](http For your results and conclusions to be valid, any experiment must have significant exposure. For instance, if you test a product change and only one user sees the change, you can't extrapolate from that single user that the change will be beneficial or detrimental. This principle holds true for any simple randomized controlled experiment, such as those used in testing new drugs or vaccines. -Even with a large sample size (e.g., approximately 10,000 participants), results can still be ambiguous. For example, if the difference in conversion rates between variants is less than 1%, it becomes difficult to determine if one variant is truly better than the other. To achieve statistical significance, there must be a sufficient difference between the conversion rates given the exposure size. +Even with a large sample size (e.g. ~10,000 participants), results can still be ambiguous. For example, if the difference in conversion rates between variants is less than 1%, it becomes difficult to determine if one variant is truly better than the other. To achieve statistical significance, there must be a sufficient difference between the conversion rates given the exposure size. PostHog computes this statistical significance for you automatically. We display on the results page when your experiment has reached statistically significant results, making it safe to draw conclusions and terminate the experiment.