CODEWITHSUNDEEP
firebaseab-testingfirebase-remote-config
DiRiNoiD
DiRiNoiD

Reputation: 1361

Android Firebase AB Testing

I set up a firebase AB testing with Remote Config. I reached 10k users sample, after that firebase says "It is still too risky to declare a leader". So what is the minimum sample rate to declare an exact leader? Is there any official explanation in docs? Is there any formula how to calculate this? Thanks.

Upvotes: 1

Views: 414

Answers (1)

Igor Urisman
Igor Urisman

Reputation: 798

The sample size required to call an experiment depends on a couple of things, including the observed difference in the target metric: the smaller the observed effect of the treatment, the more observations you need to support the hypothesis that the observed difference is not due to chance alone. See if this paper helps you. (Note further reading list at the end.)

Upvotes: 1

Related Questions