CODEWITHSUNDEEP
iosfirebaseconditional-statementsfirebase-remote-config
esbenr
esbenr

Reputation: 1524

Testing/verifying A/B testing with Firebase Remote Config in iOS

I'm using Firebase Remote Config to set up an A/B test on iOS.

Everything is set up, and I'm reading the server side default value in the iOS app.

But trying on multiple simulators, they all read the default value. I suspect, that Google knows I'm the same user, based on my IP, so maybe they're just doing their thing.

How do I test / verify, that users are getting distributed into the variatons?

Here's some more info on my test:

Since I'm testing a new feature ("Press" or "Hold"), I don't have a baseline/default with no changes. So in the "Conditions", I've created two conditions. One with "applies if User in random percentile <= 50 %" and one with "applies if User in random percentile > 50 %". This will, as I've understood it, direct half the traffic into the 1st condition and the rest into the 2nd condition. Conditions

In the "Parameters", I've created one parameter with a value "Hold" for the above 1st condition, value "Press" for the above 2nd condition and "None" for the default value. Parameter

Using the parameter key in the iOS app, after fetching, I always get the "None" value on any simulators. I've also tried uninstalling and installing the app multiple times. Always "None"

Firebase will try to see to, that the same user gets the same value/experience every time, so I have to assume that, based on the simulators has the same IP (maybe MAC address from my mac).

I could upload the app to TestFlight and try it out on multiple devices, but this seems rather cumbersome. There must be a way to test/verify or at least simulate, the 50% distribution I configures in my condition.

Upvotes: 3

Views: 2352

Answers (1)

Todd Kerpelman
Todd Kerpelman

Reputation: 17523

On iOS, you should be able to see different setups simply by deleting and then reinstalling your app.

Try that a few times and, after 6 or 7 tries, if you're still not seeing different results, there might be something wrong with your setup. Either that, or you're incredibly lucky and you should go visit your local roulette table. :)

Upvotes: 1

Related Questions