This library provides a layer to run AB tests on your applications.
AB testing is useful when you want to change anything on your application but want to benchmark different variations of the change (ie. display a button that says "Buy now", "Go to checkout" or "PAY, DUDE!").
This library is available through composer, as you can see from its packagist page.
Just require it in your composer.json:
"namshi/ab": "1.0.*"
Creating tests is very simple, as you only need to define the test name and the variations, with their absolute probability:
use Namshi\AB\Test;
$homepageColorTest = new Test('homepage_color', array(
'blue' => 1,
'red' => 1,
));and at this point you can change the color of the homepage by simply running the test and checking which variation has been picked:
<html>
...
...
<body style="background-color: <?php echo $homepageColorTest->getVariation(); ?>">Of course, the mess of a code above is here just as an example ;-)
Taken by an AB-test-rage, you might want to start using AB tests for everything: that's why we added a test container where you can register as much tests as you want, and retrieve them easily:
use Namshi\AB\Container;
use Namshi\AB\Test;
// instantiate the container with a test
$container = new Container(array(
new Test('homepage_color', array(
'blue' => 1,
'black' => 2,
)),
));
// add another test
$container->add(new Test('checkout_button_text', array(
'Buy now' => 4,
'Go to checkout' => 1,
'Proceed to checkout' => 1,
)));
// then you can retrieve all the tests
$container->getAll();
// or a single test, by its name
$container->get('checkout_button_text');The Container implements the ArrayAccess and
Countable interfaces, so that you can access its
tests like if it is an array:
$tests = $container; // I only do this for readability
foreach($tests as $test) {
echo sprintf("Test '%s' has the variation %s", $test->getName(), $test->getVariation());
}
// if you have time to waste, count the tests :)
echo count($tests);Variations' weight must be expressed in absolute values: if, for
example, you have A: 1, B: 2 and C: 1, that means that the
percentage of picking each variation is 25% (A), 50% (B) and
25%(C), as the sum of the weights is 4.
Variations can be set while constructing the test or later on:
$test = new Test('checkout_button_text', array(
'Buy now!' => 1,
'Go to checkout!' => 1,
));
// or you can set them afterwards
$test = new Test('checkout_button_text');
$test->setVariations(array(
'Buy now!' => 1,
'Go to checkout!' => 1,
));Remember to set the variations before running the test
with getVariation, else an exception is thrown:
$test = new Test('checkout_button_text');
$test->getVariation(); // will throw a BadMethodCallExceptionLet's say that you are running a test that defines whether the background color of your website should be black or white.
Once a user hits the homepage, he will get the white one, but as soon as he refreshes the page he might get the white one!
To be consistent with the variations, for a user's session, you should store a unique number (seed) and pass it to the tests before running them, so you will always be sure that specific user will always get the same variations of the tests:
$test = new Test('homepage_color', array(
'white' => 1,
'black' => 1,
));
// set the seed
$test->setSeed($_SESSION['seed_for_homepage_color_test']); // 326902637627;
$test->getVariation(); // blackIn the next request, since the seed won't change,
the user will get again the same variation, black.
This functionality is implemented thanks to
PHP's mt_rand and mt_srand functions.
You shouldn't specify a different seed for each of your tests, but use the container instead:
$container = new Container(new Test('homepage_color', array(
'black' => 1,
'white' => 1,
)));
$container->setSeed($_SESSION['seed']); // 326902637627;);The advantage of setting the seed through the container is that
you don't have to maintain a seed for every test you run in
the session, you can just use a global seed and the container
will assign a unique seed to each test by combining the general
seed and a numerical version of the tests' name (abce becomes 1235).
Sometimes you might want to disable tests for different purposes, for example if the user agent who is visiting the page is a bot.
$test = new Test('my_ab_test', array(
'a' => 0,
'b' => 1,
));
$test->disable();
$test->getVariation(); // will return 'a'!Once you disable the test and run it, it will always return the first variation, no matter what its odds are! Yes, even zero...
You can also attach any parameter you want to
a test by just injecting them (or with the set
method):
$test = new Test('example', array(1, 2), array(
'par1' => 1,
'par2' => new stdClass,
));
$test->set('par3', 'Whoooops!')So that you can then easily retrieve them in other parts of the code:
$test->getParameters(); // returns all the parameters
$test->get('par3'); // Whoooops!
$test->get('i-dont-exist'); // NULLThis library has been unit tested with
PHPUnit,
so just cd into its folder and run phpunit.
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent