Who sees the A-head, who sees the B-head during the a/b-test?

The a/b-testing tool smartocto Tentacles shows the users the original or alternative headlines. Editors who have the overlay enabled and are logged in, will always see the original title (also known as the A-headline).

The test starts with serving the same amount, but if a headline seems to be more successful, it will serve out more often to see if it is indeed more successful and to prevent loss. We want to prevent showing titles of which it is then discovered that it doesn't look to be converting.

At the same time, the tester always continues to show the other option as a cross check to see if it will not perform better.