A B split testing - multiple at the same time.
Hi everyone.
Would anyone know the answer to this question please:
I am about to run my first ever split test A/B using Amazon manager your experiment tool (testing the title for my product).
Will I be able to run another experiment in amazon testing main image at the same time?
Or do I have to wait 4-8 weeks to get the results for title and only then run my main image test?
Thank you very much.
Aya
A B split testing - multiple at the same time.
Hi everyone.
Would anyone know the answer to this question please:
I am about to run my first ever split test A/B using Amazon manager your experiment tool (testing the title for my product).
Will I be able to run another experiment in amazon testing main image at the same time?
Or do I have to wait 4-8 weeks to get the results for title and only then run my main image test?
Thank you very much.
Aya
7 replies
Seller_ZJhFeE3tNKzfh
unsure but even if you could, I wouldn’t recommend it as you’d have no idea which of the tests was actually working.
Generally with AB testing, you test one thing at a time.
Seller_Y5arOb7nEajZ6
In theory, you could potentially conduct four A/B tests.
However, the issue arises when using four variables, as the A/B test would essentially transform into an AxBxCxD test. This could make it challenging to extract meaningful data to pinpoint the best metrics.
Amazon would typically provides A/B results for 4 or rather (16 (4x4, technically) separate tests, requiring extensive mathematical and manual calculations.
A more practical approach would be to start with an A/B test for images, assess the results after a week or so, and then conclude the test. Subsequently, you can experiment with optimizing your product title.
