What is the Switch method in CPP A/B Testing
The Switch method shows variants to users in separate timeframes, not simultaneously. This test method is designed to reduce the impact of demand fluctuations and seasonality when you compare custom product page variants.
This article explains how the Switch method works and when to use it. If you want help choosing between Switch tests, go to Ad Switch vs Ad Group Switch. If you want to set up a Switch test, learn how to create an Ad Group Switch test or an Ad Switch test.
How the Switch method works
In a Switch test:
- Only one custom product page variant is live at a time.
- The system rotates which variant is live based on calculated switching periods.
- Periods are calculated by analyzing demand fluctuations, so each variant is exposed under similar conditions.
This structure helps bring seasonality effects to a similar level for each variant, so the test can be performed properly.
Switch implementations
Switch has two implementations:
- Ad Group Switch: The system duplicates the ad group for each custom product page and rotates which ad group is live.
- Ad Switch: The system keeps one ad group and rotates custom product pages by toggling status.
To compare these methods, go to Ad Switch vs Ad Group Switch.
How switching periods are chosen
Switching periods can be:
- Hourly
- Daily
- Weekly
To use the Switch method and ensure statistical validity, your ad group must meet a minimum daily or hourly traffic volume.
|
Switch type |
Minimum traffic threshold |
|
Hourly switch |
≥ 100 taps OR ≥ 30 installs per 6-8 hour slot Daily switch |
|
Daily switch |
≥ 100 taps OR ≥ 30 installs per day |
If these minimum thresholds are not met, the system will automatically default your test to a Weekly switch interval to guarantee sufficient data is collected during each variant's active period.
When to use the Switch method
The Switch method is a good fit when:
- You want to compare custom product page variants without showing them at the same time.
- You want the system to account for demand fluctuations when planning exposure periods.
Related links
- Ad Switch vs Ad Group Switch in CPP A/B Testing
- How are switch periods chosen in CPP A/B Testing
- Create an Ad Group Switch test for CPP A/B Testing
- Create a multiple ad group test for CPP A/B Testing
- How do you monitor and interpret tests in CPP A/B Testing
Need more help?
If you have further questions on the process, contact your dedicated Customer Success Manager or contact the support team via live chat!