---
title: How do you interpret results and confidence badges
description: CPP A/B Testing helps you compare variants using performance metrics and a confidence badge. Learn more.
---

[Skip to content](https://helpcenter.mobileaction.co/en/how-do-you-interpret-results-and-confidence-badges#main-content)

[![MobileAction Logo](https://helpcenter.mobileaction.co/hs-fs/hubfs/logo_black_medium-1.png?width=145&height=48&name=logo_black_medium-1.png)](https://www.mobileaction.co/)

- [Website](https://www.mobileaction.co/)
- [Help Center](https://helpcenter.mobileaction.co/en)

Open main navigation

Close main navigation

- [Website](https://www.mobileaction.co/)
- [Help Center](https://helpcenter.mobileaction.co/en)

 Advice and answers from the MobileAction Team

- There are no suggestions because the search field is empty.

1. [Help Center](https://helpcenter.mobileaction.co/en?hsLang=en)
2. [MobileAction CMP](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en)
3. [CPP A/B Testing](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#cpp-a-b-testing)

# How do you interpret results and confidence badges

CPP A/B Testing helps you compare variants using performance metrics and a confidence badge.

This article explains what you can see in results, what the confidence badges mean, and how baseline comparison works. If you want to learn where to find these views, go to [How do you monitor tests in CPP A/B Testing](https://helpcenter.mobileaction.co/en/how-to-monitor-cpp-a-b-tests-in-the-dashboard?hsLang=en)

 What you compare in results

In the [CPP A/B Testing dashboard](https://searchads.mobileaction.co/cpp-ab-testing/), each test shows a table of variants with metrics such as:

- Impressions
- Tap-Through Rate (TTR)
- Conversion Rate (CR)
- Cost Per Tap (CPT)
- Average CPA
- Confidence level badge

You can use these metrics to compare how each variant performs.

**Note:** If you want Apple’s official definitions for these performance metrics, see [Reporting Options and Definitions](https://ads.apple.com/app-store/help/reporting/0023-reporting-options-and-definitions).

### Benchmark Summary

Each test shows a Benchmark Summary above the variant table, with the benchmark data from when the test was created (Impressions, TTR, CR, CPT, and CPA). Use it as a fixed baseline to judge whether a variant is improving on the starting point, not only how variants compare against each other.

### Top Performer badge

Each performance metric (TTR, CR, Average CPT, and Average CPA) shows a Top Performer badge on the variant leading that metric so far. One variant can lead on TTR while another leads on Average CPA, so read the badges metric by metric rather than looking for a single overall winner.

### Confidence level badges

Each variant shows a confidence level badge.

- **Green badge**: the variant reached the desired confidence (statistically significant).
- **Gray badge**: the test is still collecting data for that variant.

### Baseline comparison

To help you understand performance differences, the dashboard supports baseline comparison.

- Hover over metrics to see the **baseline (default product page)** for comparison.
- Tooltips explain every metric in plain language.

### Use table and chart views together

You can compare results in:

- **Table view** for a snapshot across all variants
- **Chart view** for trends over time

In chart view:

- Each variant is represented by a line.
- You can switch the metric shown using the metric dropdown (for example CR, TTR, CPT).

### If there is no significant difference

A test can end without a clear winner. If no variant clearly outperforms the others:

- Review metrics like impressions, CR, and TTR to choose the most promising option.
- A lack of significant difference indicates the variants are likely to perform similarly over time.

The test does not guarantee one variant will outperform another. It is designed to ensure that, given your selected precision and confidence level, results are statistically sound and comparable.

### Related links

- [How do you monitor tests in CPP A/B Testing](https://helpcenter.mobileaction.co/en/how-to-monitor-cpp-a-b-tests-in-the-dashboard?hsLang=en)
- [What are the requirements and limits for CPP A/B Testing](https://helpcenter.mobileaction.co/en/what-are-the-requirements-and-limits-for-cpp-a-b-testing?hsLang=en)
- [Test health and issue management in CPP A/B Testing](https://helpcenter.mobileaction.co/en/keep-cpp-a-b-tests-healthy-and-fix-issues?hsLang=en)
- [Frequently asked questions about CPP A/B Testing](https://helpcenter.mobileaction.co/en/frequently-asked-questions?hsLang=en)

---

### Need more help?

If you have further questions on the process, contact your dedicated Customer Success Manager or contact the support team via live chat!

- [Quick Guide to MobileAction](https://helpcenter.mobileaction.co/en/quick-guide-to-mobileaction?hsLang=en)
- [MobileAction CMP](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#main-content)

    - [Apple Ads Integration](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#apple-ads-integration)
    - [AI Assistant](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#ai-assistant)
    - [Overview](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#overview)
    - [Ads Manager](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#ads-manager)
    - [Automations](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#automations)
    - [CPP A/B Testing](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#cpp-a-b-testing)
    - [AI Keyword Planner](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#ai-keyword-planner)
    - [AI Smart Bidding](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#ai-smart-bidding)
    - [Budget Allocation](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#budget-allocation)
    - [Benchmarks](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#benchmarks)
    - [Market Finder](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#market-finder)
    - [MMP Integration](https://helpcenter.mobileaction.co/en/mobileaction-cmp?hsLang=en#mmp-integration)
- [ASO Intelligence](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#main-content)

    - [Metadata Optimizer](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#metadata-optimizer)
    - [App Update Timeline](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#app-update-timeline)
    - [Creative Monitoring](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#creative-monitoring)
    - [Localization](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#localization)
    - [Keyword Tracking](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#keyword-tracking)
    - [Competitor Keywords](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#competitor-keywords)
    - [Keyword Inspector](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#keyword-inspector)
    - [Keyword Trends](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#keyword-trends)
    - [Keyword Translator](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#keyword-translator)
    - [Organic CPP Results](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#organic-cpp-results)
    - [ASO Report](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#aso-report)
    - [Visibility Report](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#visibility-report)
    - [Download Share](https://helpcenter.mobileaction.co/en/aso-intelligence?hsLang=en#download-share)
- [Store Analytics](https://helpcenter.mobileaction.co/en/store-analytics?hsLang=en#main-content)

    - [Revenue Snapshot](https://helpcenter.mobileaction.co/en/store-analytics?hsLang=en#revenue-snapshot)
    - [Organic Acquisition Dashboard](https://helpcenter.mobileaction.co/en/store-analytics?hsLang=en#organic-acquisition-dashboard)
    - [Download Report](https://helpcenter.mobileaction.co/en/store-analytics?hsLang=en#download-report)
    - [Conversion Funnel View](https://helpcenter.mobileaction.co/en/store-analytics?hsLang=en#conversion-funnel-view)
    - [Analytics Overview](https://helpcenter.mobileaction.co/en/store-analytics?hsLang=en#analytics-overview)
- [Search Ads Intelligence](https://helpcenter.mobileaction.co/en/search-ads-intelligence?hsLang=en#main-content)

    - [Search Result/App](https://helpcenter.mobileaction.co/en/search-ads-intelligence?hsLang=en#search-result-app)
    - [Search Result/Keyword](https://helpcenter.mobileaction.co/en/search-ads-intelligence?hsLang=en#search-result-keyword)
    - [Search Result/Competitor](https://helpcenter.mobileaction.co/en/search-ads-intelligence?hsLang=en#search-result-competitor)
    - [Today Tab](https://helpcenter.mobileaction.co/en/search-ads-intelligence?hsLang=en#today-tab)
    - [Search Tab](https://helpcenter.mobileaction.co/en/search-ads-intelligence?hsLang=en#search-tab)
    - [Product Pages](https://helpcenter.mobileaction.co/en/search-ads-intelligence?hsLang=en#product-pages)
    - [Top Advertisers](https://helpcenter.mobileaction.co/en/search-ads-intelligence?hsLang=en#top-advertisers)
    - [CPP by Keyword](https://helpcenter.mobileaction.co/en/search-ads-intelligence?hsLang=en#cpp-by-keyword)
    - [CPP by App](https://helpcenter.mobileaction.co/en/search-ads-intelligence?hsLang=en#cpp-by-app)
    - [CPP by Category](https://helpcenter.mobileaction.co/en/search-ads-intelligence?hsLang=en#cpp-by-category)
    - [CPP on Ad Networks](https://helpcenter.mobileaction.co/en/search-ads-intelligence?hsLang=en#cpp-on-ad-networks)
- [App Intelligence](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#main-content)

    - [Compass Explore](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#compass-explore)
    - [Compass Trace](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#compass-trace)
    - [Compass Impact](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#compass-impact)
    - [App Profile](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#app-profile)
    - [Publisher Profile](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#publisher-profile)
    - [Featured Apps](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#featured-apps)
    - [Category Rankings](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#category-rankings)
    - [Reviews](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#reviews)
    - [AI Review Reply](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#ai-review-reply)
    - [Ratings](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#ratings)
    - [Similar Apps](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#similar-apps)
    - [In-App Events](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#in-app-events)
    - [Promotional Content](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#promotional-content)
    - [Top Charts](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#top-charts)
    - [Biggest Movers](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#biggest-movers)
    - [Biggest Losers](https://helpcenter.mobileaction.co/en/app-intelligence?hsLang=en#biggest-losers)
- [Ad Intelligence](https://helpcenter.mobileaction.co/en/ad-intelligence?hsLang=en#main-content)

    - [Creative Analysis](https://helpcenter.mobileaction.co/en/ad-intelligence?hsLang=en#creative-analysis)
    - [Advertiser Analysis](https://helpcenter.mobileaction.co/en/ad-intelligence?hsLang=en#advertiser-analysis)
    - [Ad Publisher Analysis](https://helpcenter.mobileaction.co/en/ad-intelligence?hsLang=en#ad-publisher-analysis)
    - [Developer Analysis](https://helpcenter.mobileaction.co/en/ad-intelligence?hsLang=en#developer-analysis)
    - [Top Advertisers](https://helpcenter.mobileaction.co/en/ad-intelligence?hsLang=en#top-advertisers)
    - [Top Ad Publishers](https://helpcenter.mobileaction.co/en/ad-intelligence?hsLang=en#top-ad-publishers)
    - [Top Creatives](https://helpcenter.mobileaction.co/en/ad-intelligence?hsLang=en#top-creatives)
    - [Top Developers](https://helpcenter.mobileaction.co/en/ad-intelligence?hsLang=en#top-developers)
    - [App Collections](https://helpcenter.mobileaction.co/en/ad-intelligence?hsLang=en#app-collections)
    - [Creative Collections](https://helpcenter.mobileaction.co/en/ad-intelligence?hsLang=en#creative-collections)
- [Troubleshooting](https://helpcenter.mobileaction.co/en/troubleshooting?hsLang=en#main-content)

    - [MobileAction CMP Troubleshooting](https://helpcenter.mobileaction.co/en/troubleshooting?hsLang=en#mobileaction-cmp-troubleshooting)
    - [ASO Intelligence Troubleshooting](https://helpcenter.mobileaction.co/en/troubleshooting?hsLang=en#aso-intelligence-troubleshooting)
    - [Search Ads Intelligence Troubleshooting](https://helpcenter.mobileaction.co/en/troubleshooting?hsLang=en#search-ads-intelligence-troubleshooting)
- [Integrations](https://helpcenter.mobileaction.co/en/integrations?hsLang=en#main-content)

    - [MobileAction Integrations](https://helpcenter.mobileaction.co/en/integrations?hsLang=en#mobileaction-integrations)
    - [SearchAds.com Integrations](https://helpcenter.mobileaction.co/en/integrations?hsLang=en#searchads-com-integrations)
    - [SSO Configuration](https://helpcenter.mobileaction.co/en/integrations?hsLang=en#sso-configuration)
- [Settings](https://helpcenter.mobileaction.co/en/settings?hsLang=en#main-content)

    - [MobileAction Settings](https://helpcenter.mobileaction.co/en/settings?hsLang=en#mobileaction-settings)
    - [SearchAds.com Settings](https://helpcenter.mobileaction.co/en/settings?hsLang=en#searchads-com-settings)
    - [Single Sign-On Configuration Guides](https://helpcenter.mobileaction.co/en/settings?hsLang=en#single-sign-on-configuration-guides)

[![Chill listening crop-3](https://helpcenter.mobileaction.co/hs-fs/hubfs/logo_black_medium-2.png?width=165&height=55&name=logo_black_medium-2.png "Chill listening crop-3")](https://www.mobileaction.co)

Build app store marketing on AI, automation and expertise

<https://www.linkedin.com/company/mobile-action/> <https://www.youtube.com/mobileactioninsights> <https://www.facebook.com/MobileAction> <https://x.com/MobileAction> <https://www.instagram.com/lifeatmobileaction/>

Copyright © 2025, MobileAction