YouTube Test and Compare Thumbnails: How Is a Winner Picked?
Who can use YouTube's built-in thumbnail and title test, how to set it up, and how to read Winner, Performed Same and Inconclusive.
4 min read
Summary
YouTube Test and Compare thumbnails is YouTube's built-in experiment for trying up to three thumbnails, titles, or title-and-thumbnail pairs on one video at the same time. In YouTube Studio the button now reads A/B Testing. When the test ends, every viewer sees the option with the highest watch time share, not the highest click-through rate.
Who can use Test and Compare?
According to YouTube Help:
- it only works in YouTube Studio on a computer
- your channel needs advanced features enabled
- it works on long-form videos and live archives, not on Shorts or scheduled lives
- Premieres qualify only after the Premiere ends and becomes a long-form video
- videos set as made for kids, mature audiences or private cannot be tested
If a video is later turned into a Short, YouTube says you lose access to its earlier tests.
How do you set up a thumbnail test?
- Sign in to YouTube Studio.
- For a new video, click Create, then Upload videos. For an existing one, click Content and open the video.
- In the Title box or under Thumbnail, click A/B Testing.
- Choose Title only, Thumbnail only, or Title and thumbnail.
- Upload up to three thumbnails or titles, then click Done.
Do not edit the title or thumbnail while the test runs. YouTube says any change stops the test, and you then have to start again.
How does YouTube pick the winning thumbnail?
At the end you get one of three results, based on watch time share:
- Winner: one option clearly outperformed the others, and YouTube says the result is statistically significant.
- Performed Same: all options did about as well as each other, so you pick the one you prefer.
- Inconclusive: no strong difference was found, and the first title and thumbnail you uploaded becomes the default.
YouTube may also hold back a small control group of viewers who only see the default packaging. Their views are left out of the calculation.
Why does YouTube use watch time instead of click-through rate?
YouTube's answer is that a good title and thumbnail should help viewers understand what a video is about, so they do not waste time clicking the wrong one. It optimises tests for overall watch time rather than click-through rate. It also says its tests are concurrent, with every variation shown at the same time, while many third-party tools test one after another and judge only on clicks. That is why a third-party tool can name a different winner.
How long does a thumbnail test take?
YouTube says a test should finish within two weeks and can take anything from a few days up to that. Tests finish faster when a video gets more impressions and when the options are clearly different from each other.
How do you get a useful result?
YouTube's own tips:
- Start with older videos. Some versions will do worse than others, and older videos limit the effect on your channel's overall views.
- Make the options really different. Near-identical thumbnails make tests run longer.
- Use high resolution. If any thumbnail is below 1280 x 720, all of them in the test are scaled down to 854 x 480.
Where do you see the results?
Open the video's Details page, or go to Analytics and then the Reach tab. While a test is running, the Reach tab shows "How your A/B test is going", and Manage test lets you review it or stop it early.
FAQ
Can I test thumbnails on Shorts? No. YouTube Help says A/B testing is not available for Shorts.
Why did my test not find a winner? YouTube says this is common. The usual reasons are too few impressions, or options too similar to make a measurable difference.
Can I rerun a test on the same video? Yes, but YouTube warns that results can differ between runs, from normal statistical variation and from changes in who sees the video over time.
Related
- What size should a YouTube thumbnail be?
- How long should a YouTube title be?
- Do YouTube thumbnails still matter?
Sources
Lab evidence
What I found running this
Checked on 18 Oct 2026 against YouTube Help's 'A/B test titles & thumbnails' page; the older 'Test & compare thumbnails' help URL now loads the same page. Steps, limits and result labels are quoted as published there. No fresh hands-on test was run in a YouTube Studio account for this post, and no channel results are claimed.
Explore the product
YouTubers who want research, titles, thumbnails and scheduling in one workflow
Need stronger thumbnail and title options to test?
Draft test variants with VidRankrKeep reading
Do YouTube Thumbnails Still Matter in 2026?
YouTube says half of all channels and videos have an impressions click-through rate between 2% and 10%, and its own A/B tests now pick winners by watch time, not clicks. What YouTube says, where feed previews and Shorts reduce the thumbnail's role, what testing shows about style, and how to decide how much effort to spend.
News9 Oct 20266 min read
Why Do YouTube Thumbnails Have Shocked Faces?
In 2008, YouTube stopped offering thumbnails from the 25, 50 and 75 percent marks of a video and let partners upload their own. What followed was YouTube Face: why faces took over, why they looked shocked, how A/B testing pushed even MrBeast to close his mouth, and five lessons for your own videos.
News9 Oct 20267 min read
How to Turn Off Remix on YouTube Shorts, and What Happens?
Your Shorts are open to remixing by default. Here is the YouTube Studio setting that limits it, and what YouTube Help says happens to remixes already made from your video.
Summary29 Oct 20264 min read
