Race to Scale

Video-style thumbnails in marketing emails

Overlay a play button and time stamp on an email image so it reads as a video. Wistia's seven A/B tests averaged a 21.52% click lift, but the gain shrank in later sends.

By Race to Scale Desk, edited by Lila Odinaev. Published . How we work

Effort
6hours
Scale ends at 160 hours
Time to signal
3days
Scale ends at 90 days
Channel
Email
Evidence
Case with numbers
What the grades mean
Cases cited
1

A video-style thumbnail is a still image in a marketing email with a play button and a time stamp laid over it, so it reads as a video the reader can click to watch. Across seven A/B tests, Wistia found this one overlay averaged a 21.52% click lift over the plain image, and later sends showed smaller gains.

How it works

The change is small and visual. You are not embedding video in the email. You are making a static image look playable, which gives the reader a clearer reason to click.

  • Pick an email that already uses a hero image linking to a video or a content page.
  • Make a copy of that image with a play button and a time stamp on top. Change nothing else.
  • Link the thumbnail to a page where the video actually plays.
  • Split the list at random and send both versions at the same time.
  • Compare clicks per recipient between the two versions.

Wistia is the case behind this page. The company describes itself as one place to host and make videos and run webinars. In its write-up of the thumbnail tests, the thumbnail version differed from the control only by the play button and time stamp. The first test was a content email to a segmented list of 11,290 people. In that test, 282 people clicked the thumbnail version and 200 clicked the plain image version. Wistia reports this as 40.83% more people engaging with the thumbnail email. Those totals include clicks on any link in the email, not only the image. Across all seven tests the average lift was 21.52%, and Test 6 came in lower at 15%. The full case is at Wistia's video thumbnail emails.

What it takes

Our estimate: about 6 hours of work, and about 3 days before you can read a signal. Most of the hours go into making a clean overlay template you can reuse, setting up the split in your email tool, and checking that the thumbnail link lands on a page where the video plays. Most email clicks arrive within the first couple of days after a send, so one send gives you a first reading quickly. A trustworthy answer takes several sends, because a single test can mislead.

What to measure

Clicks per recipient is the core comparison. Use rates, not raw counts, so uneven splits do not distort the result. Check your numbers against lifecycle email benchmarks only for context, since your own control is the real baseline.

Split image clicks from all other link clicks. Wistia's totals counted every link, so a lift could come partly from readers clicking elsewhere. A good reading shows the gain concentrated on the thumbnail. A bad reading shows image clicks up while text link clicks fall by the same amount, which means clicks moved rather than grew.

Track lift by send number. Wistia saw the gain shrink in later tests. If your lift drops send after send, the effect is novelty, not a lasting change.

Follow clicks through to plays or signups. Wistia lets users add forms to videos to capture leads, so you can tie thumbnail clickers to signups rather than stopping at clicks. A good reading holds or improves the play rate per recipient. A bad reading is more clicks with flat plays.

Watch unsubscribes per send. A promise of a video that readers find annoying will show up here first.

When it backfires

  • The novelty wears off. Wistia's later tests showed smaller gains, and it put this down to overlapping lists and fading novelty, while saying it could not be sure. Expect the lift to decay if the same people see the overlay every week.
  • The click does not deliver a video. A play button that leads to a text page or a gated form breaks the promise. Readers may click once and then ignore your next email.
  • Clicks move instead of grow. Since all link clicks were counted in Wistia's tests, a headline lift can hide a drop in clicks on your main call to action.
  • The list is too small to read. On a few thousand recipients, a modest lift can vanish in noise, and you will ship a change based on luck.
  • There is no video to show. Faking a play button on content that is not a video is a trick, not a tactic, and it erodes trust.

Run it as an experiment

Hypothesis: adding a play button and time stamp to the hero image raises clicks per recipient without lowering clicks on the main call to action or raising unsubscribes.

We recommend a random 50/50 split, both versions sent at the same time to the same segment. Size the test first with the A/B test sample size calculator, and if your list cannot reach that size in one send, pool results across sends. Repeat the test on at least three separate sends.

Log per variant: recipients, opens, clicks on the image, clicks on other links, video plays, signups and unsubscribes. Log the send number so you can see decay.

Decision rule we suggest: adopt the thumbnail if it beats the control on clicks per recipient in at least two of three sends, plays per recipient do not fall, and unsubscribes do not rise. After you adopt it, keep a small control group on plain images to see whether the gain holds. Add the test to your growth experiment backlog and write it up using the steps in how to run a growth experiment.

How strong the evidence is

The grade is case with numbers: one company ran the tactic and published the results as numbers on its own site. Wistia carries the whole grade, through seven tests with a stated average lift and a detailed first test.

The evidence has clear limits. The click totals count every link in the email, not just the thumbnail. The facts give click counts for Test 1 but not the size of each variant, so per-recipient rates cannot be checked. There is no data on plays, signups or revenue after the click. The lift shrank in later tests and Wistia could not say for sure why. Wistia sells video software, so its readers may respond to video cues more than your list will. Treat the 21.52% average as one company's result, and run your own test before you rely on it.

Cases

Company

Wistia

Year
2017
Outcome
Worked

Wistia, a video hosting and webinar platform, ran seven A/B email tests where the only change was a play button and time stamp laid over the image. The first test, sent to 11,290 people, drew 282 clicks for the thumbnail version against 200 for the plain image. Across all seven tests the average click lift was 21.52%, though later tests showed smaller gains.

Source: Video Thumbnails Increased Our Emails’ Click-Through Rates. We Tested It., wistia.com

Questions

Do I need to embed real video in the email?

No. The tactic is a still image with a play button and time stamp overlaid, linked to a page where the video plays. That overlay was the only difference in Wistia's tests.

How big a lift should I expect?

Wistia saw a 21.52% average click lift across seven tests, with Test 6 at 15%. That is one company's result, and the gain shrank over time, so run your own split before planning around it.

Why did Wistia's lift get smaller in later tests?

Wistia pointed to overlapping lists and fading novelty, but said it could not be certain. Keep a small control group after adopting the thumbnail so you can see whether your own lift decays.

Did the extra clicks lead to more signups or sales?

The published tests report clicks only, and those totals include clicks on any link in the email. They do not show what happened after the click, so track plays and signups by variant yourself.

Sources

  1. Video Thumbnails Increased Our Emails’ Click-Through Rates. We Tested It., wistia.com, 2017-02-23.
  2. Video Hosting & Marketing Platform for Business | Wistia, wistia.com.