You've run the facial coding study. You've got second-by-second emotion traces for your new spot. The average line shows a smile peak at the product reveal and a dip during the setup.
Now you hand that average to your media team, who promptly buy six different audience segments across linear, streaming, and social.
Here's the problem: that average flattens every difference between the audiences you're actually targeting. Women 35-44 might love the setup and tune out at the reveal. Men 18-24 might do the opposite. Parents might smile through the whole thing while non-parents stay flat.
If you're building creative packages from averaged emotion data, you're optimizing for an audience that doesn't exist.
Why audience segmentation matters for emotion data
Facial coding gives you second-by-second reads on expressions like smiles, frowns, brow furrows, and neutral affect. When you average across a broad panel, you see the central tendency. That's useful for a single-audience buy.
But most media plans aren't single-audience. You're buying women 25-54 on one platform, parents 35-49 on another, and maybe a lookalike or behavioral segment somewhere else.
Each of those cells responds differently. Age, gender, parental status, income, and category usage all shift which moments land and which fall flat. Averaging washes out the signal you need to match creative to the buy.
Recruit panels that mirror your media plan
The cleanest path is to build your emotion panel with the same segmentation you'll use in media. If your plan targets women 25-34, women 35-44, and men 25-44, recruit those three cells with enough panelists in each to get stable reads.
Stable usually means 30 to 50 opt-in panelists per cell, depending on how much variance you expect. Smaller cells work if you're testing subtle tweaks. Broader differences (like comparing parents to non-parents on a baby product) can read clearly with fewer.
You can also layer behavioral or attitudinal splits if they matter for targeting. Category users versus non-users. High-intent versus low-intent. Just keep the matrix manageable so you don't fragment your sample into cells too small to interpret.
Run the same creative across all cells
Show every segment the same spot or spots. EmotionTrac captures facial expressions frame by frame as panelists watch on their own devices. The Facial Action Coding System (FACS) classifies muscle movements into expressions, so you get comparable emotion traces across every cell.
Because the stimulus is identical, any differences in response come from the audience, not the creative. That's the signal you're looking for.
Compare second-by-second traces by segment
Once data is in, plot emotion traces for each audience cell side by side. Look for moments where one segment smiles and another stays neutral. Or where one group frowns and another doesn't react.
Those splits tell you which scenes work universally and which are polarizing or segment-specific. A peak that shows up in every cell is a keeper for any cut. A peak that only appears in one cell is a candidate for a targeted package.
Höfling and Alpers (2023) found that automated facial expression analysis predicts ad and brand effects beyond what self-report captures. Segmenting that predictive signal by audience gives you a clearer map of where to trim, extend, or swap scenes.
Build creative packages that match media buys
Now you can assemble cuts that align with your targeting strategy. If women 35-44 smile during the testimonial but men 25-34 don't, build a longer testimonial version for the women's buy and a shorter one for the men's.
If parents show strong positive response to the family dinner scene and non-parents stay flat, keep that scene in the parents' package and swap it out for non-parents.
You're not guessing. You're matching emotion peaks and valleys to the audiences you're actually paying to reach.
A hypothetical workflow
Let's say you're launching a meal kit service. Your media plan targets three segments: parents 30-45, young professionals 25-34, and empty nesters 50-64.
You recruit 40 panelists in each cell. All three groups watch the same 60-second spot. The parents' trace shows a smile peak during the "dinner together" scene and a dip during the "skip the grocery store" line. Young professionals smile at "skip the grocery store" and stay neutral on "dinner together." Empty nesters smile at both but show a stronger peak on the convenience message.
You build three packages. Parents get a 30-second cut that leads with the dinner scene and trims the convenience talk. Young professionals get a 30-second cut that opens with convenience and drops the family moment. Empty nesters get a 45-second version that keeps both beats because both tested well.
Each package goes to the corresponding media buy. You're not running one average spot everywhere and hoping it works.
When to use one cut for multiple segments
Segmentation doesn't always mean separate creative. Sometimes two or three audience cells respond almost identically. When that happens, one cut serves all of them.
The value of segmenting emotion data isn't to force differences. It's to see where differences exist and act on them, and to see where they don't so you can simplify.
If your traces converge, you save production budget and reduce trafficking complexity. If they split, you know exactly where to customize.
Try it: Schedule an EmotionTrac demo and see second-by-second emotion tracking in action. Or visit Audience for more information.
The bottom line
Averaging emotion response across a broad panel hides the audience differences that drive media strategy. When you segment facial coding data by the same cells you target in your buys, you can build creative packages that match how each group actually responds.
You'll spend less on creative that doesn't work and more on moments that move the needle for each audience. That's how you turn second-by-second emotion into a targeting advantage.
Sources
- Höfling, T. T. A., & Alpers, G. W. (2023). Automated facial expression analysis predicts advertising and brand effects beyond self-report. Frontiers in Neuroscience, 17. https://doi.org/10.3389/fnins.2023.1125983
- EmotionTrac Audience. https://audience.emotiontrac.com/