March 2022 ARVIC

The March 2022 ARVIC session centered on the practical mechanics of creative and ad evaluation. The core argument running through the conference: a single metric or a single test tells you very little. What matters is a consistent process, a growing benchmark database, and enough contextual awareness to interpret what any given score actually means.

Norms and Context Over Isolated Scores

A recurring emphasis was the danger of reading ad scores in isolation. Without normative context, even a strong result can mislead. The guidance was direct: stand up a standardized testing process first, accumulate benchmarks over time, and only then draw firm conclusions from individual tests.

• Build a normative database before treating any single score as actionable.
• Context shapes results. A fitness brand ad tested at New Year's will produce inflated consideration and intent scores compared to the same ad tested two months later.
• Start simple. Layer in custom audiences, custom norms, and custom brand questions as your process matures.

What Creative Can and Cannot Move

Not all metrics respond equally to creative execution. The session drew a clear line between two groups of measures.

• Recall, likability, engagement, and viral potential are more directly influenced by the creative itself.
• Consideration, intent, and recommendation are harder for any single ad to move and are shaped more by category dynamics than by execution.
• Brand recall is table stakes. Engaging creative that fails to build brand association is a problem, regardless of how well it scores on other dimensions.

Dial Testing as a Diagnostic Tool

Dial testing was positioned not as a pass/fail gate but as a scene-level diagnostic. Its value lies in pinpointing which specific moments in a spot are driving positive or negative reactions, making it especially useful when editing a long-form piece down to a shorter cut. Used that way, it informs decisions rather than making them.