Skip to content
ARVIC · Virtual Insights Conference

July 2021 ARVIC

July 29, 20214 Sessions

The July 2021 ARVIC conference brought together practitioners and academics to tackle how research teams can move faster, scale wider, and stay credible in a rapidly changing environment.

Overview

The July 2021 ARVIC conference covered a range of challenges facing modern insights teams: how to scale research without scaling headcount, how to maintain data quality in crowdsourced environments, how to meet the speed demands of agile organizations, and what a new generation of consumers expects from the world and from brands. Across all four sessions, a common thread emerged: rigor and speed are not opposites, and the researchers doing the best work are the ones who have made deliberate choices about where to flex and where to hold firm.

Scaling Research With Limited Resources

Two sessions addressed the practical problem of doing more with less, approaching it from different angles: one focused on headcount and organizational reach, the other on budget and decision-making speed.

  • Find internal allies first. Colleagues already asking good questions are a more productive starting point than trying to convert the whole organization at once.
  • Delegate low-risk tasks, such as surveys, polls, and guerrilla testing, with written guidelines so quality standards remain yours even when others do the work.
  • A public research repository with sourced data, sample details, and documented recommendations prevents findings from being misquoted or misapplied downstream.
  • Agile platforms work best for short, focused studies of three to five questions. Treating them as a replacement for complex surveys undermines the speed advantage they offer.
  • Unlimited-capacity platform licenses remove budget approval as a bottleneck, which is often what keeps insights out of early-stage decisions.
  • A deliberate team checkpoint at twelve to eighteen months helps identify where old research habits are slowing down an agile workflow.

Data Quality in Crowdsourced Research

One session offered a grounded look at crowdsourcing platforms as a cost-effective data collection method, with a clear-eyed accounting of their risks. The practical guidance here is useful for any team considering platforms like Amazon Mechanical Turk for general-population work.

  • Crowdsourcing is well suited to general-population studies such as consumer behavior and online shopping. It is a poor fit for specialized or niche samples.
  • Plan to collect roughly 30 percent more responses than your target, since cleaning for bots, speeders, and inconsistent answers typically removes about that share.
  • Cross-validate respondent identity by asking the same demographic question in two different formats at different points in the survey, then flag conflicting records.
  • Use dynamic, randomized completion codes rather than a static code to prevent sharing and reuse by bad actors.
  • Pilot with a small batch first to calibrate actual completion time, then set payment based on a fair hourly rate. Underpaying reduces quality; overpaying is unnecessary.

What Young Consumers Want Next

One session presented findings from a global survey of over 8,000 people aged 16 to 24 across 15 countries, examining how the events of 2020 reshaped this generation's expectations. The data carries direct implications for brand strategy and product positioning.

  • Happiness among 16 to 24 year olds fell from roughly 70% to just over 50% between 2012 and 2020, while stress rose from 36% to 46%. These are structural shifts, not short-term fluctuations.
  • Despite widespread pessimism about the world, over 90% of young people say they want to make the most of what comes next and acknowledge they will have to work hard to get there.
  • Young people globally ranked the environment and climate change as the top societal priority for the next decade, even in a year dominated by COVID-19. The US was a notable exception.
  • For their own lives, top priorities center on security: a stable job, keeping loved ones safe, mental health, and a strong family unit.
  • 83% of young people already expect brands to stand up against social injustice, and nearly 80% expect that expectation to grow. Authenticity matters: they will hold brands accountable when actions contradict messaging.
  • Brands can respond concretely by making genuine long-term commitments, giving young people tools and spaces to act, and telling stories of resilience and cultural diversity.

The Rigor-Speed Trade-Off

A theme running across multiple sessions is that the choice between rigor and speed is often false, but only if teams make deliberate decisions upfront about what level of certainty a given decision actually requires. Agile tools are best used to earn a seat at early-stage conversations and surface language and concept issues before a full custom study is warranted, not to replace robust research when the stakes are high. Similarly, democratizing research within an organization is not about lowering the bar; it is about extending the reach of a credible function through careful delegation, documentation, and transparency.

The Sessions

Presentations

4 Sessions
Adapting Traditional Market Research to an Agile Toolkit: A Journey at Lincoln Financial Group01

Adapting Traditional Market Research to an Agile Toolkit: A Journey at Lincoln Financial Group

Liz Castles, head of enterprise consumer insights at Lincoln Financial Group, walks through Lincoln's two-year journey adopting agile research platforms to close the gap between consumer insight and real-time business decision making. She covers the platforms adopted, how her team adapted traditional research processes to fit an experimentation mindset, and the hard-won lessons learned along the way. The talk is grounded in the practical tension between research rigor and speed, and how her team learned to navigate that trade-off inside a highly traditional insurance company.

Watch the talk
Best Practices for Using Crowdsourcing Platforms in Survey Research: The Case of Amazon Mechanical Turk02

Best Practices for Using Crowdsourcing Platforms in Survey Research: The Case of Amazon Mechanical Turk

Dr. Cihan Cobanoglu, McKibben Endowed Chair Professor at the University of South Florida and Director of the M3 Center, walks through the theory and practical mechanics of using Amazon Mechanical Turk for academic and market research. He covers the advantages and risks of crowdsourcing for data collection, the precautions researchers must take to ensure data quality, and delivers a live demonstration connecting a Qualtrics survey to Mechanical Turk. The session is aimed at researchers and practitioners who want a cost-effective, scalable alternative to traditional survey methods.

Watch
Beyond 2020: How Young People Around the World Are Thinking About the Future03

Beyond 2020: How Young People Around the World Are Thinking About the Future

Christian Kurtz, Head of Global Streaming and Corporate Insights at ViacomCBS, presents findings from the "Beyond 2020" study, a global survey of over 8,000 people aged 16 to 24 across 15 countries. The research examines how the events of 2020 disrupted young people's lives and reshaped their expectations for the next decade. Key themes include declining happiness, a craving for stability, optimism about personal agency, and rising expectations for brands to take genuine stands on social and environmental issues.

Watch
Democratizing Research Without Jeopardizing Your Job04

Democratizing Research Without Jeopardizing Your Job

Sean Good, sole UX researcher at Jane.com, walks through how a one-person research function can extend its reach across an organization without losing quality control or relevance. Drawing on four years of hands-on experience, he covers three practical steps: building bridges with non-research colleagues, delegating research tasks carefully, and protecting yourself and your findings through documentation and transparency. The talk is grounded in real situations from a 200-person e-commerce company and is aimed at researchers working with limited headcount and budget.

Watch

Want to be in the room next time?

Register for next conference
Get Involved

Present at the next ARVIC

Share a method, a study, or a hard-won lesson with a room of senior research practitioners.