Skip to content
Overview

The August 2023 ARVIC virtual conference brought together practitioners from consumer insights, UX research, technology consulting, and organizational strategy. Across six talks, a clear through-line emerged: the craft of research is necessary but not sufficient. What separates impactful research programs from ones that stall is the discipline applied to communication, stakeholder alignment, and the willingness to operate at a strategic rather than purely tactical level. Sessions covered everything from service design blueprints and technology evaluation to identity psychology and internal listening programs, yet the practical and organizational challenges they addressed were largely shared.

Making Research Land: Communication and Organizational Influence

Several sessions treated the delivery and reception of research as a craft in its own right, deserving the same rigor as the research design itself.

  • Reframing a presentation as a performance, rather than a data transfer, changes preparation and delivery in ways that improve audience reception and retention.
  • Matching depth to audience matters. Executives often need executive-level highlights; technical partners need the detail. Designing for one rarely works for both.
  • A single compelling visual, including AI-generated imagery, can communicate a complex finding to any level of the organization faster than a full slide deck.
  • The physical environment in which findings are shared shapes how openly audiences receive them. Room choice, light, and key visuals all prime the conversation.
  • Listening without a visible action plan destroys credibility. Building champion networks, tiger teams, and senior leadership buy-in are prerequisites for turning data into change.

Broadening Who Is in the Room

A recurring pattern across talks was the value of expanding who participates in research, both as contributors and as an audience for findings.

  • Inviting senior leaders and cross-functional partners into consumer interviews, not just debriefs, builds firsthand empathy and shared ownership that a slide deck cannot replicate.
  • Internal employee panels are a low-cost way to generate early-stage behavioral data and build company-wide visibility for the research function.
  • Technology evaluations that rely on the same small group of trusted reviewers create echo chambers. Actively recruiting frontline employees and cross-geography stakeholders reduces that risk.
  • Persona profiles adapted from UX practice offer a practical, empathy-building tool for communicating complex psychological data about underrepresented populations to cross-disciplinary audiences.
  • Service design blueprints presented at large format draw in developers and managers who have never seen a full process before, recalibrating unrealistic expectations and surfacing misaligned assumptions.

Expanding the Strategic Scope of Research

Multiple speakers pushed directly against a narrow definition of what researchers are for. The argument, made from different angles, was that user and consumer researchers should be operating across longer time horizons and at higher levels of organizational decision-making.

  • Business design thinking, validating business models rather than just products or services, is the most underdeveloped lens available to UX researchers. Tools like the Business Model Canvas belong in the researcher's toolkit.
  • Most UX teams live in the immediate horizon. Sustained competitive advantage requires research investment in the one-to-five-year future.
  • Earning a strategic seat requires business fluency: understanding how the company makes money, identifying allies across functions, and continuously connecting tactical deliverables to strategic outcomes.
  • Tying engagement or satisfaction metrics to retention rates or revenue makes the case for broader listening programs far more persuasive than presenting scores alone.
  • The same multimodal research methods used for external customers apply directly to employee research. The frameworks are nearly identical; the internal application is simply underused.

Research Rigor and Method Discipline

Across the more methods-focused sessions, speakers emphasized that rigor is not just about design but about the conditions that make research trustworthy and actionable.

  • Anchor technology evaluations to documented strategic objectives before any vendor contact, so vendor narratives cannot redirect the research goal.
  • Data quality is a prerequisite, not an afterthought. Misaligned definitions and inconsistent metrics corrupt results regardless of how rigorous the research design is.
  • Contextual inquiry, sitting with someone while they work, surfaces behaviors, errors, and workarounds that interviews and surveys rarely reach. It is especially valuable for manual, multi-system processes.
  • Starting low-resolution with paper stickies or a whiteboard makes it easier to correct errors and invite collaboration before committing to a digital deliverable.
  • Rapid early-stage experiments carry far less risk than late-stage failures. Research that happens earlier in a project cycle is what separates teams that hit deadlines from those that do not.
  • Apply the same evaluation rigor to AI that you would to any emerging technology: tie it to specific use cases, test in a controlled environment, and govern data inputs before broad deployment.

Identity, Culture, and the Complexity of Human Experience

One session offered a distinct methodological and human dimension, presenting dissertation research on the psychological experiences of African-American women in computer science. It was a reminder that the populations researchers study carry cultural narratives that standard quantitative instruments are not built to capture.

  • Existing measures of narrative identity lack a cultural coherence subscale, a meaningful gap when studying groups whose identity development is shaped by specific cultural contexts.
  • Cultural narratives can operate as background filters on behavior even when individuals do not consciously identify with them.
  • High identification with competing social identities was associated with higher anxiety and depression in younger participants, pointing to the psychological cost of navigating multiple demanding roles simultaneously.
  • Narrative identity tends to strengthen over time as individuals accumulate and retell life experiences, with measurable differences in well-being visible across generational cohorts.
The Sessions

Presentations

6 Sessions
Mitigating Shiny Object Syndrome in Business Technology Evaluation Research01

Mitigating Shiny Object Syndrome in Business Technology Evaluation Research

Andrew Comerford, founder of Day 31 Consulting, draws on nearly 30 years of technology consulting experience to explain how "shiny object syndrome" distorts business technology evaluations. He traces the pattern across major technology waves, from the early web through AI, and offers concrete mitigation strategies covering strategic alignment, data readiness, employee inclusion, bias awareness, and long-term sustainability planning.

Watch the talk
Moving the Needle: Techniques for Translating Research into Progress02

Moving the Needle: Techniques for Translating Research into Progress

Heidi Carrion of J.M. Smucker, joined by Kathy Wilcox and Joe Watson of Switch Innovation Lab, shares practical techniques for moving research from insight to action. The talk covers how to build organizational buy-in through consumer immersion, internal panels, and intentional presentation design. A central theme is that great research alone is not enough: how you deliver and perform the message determines whether it drives real progress.

Watch
Service Design Blueprints for Enterprise Software: A Multi-Method UX Research Case Study03

Service Design Blueprints for Enterprise Software: A Multi-Method UX Research Case Study

Jen, a UX researcher at BECU, walks through a real case study in which she used a multi-method research approach, including heuristic evaluation, customer interviews, and contextual inquiry, to build a service design blueprint for an enterprise security reporting process. The blueprint mapped a deeply manual, multi-system workflow and surfaced both improvement opportunities and the limits of automation. The talk also demonstrates how the service design blueprint framework can be adapted beyond its standard template to fit the specific questions a team needs to answer.

Watch
The Superwoman Schema as a Cultural Narrative in the Lives of African-American Women Computer Science Majors04

The Superwoman Schema as a Cultural Narrative in the Lives of African-American Women Computer Science Majors

Dr. Daya Bonet presents her dissertation research, a narrative personality exploratory study examining how African-American women computer science majors use the Superwoman schema as a cultural narrative to interpret and buffer the stressors of a white male-dominated educational environment. The study integrates personality psychology, narrative identity theory, and Superwoman schema literature, and introduces a new quantitative measure of narrative identity that includes a cultural coherence subscale tailored to African-American women. Findings from three participants are presented through persona profiles, revealing high perceived stress and strong Superwoman identification across all participants, with generational differences shaping how that schema is consciously embraced or rejected.

Watch
The Three Lenses of Design Thinking: Evolving User Research into a Strategic Role05

The Three Lenses of Design Thinking: Evolving User Research into a Strategic Role

Brian Sullivan, Director of User Research and Design Strategy at Sabre Corporation, presents a framework for applying design thinking across three lenses: product design, service design, and business design. He walks through a six-stage Double Diamond process and argues that user researchers must move beyond product validation into business model thinking to earn a genuine strategic seat at the table. The talk closes with a call to reframe the central question of UX research from "how do we build better products" to "what future do we want to explore together."

Watch
Treating Employees Like Customers: Internal and External Listening Strategies at Indeed06

Treating Employees Like Customers: Internal and External Listening Strategies at Indeed

Laura and Ben, members of the Voice of Customer team at Indeed, share how the company built parallel internal and external listening strategies over five years as the organization grew from 3,000 to 15,000 employees. The central argument is that employees and external customers deserve similarly rigorous, multimodal listening programs, and that the methods, mission statements, and action-planning structures for both are more alike than most organizations assume. The talk covers program design, channel mix, action planning, and two concrete case studies, one internal and one external.

Watch

Want to be in the room next time?

Register for next conference
Get Involved

Present at the next ARVIC

Share a method, a study, or a hard-won lesson with a room of senior research practitioners.