August 2023 ARVIC
The August 2023 ARVIC conference united researchers and practitioners around a single conviction: rigorous methods only deliver value when paired with sharp communication, organizational buy-in, and strategic ambition.
- 01Mitigating Shiny Object Syndrome in Business Technology Evaluation Research
- 02Moving the Needle: Techniques for Translating Research into Progress
- 03Service Design Blueprints for Enterprise Software: A Multi-Method UX Research Case Study
- 04The Superwoman Schema as a Cultural Narrative in the Lives of African-American Women Computer Science Majors
- 05The Three Lenses of Design Thinking: Evolving User Research into a Strategic Role
- 06Treating Employees Like Customers: Internal and External Listening Strategies at Indeed
The August 2023 ARVIC virtual conference brought together practitioners from consumer insights, UX research, technology consulting, and organizational strategy. Across six talks, a clear through-line emerged: the craft of research is necessary but not sufficient. What separates impactful research programs from ones that stall is the discipline applied to communication, stakeholder alignment, and the willingness to operate at a strategic rather than purely tactical level. Sessions covered everything from service design blueprints and technology evaluation to identity psychology and internal listening programs, yet the practical and organizational challenges they addressed were largely shared.
Making Research Land: Communication and Organizational Influence
Several sessions treated the delivery and reception of research as a craft in its own right, deserving the same rigor as the research design itself.
- Reframing a presentation as a performance, rather than a data transfer, changes preparation and delivery in ways that improve audience reception and retention.
- Matching depth to audience matters. Executives often need executive-level highlights; technical partners need the detail. Designing for one rarely works for both.
- A single compelling visual, including AI-generated imagery, can communicate a complex finding to any level of the organization faster than a full slide deck.
- The physical environment in which findings are shared shapes how openly audiences receive them. Room choice, light, and key visuals all prime the conversation.
- Listening without a visible action plan destroys credibility. Building champion networks, tiger teams, and senior leadership buy-in are prerequisites for turning data into change.
Broadening Who Is in the Room
A recurring pattern across talks was the value of expanding who participates in research, both as contributors and as an audience for findings.
- Inviting senior leaders and cross-functional partners into consumer interviews, not just debriefs, builds firsthand empathy and shared ownership that a slide deck cannot replicate.
- Internal employee panels are a low-cost way to generate early-stage behavioral data and build company-wide visibility for the research function.
- Technology evaluations that rely on the same small group of trusted reviewers create echo chambers. Actively recruiting frontline employees and cross-geography stakeholders reduces that risk.
- Persona profiles adapted from UX practice offer a practical, empathy-building tool for communicating complex psychological data about underrepresented populations to cross-disciplinary audiences.
- Service design blueprints presented at large format draw in developers and managers who have never seen a full process before, recalibrating unrealistic expectations and surfacing misaligned assumptions.
Expanding the Strategic Scope of Research
Multiple speakers pushed directly against a narrow definition of what researchers are for. The argument, made from different angles, was that user and consumer researchers should be operating across longer time horizons and at higher levels of organizational decision-making.
- Business design thinking, validating business models rather than just products or services, is the most underdeveloped lens available to UX researchers. Tools like the Business Model Canvas belong in the researcher's toolkit.
- Most UX teams live in the immediate horizon. Sustained competitive advantage requires research investment in the one-to-five-year future.
- Earning a strategic seat requires business fluency: understanding how the company makes money, identifying allies across functions, and continuously connecting tactical deliverables to strategic outcomes.
- Tying engagement or satisfaction metrics to retention rates or revenue makes the case for broader listening programs far more persuasive than presenting scores alone.
- The same multimodal research methods used for external customers apply directly to employee research. The frameworks are nearly identical; the internal application is simply underused.
Research Rigor and Method Discipline
Across the more methods-focused sessions, speakers emphasized that rigor is not just about design but about the conditions that make research trustworthy and actionable.
- Anchor technology evaluations to documented strategic objectives before any vendor contact, so vendor narratives cannot redirect the research goal.
- Data quality is a prerequisite, not an afterthought. Misaligned definitions and inconsistent metrics corrupt results regardless of how rigorous the research design is.
- Contextual inquiry, sitting with someone while they work, surfaces behaviors, errors, and workarounds that interviews and surveys rarely reach. It is especially valuable for manual, multi-system processes.
- Starting low-resolution with paper stickies or a whiteboard makes it easier to correct errors and invite collaboration before committing to a digital deliverable.
- Rapid early-stage experiments carry far less risk than late-stage failures. Research that happens earlier in a project cycle is what separates teams that hit deadlines from those that do not.
- Apply the same evaluation rigor to AI that you would to any emerging technology: tie it to specific use cases, test in a controlled environment, and govern data inputs before broad deployment.
Identity, Culture, and the Complexity of Human Experience
One session offered a distinct methodological and human dimension, presenting dissertation research on the psychological experiences of African-American women in computer science. It was a reminder that the populations researchers study carry cultural narratives that standard quantitative instruments are not built to capture.
- Existing measures of narrative identity lack a cultural coherence subscale, a meaningful gap when studying groups whose identity development is shaped by specific cultural contexts.
- Cultural narratives can operate as background filters on behavior even when individuals do not consciously identify with them.
- High identification with competing social identities was associated with higher anxiety and depression in younger participants, pointing to the psychological cost of navigating multiple demanding roles simultaneously.
- Narrative identity tends to strengthen over time as individuals accumulate and retell life experiences, with measurable differences in well-being visible across generational cohorts.
Presentations
01Mitigating Shiny Object Syndrome in Business Technology Evaluation Research
Andrew Comerford, founder of Day 31 Consulting, draws on nearly 30 years of technology consulting experience to explain how "shiny object syndrome" distorts business technology evaluations. He traces the pattern across major technology waves, from the early web through AI, and offers concrete mitigation strategies covering strategic alignment, data readiness, employee inclusion, bias awareness, and long-term sustainability planning.
Watch the talk
02Moving the Needle: Techniques for Translating Research into Progress
Heidi Carrion of J.M. Smucker, joined by Kathy Wilcox and Joe Watson of Switch Innovation Lab, shares practical techniques for moving research from insight to action. The talk covers how to build organizational buy-in through consumer immersion, internal panels, and intentional presentation design. A central theme is that great research alone is not enough: how you deliver and perform the message determines whether it drives real progress.
Watch
03Service Design Blueprints for Enterprise Software: A Multi-Method UX Research Case Study
Jen, a UX researcher at BECU, walks through a real case study in which she used a multi-method research approach, including heuristic evaluation, customer interviews, and contextual inquiry, to build a service design blueprint for an enterprise security reporting process. The blueprint mapped a deeply manual, multi-system workflow and surfaced both improvement opportunities and the limits of automation. The talk also demonstrates how the service design blueprint framework can be adapted beyond its standard template to fit the specific questions a team needs to answer.
Watch
04The Superwoman Schema as a Cultural Narrative in the Lives of African-American Women Computer Science Majors
Dr. Daya Bonet presents her dissertation research, a narrative personality exploratory study examining how African-American women computer science majors use the Superwoman schema as a cultural narrative to interpret and buffer the stressors of a white male-dominated educational environment. The study integrates personality psychology, narrative identity theory, and Superwoman schema literature, and introduces a new quantitative measure of narrative identity that includes a cultural coherence subscale tailored to African-American women. Findings from three participants are presented through persona profiles, revealing high perceived stress and strong Superwoman identification across all participants, with generational differences shaping how that schema is consciously embraced or rejected.
Watch
05The Three Lenses of Design Thinking: Evolving User Research into a Strategic Role
Brian Sullivan, Director of User Research and Design Strategy at Sabre Corporation, presents a framework for applying design thinking across three lenses: product design, service design, and business design. He walks through a six-stage Double Diamond process and argues that user researchers must move beyond product validation into business model thinking to earn a genuine strategic seat at the table. The talk closes with a call to reframe the central question of UX research from "how do we build better products" to "what future do we want to explore together."
Watch
06Treating Employees Like Customers: Internal and External Listening Strategies at Indeed
Laura and Ben, members of the Voice of Customer team at Indeed, share how the company built parallel internal and external listening strategies over five years as the organization grew from 3,000 to 15,000 employees. The central argument is that employees and external customers deserve similarly rigorous, multimodal listening programs, and that the methods, mission statements, and action-planning structures for both are more alike than most organizations assume. The talk covers program design, channel mix, action planning, and two concrete case studies, one internal and one external.
WatchWant to be in the room next time?
Register for next conferenceRelated conferences
October 2023 ARVIC
The October 2023 ARVIC conference focused on how researchers can build more durable, actionable programs by rethinking how they communicate findings, engage stakeholders, and integrate AI into their work.
ViewMarch 30, 2023March 2023 ARVIC
The March 2023 ARVIC conference brought together practitioners to advance research methods, organizational capability, and the translation of insights into decisions that actually get used.
ViewMarch 24, 2024March 2024 ARVIC
The March 2024 ARVIC conference brought together researchers and practitioners to explore how sharper methods, stronger team culture, and faster decision-making cycles can turn consumer insights into clearer business action.
ViewPresent at the next ARVIC
Share a method, a study, or a hard-won lesson with a room of senior research practitioners.