October 2023 ARVIC

Across five sessions, the October 2023 ARVIC brought together practitioners from Google Cloud, Community America Credit Union, Nationwide, JB Hunt, and Glassdoor. The talks shared a common premise: the technical quality of research is rarely what determines its impact. What determines impact is whether findings are communicated clearly, socialized strategically, and embedded in the structures that drive decisions. That thread ran through sessions on AI integration, continuous feedback programs, stakeholder communication, and segmentation rollout alike.

AI in Research: Draw the Line Before Someone Draws It for You

One session addressed where generative AI can realistically take on research work today and where human judgment remains irreplaceable. The practical guidance was direct: map your own daily tasks against that line now, before tools are selected for you.

• AI can already handle templated, repetitive, and first-draft tasks, covering an estimated 30 to 40 percent of a typical research process. That recovered time should go toward higher-judgment work.
• Human value concentrates in collaboration, organizational navigation, and connecting research to broader business context.
• Prompt engineering and AI quality assurance are the two skills most worth building now. Output quality depends directly on prompt quality.
• Not all methodologies will be affected equally. Evaluate your specific methods rather than treating AI as a uniform force.
• Volunteer for proof-of-concept work and surface use cases to leadership. Treat experimentation as progress even when individual tests fail.

Continuous Feedback Programs: Structure and Visibility Drive Adoption

Two sessions presented multi-month, always-on research programs built inside organizations, one focused on customers and one on employees. Both arrived at similar structural lessons.

• Dedicated ownership matters. A single manager responsible for day-to-day communication with participants was identified as a critical success factor in the customer advisory board case. In the employee program, embedding product owners with product teams was the single most important structural decision for earning trust.
• Close the feedback loop visibly. The employee program reversed the perception that feedback 'goes into a black hole' through a monthly 'feedback in action' page and a tiered champion network. The customer board produced stronger internal buy-in precisely because feedback came directly from real customers.
• Incentives can be modest when engagement is genuine. The customer advisory board paid $1 to $15 per activity across 14 sessions at roughly $5,000 total, surfacing 16 usability concerns and informing 7 design decisions.
• Segment participants by capacity, not just demographics. Dividing a 300-person volunteer panel into active, background, and stakeholder tiers kept participation healthy without forcing attrition.
• Balance quick wins against longer initiatives deliberately. Consistently delivering quick hits maintained stakeholder confidence while higher-effort projects progressed.
• Measure the same baseline consistently. Running the same brief survey annually made it possible to track a meaningful score trajectory over time.

Communicating Findings: Format and Narrative Do the Work

Two sessions tackled the last-mile problem of getting findings to stick with busy, context-switching stakeholders. The approaches were different in format but aligned in principle: match the communication vehicle to the audience, and build narrative causation into everything.

• Comic strips offer a practical, low-cost format for communicating UX findings. A free drag-and-drop tool removes the need for design skills. First comic takes roughly two hours; subsequent ones take about 30 minutes by reusing layouts.
• Focus each comic on one to two pain points, structure it chronologically, and end with a clear call to action. Apply the 'therefore/but' test: if story beats connect only with 'and then,' the narrative lacks causation.
• For segmentation, great methodology is not enough. Socialization strategy determines whether segments enter an organization's vocabulary or sit in a deck.
• Alignment on scope, roles, and methodology must happen before fieldwork begins. Unmet expectations surfaced in a final presentation are very hard to recover from.
• Immersion workshops, customized by business unit, are the highest-impact socialization tool. Build for enthusiastic early adopters first; skeptical stakeholders are more likely to adopt after seeing a colleague use the work successfully.
• Embed a segmentation typing tool in ongoing research programs so segments remain a living lens. Give all segments equally appealing names to prevent disengagement.

The Shared Lesson Across Sessions

Whether the topic was AI, customer advisory boards, employee listening programs, or deliverable design, every session pointed to the same gap: researchers invest heavily in methodology and underinvest in the systems and communication strategies that get findings used. Closing that gap, through proactive AI mapping, structural embedding of research in product teams, visible feedback loops, and disciplined socialization, was the conference's practical through-line.