March 2025 ARVIC

The March 2025 ARVIC conference brought together practitioners from UX research, consumer insights, and the survey industry to tackle a shared challenge: how do you make research findings trustworthy, measurable, and genuinely useful to the people who act on them? Three sessions covered distinct territories, from expert usability auditing to AI-driven gift-giving behavior to the deteriorating quality of survey sample, but each circled back to the same core tension between speed and rigor, and the professional responsibility researchers have to defend standards.

Quantifying and Communicating UX Research Value

One session made a strong case for the PURE (Pragmatic Usability Rating by Experts) audit method as a way to turn qualitative usability observations into scored, trackable data. The approach is practical by design: a structured top-task list drives the audit, trained evaluators score each interaction step on an expanded five-point scale, and results are versioned so teams can benchmark improvement over time and tie usability scores to metrics like NPS or adapted SUS scores.

• Evaluators must be separate from the product team to remove bias and add credibility.
• A top-task list of 10 to 15 key tasks can be reused across moderated tests, surveys, and other research activities.
• The expanded five-point scale captures both zero-friction interactions and complete failures that a three-point scale misses.
• Versioned reports make ROI tracking explicit and build a shared UX vocabulary across teams, supporting cross-project collaboration and career development for junior designers.

AI Adoption in Consumer Behavior: Early Signals Worth Watching

A two-phase study from University of Georgia master's candidates examined how AI is entering the gift-giving process. The findings sketch an early-adoption curve: a majority of shoppers have tried AI tools at least occasionally, led by recommendation algorithms, but meaningful barriers remain. The research is a useful model for how student-led primary and secondary research can surface actionable consumer signals.

• 59% of the 400 surveyed consumers have used AI tools in gifting at least rarely, with recommendation algorithms the most common entry point at 50% usage.
• 74% of AI users said the technology made gift selection faster, suggesting a clear speed benefit that marketers can build on.
• Privacy concern is the single largest adoption barrier, cited by about 55% of respondents.
• Personalization cuts both ways: AI is valued for surfacing novel ideas, but 34% said suggestions would need to be more creative or unique before they would increase use.
• Methodological notes include a broader age range than intended and survey timing that fell before peak holiday shopping, both worth accounting for when applying these findings.

The Data Quality Crisis in Survey Research

The most urgent conversation at the conference centered on participant data quality. A cross-industry panel of sample, agency, and client-side veterans described a market in which four out of five researchers rate current participant quality as poor or worse, and some buyers are discarding 70 to 80 percent of purchased sample. The diagnosis pointed to structural causes as much as operational ones.

• Private equity and venture capital ownership of sample and research firms creates financial incentives to scale quickly rather than invest in sustained quality innovation.
• Fraud detection requires deep category expertise; junior researchers and clients without that knowledge are especially exposed to missing subtle data anomalies.
• Synthetic data was viewed skeptically by the panelists as an overpromise for most use cases, particularly for attitudinal questions, because bad input data compounds existing quality problems.
• Client-side researchers are urged to treat sample quality oversight as a core part of their value proposition and to have direct internal conversations about the speed-quality-cost tradeoff.
• Reasons for cautious optimism include growing industry attention to the issue, the Insights Association's participant Bill of Rights, and large clients setting their own quality standards.

Cross-Conference Themes

Across all three sessions, a few ideas kept surfacing. Rigor and practicality are not opposites: structured methods like PURE audits and well-designed surveys produce data that is both credible and usable by non-researchers. Transparency matters at every layer, whether that is disclosing who scored a UX audit, how a sample was sourced, or what limitations a student survey carried. And the researcher's role is increasingly one of advocacy, defending decision-grade quality inside organizations that often prefer faster and cheaper answers.