April 2022 ARVIC
The April 2022 ARVIC conference brought together research and product practitioners to examine inclusive design principles, distributed team cohesion, and methodological rigor in survey fielding.
- 01Does Survey Fielding Duration Affect Results? An A/B Test on Single-Day vs. Multi-Day Data Collection
- 02From TV Researcher to Media Data Scientist: Navigating Media's Structural Shift
- 03How The Weather Channel Proves Attentive Audiences to Brands Using T-Vision Data
- 04Keeping a Fully Remote Team Connected: Techniques from Charles Schwab's UX Research Practice
- 05Making Inclusive Design Accessible to Everyone: Seven Principles for Research and Product Teams
The April 2022 ARVIC virtual conference covered three substantive areas: building accessibility into research and product development from the ground up, keeping large distributed research teams genuinely connected, and testing assumptions about survey fielding methodology. Across sessions, a common thread emerged: good intentions are not enough. Inclusive design, team culture, and data collection all require deliberate structure to produce reliable results.
Accessibility as a Research and Design Standard
One session made the case that accessibility is not a compliance checkbox but a core research and design discipline. Several practical anchors stood out for teams looking to move from awareness to action.
- Co-design with users who have diverse needs from the start, not as a post-hoc audit step.
- Testing with users who are blind or severely visually impaired can surface roughly 80% of accessibility problems, given their reliance on the widest range of assistive technologies.
- Plain language is an accessible starting point: targeting a seventh or eighth grade reading level is a reasonable baseline for broad U.S. populations.
- VPATs (voluntary accessibility product templates) give teams a structured mechanism to hold vendors accountable to specific standards.
- Small, demonstrable wins, such as A/B testing an accessible versus non-accessible email campaign, are an effective way to build senior stakeholder support before pursuing larger changes.
- Legal exposure is a real forcing function: multiple large companies have faced lawsuits over inaccessible digital experiences, making early investment a cost-avoidance measure as well as a design one.
Building Connection in Fully Remote Research Teams
A session from a senior UX research leader at a large financial services firm addressed a challenge that has become common across the industry: how do you maintain team cohesion when a research practice grows quickly and stays fully distributed? The answer, backed by several years of hands-on iteration, is deliberate programming rather than hoping organic connection will happen on its own.
- A monthly research salon, a structured one-hour discussion open to any research-related topic, has run since mid-2019 and remains well-attended, suggesting low-overhead recurring formats can sustain long-term engagement.
- One-on-one coffee chats, paired through a simple survey and spreadsheet tracker, generated stronger individual relationships than group events alone, with near-universal re-enrollment after the first quarter.
- Letting popular activities run over their allotted time, rather than cutting them off for the next agenda item, is a small adjustment with a meaningful return in participant satisfaction.
- Quarterly research showcases open to product and development partners, often drawing several hundred attendees, extend team visibility and reinforce the value of research to a broader organizational audience.
- Structured meeting formats that combine icebreakers, open research reviews, and a personal high-low segment can make routine meetings a meaningful touchpoint rather than a reporting obligation.
Fielding Duration and Survey Data Quality: An Early-Stage Experiment
A research methods session presented findings from an A/B test comparing single-day versus seven-day survey fielding, using a soft drink evaluation study fielded through an online panel. The headline finding was that no statistically significant overall differences were detected across seven survey questions. But the subgroup results warrant attention.
- Gender-based interactions emerged: females rated beverage liking higher in the multi-day condition, while males rated it higher in the single-day condition, with a statistically significant mean difference of 0.44 between genders in the multi-day condition.
- Male respondents also reported meaningfully different soft drink consumption frequencies by fielding condition: 61.4% in the single-day group reported 1 to 5 drinks per week, versus 38.6% in the multi-day group.
- A TURF analysis found that taste, thirst-quenching ability, and convenience together reach 96.6% of soft drink consumers, a useful benchmark for category prioritization.
- The researchers were clear about scope: results apply to soft drinks surveyed in January and should not be generalized to other categories, seasons, or survey lengths. A larger multi-category study across different time periods is needed before drawing broad conclusions.
Designing for users who are blind or severely visually impaired can surface roughly 80% of accessibility problems, because those users rely on the widest range of assistive technologies.
Presentations
01Does Survey Fielding Duration Affect Results? An A/B Test on Single-Day vs. Multi-Day Data Collection
Two MMR candidates from the University of Georgia, supervised by Dr. Marcus Kunia, presented findings from an A/B test examining whether the number of days a survey is in field affects response quality and results. Using a soft drink evaluation survey fielded through AYTM's panel, they found no statistically significant overall differences between single-day and seven-day fielding, but identified gender-based subgroup differences that suggest fielding duration may matter in gender-sensitive research contexts.
Watch the talk
02From TV Researcher to Media Data Scientist: Navigating Media's Structural Shift
Michael Capretta, VP of Global Research, Insights and Analytics at Warner Bros. Discovery, traces the evolution of the media business from cable TV's dual-revenue model through the streaming era, using that history to argue that media research organizations must embed data scientists directly within insights teams rather than separating the functions. Drawing on nearly 22 years at the company, he shares practical lessons from his own team's experience bringing data science in-house and what that shift meant for speed, accountability, and analytical depth.
Watch
03How The Weather Channel Proves Attentive Audiences to Brands Using T-Vision Data
JT Peace, Associate Director of Ad Sales and Strategic Insights at The Weather Channel, presents findings from a study conducted with T-Vision that measures real audience attention on screen. The study tested the hypothesis that Weather Channel audiences are more engaged than those of competing cable news and lifestyle networks, examining attention across day parts, program types, live storm coverage, and original content. Results consistently supported the hypothesis, giving the ad sales team concrete data to bring into upfront conversations with brands and agencies.
Watch
04Keeping a Fully Remote Team Connected: Techniques from Charles Schwab's UX Research Practice
Molly Malson, Senior Manager of UX Research at Charles Schwab, shares how her team of nearly 50 researchers built connection and cohesion while working fully remote. She walks through five concrete techniques, from a monthly research salon to one-on-one coffee chats, that the team developed organically and refined over time. The talk draws on her own experience managing a fast-growing distributed team and emphasizes that meaningful connection requires deliberate planning, not chance.
Watch
05Making Inclusive Design Accessible to Everyone: Seven Principles for Research and Product Teams
Jamal Digital Davis walked through the seven principles of inclusive design as they apply to market research and digital product development. He focused on how researchers and designers can bring more diverse users into the design and data collection process, reduce barriers for people with disabilities, and build internal advocacy for accessibility. The session included live Q&A covering software tools, budget constraints, rebranding challenges, and methods for accessibility user testing.
WatchWant to be in the room next time?
Register for next conferenceRelated conferences
June 2022 ARVIC
The June 2022 ARVIC conference focused on rigorous, practical pricing research, offering researchers and product teams a clear framework for choosing and executing the right methodology.
ViewMarch 3, 2022March 2022 ARVIC
The March 2022 ARVIC conference focused on building disciplined, context-aware ad testing frameworks that prioritize normative benchmarking and ongoing measurement over single-score evaluations.
ViewOctober 28, 2021October 2021 ARVIC
The October 2021 ARVIC conference focused on making research more durable and trustworthy by building shared ownership, protecting vulnerable participants, and turning qualitative data into concrete, reusable models.
ViewPresent at the next ARVIC
Share a method, a study, or a hard-won lesson with a room of senior research practitioners.