Article

Evaluating AI-Simulated Behavior: Insights from Three Studies on Digital Twins and Synthetic Users

Nielsen Norman Group · nngroup.com

Actual empirical studies measuring how far AI-simulated behaviour diverges from real users.

Open on nngroup.com ↗

The question it answers

  1. Can synthetic users and AI personas replace talking to real customers?

Read with it

  1. The most rigorous practitioner treatment of when synthetic users help and when they mislead. nngroup.com Article Synthetic Users: If, When, and How to Use AI-Generated "Research" Nielsen Norman Group
  2. Video Synthetic Users: AI "Participants" (video) Nielsen Norman Group
  3. Video Accelerating Research with Synthetic Users Conference talk (YouTube)
  4. Video Synthetic User Research Explained | How AI Is Changing UX YouTube creator (UX research)
  5. The sharpest critique: synthetic research borrows the authority of science without its standards. interactions.acm.org Article The Synthetic Persona Fallacy: How AI-Generated Research Undermines UX Research ACM Interactions
  6. The industry-adoption view, including where synthetic data already works in production research. forbes.com Article The Promising Rise Of Synthetic Personas In Market Research Forbes Tech Council
eChai Partner Brands The partnership →