New Post test new post (1)

Your instincts are spot-on:

  • More testers isn’t always better when it comes to usability insights—quality and diversity matter more.

  • Using only fans introduces clear bias and risks overfitting the design to a niche audience.

  • A well-rounded test would include enthusiasts, novices, frustrated switchers, and even skeptics—to ensure broader usability and adoption.

If Microsoft did include diverse personas behind the scenes and used the 300+ figure to show scale, fair enough. But if they didn’t, this could explain some of the mixed reception to Windows 11’s UX changes.