lady with iPad

NEVER Say This Word to Users (Avoid Bias and Improve Your Research Data)

Picture this: you’re invited to a research study. The researcher greets you with a smile and says, “This is an interactive activity that will take about 20 minutes.” Sounds intriguing, right? Now, imagine instead they say, “You’re about to take a test.” Suddenly, your mind races. “What if I fail? What are they looking for? Am I about to be judged? Will I look stupid?” That tiny word—”test“—can flip a switch in your brain, and not in a good way. If your role involves gathering data from customers, this is crucial to think about.

How people wrongly use the word ‘test’

I see people using the word ‘test’ all the time, even those working as professional researchers. 

Pre-research: 

  • Recruitment: Customer emails to ‘Take part in our user test’. Be careful of your participant recruitment company too because those are often just admin staff who then promote your research to their database as ‘user testing’. 
  • Calendar invites sent to participants with the title ‘User test’ (note: this reads as though the user is being tested. If you really must use the word ‘test’, please please for the love of God at least refer to it as a website test, not a user test!)
  • Initial welcome: ’Are you here for the user test?’ (said by the receptionist or researcher).

During the research

  • Confidentiality form / NDA will often let slip a mention of user test. Sometimes these are written by legal so you’ll need to tell them to change the wording.
  • Introduction section of the research: The facilitator will say ‘thanks for agreeing to take part in our user testing’ or similar. 
  • Aiming to reassure: ‘This is not a test’ (just saying the word will prompt people to think of it as a test).
Image: This is not a test

Why Labels Matter (Hint: They Totally Do)

To find out why labels matter and how they affect us, lets quickly head back to 2004, when Ross and colleagues ran a fascinating study. They asked people to play a game that involved cooperation (or not). Half the participants were told it was called the “Wall Street Game,” and the rest were told it was the “Community Game.” The rules were exactly the same, but guess what? The “Wall Street” group acted way more competitively, while the “Community” group leaned into collaboration. Just changing the name to ‘Community’ made them behave in a more collaborative way.

Labels act like cues—subtle signals that shape how people think they’re supposed to behave. If you call something a “test,” you’re setting a tone of evaluation. And when people think they’re being judged, it’s game over for authentic responses. 

What Happens When You Say “Test”

You might think “test” is an innocent word. It’s not. Here’s what it does to your participants:

  1. Cranks Up Anxiety: “Test” screams, “You’re being judged!” and that makes people worry. Anxiety takes over, and instead of focusing on the task, they’re focused on not messing up.
  2. Triggers People-Pleasing Mode: Participants may try to give you the “right” answers instead of their honest thoughts. Spoiler: this isn’t great for your data.
  3. Activates a Fixed Mindset: Carol Dweck’s research shows that when people feel evaluated, they can get stuck in a “fixed mindset,” where they play it safe instead of trying something new.
  4. Sets Up Defensive Behaviours: A test feels like a challenge, and people might approach it like they’re protecting themselves rather than exploring freely.

Ditch “Test” for Friendlier Options

If you want participants to relax and engage, ditch the T-word. Here’s what you can say instead:

  • Swap out “test” for words like “research,” ”activity,” “feedback,” “game,” or “exercise.” Doesn’t that sound more fun already?
  • Frame it as exploratory: “We’re curious to see how people solve situations like this.”
  • Keep it collaborative: “We’re exploring this together. There are no wrong answers.”

These tiny tweaks can work wonders. They tell participants: “You’re here to help us learn, not to be judged.”

How to Set the Right Tone in Your Study

Here are some tips to make sure you’re creating a participant-friendly experience:

  1. Test Your Labels (Pun Intended): Try out different phrases during your prep phase. Which one makes people feel most at ease? 
  2. Train Your Team: Make sure everyone on your research crew knows the drill—use non-judgemental, inviting language.
  3. Start Off Right: From your first email to the consent form, use words that spark interest and collaboration, not fear of failure.
  4. Avoid Fancy Jargon: Even “assessment” or “evaluation” can sound intimidating. Keep it simple and warm.

Why It’s Worth the Effort

Here’s the deal: your goal as a researcher is to understand how people think and behave in the real world. But if your participants feel like they’re under a microscope, their behaviour changes. By being mindful of the language you use, you can create an environment where people feel comfortable being themselves. And that means better, richer data for you.

So, the next time you’re setting up a study, think twice before using the word “test.” A little tweak in your phrasing can make a big difference to how your participants feel and the data you collect.

References

  • Ross, L., Greene, D., & House, P. (2004). The “Wall Street Game” versus “Community Game”: Situational labels shape decision-making in social dilemmas. Journal of Personality and Social Psychology, 87(1), 1–13.
  • Dweck, C. S. (2006). Mindset: The New Psychology of Success. Random House.
  • Kahneman, D. (2011). Thinking, Fast and Slow. Farrar, Straus and Giroux.
  • Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54(2), 93–105.

My nightmare user recruitment experience…

As someone who has worked both client and agency side, I can tell you that I’ve found it very difficult finding good participant / user recruitment agencies. The country where I’ve had the most issues has been the UK and I believe this may be because of the recent explosion and in cases exploitation of ‘UX’. Companies who traditionally recruit participants for market research, have added UX, usability testing, user research recruitment to their list of services without making any changes to how they approach the recruitment.

 

My nightmare experience…

One experience that I remember very well (because the recruitment was an absolute nightmare!) was a project that my agency Keep It Usable was conducting for a global retailer. This was several years ago, when we used specialist recruitment agencies to find our participants for us. We had done everything for them to prep, including writing the screener, so all they had to do was promote it and screen people to find our users. It was a very niche user group (roughly about 3% of the population) so we made sure to give them plenty of time to recruit (about 5 weeks) and they were certain there would be no issues.

You can probably guess what happened next… with one week to go they told me they had found it impossible to recruit even one person for me! One week! With such a niche user group and only a week to go, no other agency would take the recruitment so we had no other option but to bite the bullet and pull out all the stops to try and recruit users ourselves. We did it! It wasn’t easy but we managed to do in one week what an experienced recruitment agency couldn’t do at all.

I guess this was the starting point for me in not trusting participant recruitment agencies. I’m very conscientious about the work we do (in fact in my school reports the word conscientious cropped up all the time), and the reputation of our work was potentially at risk if this happened again.

 

4 weeks notice…. really???

Another problem I had with agencies was that they needed at least 4 weeks notice which is just ridiculous in the world of UX. 4 weeks notice is a real luxury that us UXers just don’t have.

We’re iterative! We’re lean! We do things fast!

 

The solution…

Not being afraid to innovate and pioneer, we decided that if no one did UX recruitment up to our standards and the needs of us as UXers, then we’d just go ahead and create an agency that did! We’ve been testing and refining our recruitment methods over the past 2 years and after many happy clients, we’re now opening up the best user recruitment experience to you too.

 

Welcome to I Need Users

I hope you like the name 🙂 I Need Users is a specialist user recruitment agency for UX research. Founded by and run by UX experts, who totally understand your needs and the research you do.

ineedusers-ux-user-research-participant-recruitment-specialists

 

Bonus….there’s a loyalty scheme too!

Why shouldn’t you be rewarded for your investment into improving user experiences? My original motivation for getting into UX was to make the world an easier, less frustrating place to live in through our everyday interactions. So, to encourage you to invest in your UX and improve your experiences (as well as of course your conversion), every time you buy user recruitment through I Need Users, you’ll receive loyalty points that can be swapped for fantastic rewards!

You can also earn points for any spend with our full service UX agency Keep It Usable and our pioneering UK based UX Lab HomeUXLab.com

 

I’d love to hear about your experiences – have you had any nightmare user recruitment experiences?

 

You might also be interested to read:

Top 10 major risks of poor user recruitment