Old Workflow (v1)
Last updated
Last updated
Before beginning, fully review the job overview of the position. It will have all the information you need about what is expected and what tools you will need.
The following list should provide you with clear steps to successfully find user testers for a project. If you're still in doubt, don't hesitate to reach out to the creative director on the project. You can also read more here:
Confirm target users with the project team & understand target users in depth, understanding target users in depth will tremendously ease the whole process.
The target user should be defined by the end of the last workshop (e.g. 2nd workshop in case of a branding sprint, and 3rd workshop in case of a landing page / product design sprint).
This is the earliest point where you can check if you understand the description of the target user. It's important to raise this with the Facilitator / Creative Director if at this point you don't understand what is meant by the description, because at this point there will still be time until the user testing actually starts.
Create a Typeform using a paid account. (reach out to Andrej to get a paid account)
Difficulty: 6/10
Duration: ~10min
Write 1-2 screener questions based on the target audience. Come up with a screener question and decide precisely what the user testers should be familiar with before reviewing the product.
A screener is a question which only a person with a suitable background will be able to answer. They usually ask for specific experience or explanation of a complex functionality of a tool.
Here are some examples for screening questions to mix and match depending on the project
When looking for people who considered signing up for a banking app:
How do you currently use neobanks (like Revolut, N26, etc.) in case you have signed up for one?
Potential answer 1: No I have not registered for them but i am considering using them.
Potential answer 2: Two good years of already using Bunq services. Zero issues, happy about all the functions available. They stop having travel account and now I have to pay for the service. But I am still happy about it. Also they are the only bank/fintech one that allowed me to have Maestro card. I spend 1/5 of year in The Netherlands and that is helping me much.
When assessing trading experience and general involvement in Web3:
Have you ever traded crypto? (Yes/No)
Which platforms have you used to trade?
When exploring experience with DAOs/communities:
What DAOs or (crypto) communities do you participate in?
Have you participated in voting for a DAO?
Which platform did you use for voting?
What kind of devices do you use? (multiple choice: Mobile; Computer/Laptop; Tablet)
Will you be able to join from a computer? (Yes/No)
Link it with Zapier to get the responses on #active-projects
Difficulty: 2/10
Duration: 5-20min
Find out where target users hang out (reddit, discord, telegram, twitter).
It's a "trial and error" game, sometimes guesses can be wrong, you just need to keep looking till you find the perfect one.
This largely depends on the product you're building and the type of users you are looking for. If you are testing for a specific demographic within the general population, you can use Facebook Ads to create a banner. They are pretty cheap ($10-$20) and people normally sign up pretty quickly. Here are a few other places we approach to scout testers:
Telegram groups for specific topics
Online forums
Difficulty: 7/10
Duration: 1-3hrs
Search through social media communities.
Official Discord servers search engine:
Telegram search engine :
Subreddits: reddit.com
Here are a few options for alternative ways to search:
Snowball recruitment: at the end of the user test, ask the user for a recommendation for 1 or 2 other people they know who you should talk to.
Paid for recruitment services: userinterviews.com / respondent.io
Deep Work's Twitter Account
Deep Work's User Tester Panel (pinned to the #active-projects channel)
Adhoc: Directly contact people, or post the ‘Call to Research’ on Discord, Reddit, Telegram, Twitter (wherever the likely audience will be)
Asking friends of friends
Difficulty: 4/10
Duration: ~30min
Write up 2 different posts, Formal and informal.
The detailed post usually gets removed - since it's considered as spam in some communities, usually works better in reddit subs.
"Hey everyone, we're currently designing a web3 related platform.
Tuesday (7/12/2021) we are running interviews that take about 30-45min each.
We will send you a link to a prototype and you can share your thoughts as you click through it.
After the interview we will send you a $45 Amazon gift card or $45 PayPal.
Requirements:
You are a tech savvy creative building new experiences on top of tokens/NFTs - Ideally you already experimented with some interactive, gamified NFTs.
You can apply here if you meet the requirements: [Typeform link here]
Out of all applicants we will be able to interview 10 in total.
Thanks so much and hope to see you there!"
This usually tends to work better ***in relevant discord communities, you can then provide more info when someone DMs you.
"Hey friends, we're currently helping a new web3 database project communicate what they are working on. Would anyone here spare 30-45min to jump on a call with us to give some feedback on their branding? We're looking in particular for web3 developers who have already experimented with NFTs and will compensate you with a $45 USDC or Amazon gift card or PayPal. Hit me up if you are interested!"
It’s important to set expectations and get informed consent to take part in the user test session, whilst not revealing in too much detail what we are looking to find out through the research.
For Example “We are looking for people who do X to take part in some user testing. The sessions will last 30 minutes, and we will have an open discussion about some of the things you do, and then ask you to look at a prototype and provide your feedback on it.”
Check that the user is the right kind of person to be speaking with. On more formal research projects, we’d use a screener questionnaire, but you can just ask them to tell you a bit about themselves to check they are suitable.
For example, if we’re looking for web3 developers, you can ask them “Tell me a bit about your experience working with web3 technologies”. And ask follow-up questions if you need to be sure.
Explain that:
We are a design studio working with a client to test our designs. (It's a good idea not to mention who the client is because we don’t want the user to go away and do any research beforehand).
They don’t have to do any preparation ahead of the call
They must be on a laptop with working camera/mic (sometimes users like to join a session from an airport on a mobile phone!)
Invite suitable users to book a time/date that works for them. Remember to include the lead researcher / Expert on the calendar invite too.
Difficulty: 4/10
Duration: 1hr
Try to have conversations over DM with the users from Discord, Reddit and other communities first, before sending them the Typeform application. It will help you personally understand if they are a good fit and increases the chances of them showing up and be happy about the user test. Please only share the Typeform application publicly if you don't get enough responses or high quality testers over DM.
Answer DMs you get.
Thank them for reaching out.
Be a quick replier - Some testers might lose interest quickly since they might be in it for knowing the project, and not the cash incentive.
Be Nice.
If in direct chat, ask them the screener question in chat, not using the typeform to get a more detailed answer.
Ask for their work or any type of proof (nicely), to make sure they actually meet our requirements.
-For example, if we’re looking for web3 developers, you can ask them “Tell me a bit about your experience working with web3 technologies”. And ask follow-up questions if you need to be sure.
After making sure they are a perfect fit, send them the Calendly link.
Confirm the tester with the creative director.
Difficulty: 2/10
Duration: ~20min
Once you have a list of respondents, try to find those who fit your criteria the most and send them a Calendly link to sign up.
Email typeform responders that qualify to take the test.
Hey there!
Thank you so much for signing up for the user testing session!
We are a small design studio called Deep Work Studio that designs digital products and also conducts user research.
My name is Hazem, I'm a collaborator and I'm responsible for the user testers this week.
This week we are working on a derivatives & perpetuals related website, similar to Aave, MakerDAO, etc..
If you're receiving this email it means that we think you are a good fit for the user testing session. If you have time Tomorrow Thursday, 2nd of December, you can use the following link to sign up for a session: [ Calendly Link here ]
The session will consist of an online-call and take approximately 30-45min, where we will show you the current design of the website, which you can share your thoughts on. After the call we will send you a $45 USDC or Amazon Gift card or PayPal.
Let me know if you have any questions, and hope to see you then!
Sometimes emails land in spam, so make sure emails land in the inbox by having yourself in BCC, If they do land in spam, re-send the email from incognito and see if that helps, if not, reach out to the creative director for help.
Difficulty: 3/10
Duration: ~20min
Remind all testers to attend the session, one day before the user research day. Direct chat is preferred, if not possible, use email.
Reminder template -
Hey there! Thanks so much for signing up to help us test the new interface. We're really looking forward to hearing your thoughts. This is a reminder that your session is taking place on (DATE) Please remember that you will need a computer with a stable internet connection and a functioning microphone!
Here is a quick guide on how to join your session : https://i.imgur.com/VEcAZSd.png
After you participate in the interview you will receive the compensation of your choice. Please fill out this Typeform to request it: https://deepworkstudio.typeform.com/to/It0F5NFT Last but not least, let me know if you can't attend or need to reschedule. This way we can make sure everything runs smoothly or give someone else the opportunity. The link for the online call is in your calendar invite. Have a great day and see you there! Your Deep Work team
Difficulty: 7/10
Duration: 0-100 min
Stay available on discord throughout the user research day, in case the user researcher needs any help with any of the testers.
Ping late testers.
Manage no shows either re-schedule them for another time that day, or if possible the next round.
Go to the Amazon.com gift card page using your personal account.
3. Send out gift card and confirm action with the creative director.
Have balance or card linked to your paypal account.
Send out $47.25 so the recipient could receive the $45 as promised (without fee deduction)
Send out the payment using the "Friends and family'' feature
Confirm action with the creative director.
Confirm all processed payments with the creative director.
Invoice Deep Work here to get refunded at the end of the month (in USDC)
Some testers invoice before the session and never show up - Make sure you only pay testers that attended the user test session
2. Make sure to fill out the correct info as seen in the image -
