Create your First UX Test

After you’ve identified your test goals, target audience and testing methodology, it’s time to build out your first user experience test. The first step in creating your first UX test is to decide whether you will be conducting an unmoderated test, or a Live Conversation test. During an unmoderated test, your participants will be asked to go through your test on their own, without the guidance of a moderator. For a Live Conversation test, a live moderator will be on a webcam with participants throughout the entire test. The moderator can help guide participants through the test and answer any questions they may have. Although a Live Conversation involves the added coordination of finding available time slots for both your moderator and participants, it is an extremely effective tool for gathering user feedback.

After deciding between an unmoderated or a Live Conversation Test, it’s time to build out your test from top to bottom. Below, we give an overview of each aspect of the test builder in six simple steps:

Define the Test Info

The first aspect of creating your UX test is defining the basics. There will be prompts in our test builder that ask you to choose a public name for your test, which will be seen by all of your participants, and to choose a private name if you’d like, which will only be seen internally. Then, the builder will ask you what type of asset you will be testing, whether that be a website, mobile app, or prototype. There will be a given space for you to link to your asset. Once this is done, choose whether your participants will be recorded via video, audio and screen recording, or just audio and screen recording. Lastly, choose the length of your testing sessions and session language, keeping in mind that the language of the test should be the same language you eventually write the test script in.

Filter your UX Test Audience

After you’ve outlined the basics of your test, it’s time to filter your UX test audience. You have two options when it comes to choosing participants for your test: you may invite your own participants to the test, or allow Userlytics to sort through its global panel of over 500,000 testers to find the perfect audience for your test. You must then choose the target number of participants for your study. After choosing whether you will be inviting your own participants to the study or choosing from our global panel of participants, you will be able to select filtering criteria like country, age, gender, and other demographic filters. These filters will ensure each participant who takes your test is representative of your brand and will provide you with real, valuable UX insights.

Filter More with a Screener

As an added way to ensure your testers fit the exact profile of your target demographic, our test builder has the built in option of adding a screener to the beginning of your test. The screener is totally customizable, and allows you to ask participants a very specific question that will either include or exclude them from your study.

If Bringing your own Participants, Invite Participants

If you choose to invite your own participants to your study, after building out your test, you will be able to send them a personalized link to take your UX test. Participants can be invited to your test via URL, an email, or a website widget. You can also leverage our advanced redirect and unique identifier (UID) system to leverage participants offered by third party panels such as SSI, Peanut Labs or Testing Time.

If Conducting Live Conversations, Schedule Sessions

If you choose to conduct a Live Conversation test with your participants, you will have to select your moderator’s availability and create open and available test sessions. You have the option of designating a large time block with your availability, or creating individual open test sessions for your participants to choose from. Invited participants can then confirm the specific date and time they will complete the test, and both the moderator and the participant will receive reminders prior to the selected test date and time. One unique aspect of the Live Conversations option is that participants do not need to download any application, extension or plug-in to start tests. The system is completely “in-browser” and 100% HTML based, so participant onboarding is seamless and can take place within corporate firewalls.

Define your Test Tasks

The last and most important aspect of creating your first UX test is designing tasks for your testers. Here, you have two different options: you can choose from our existing task templates, which include a variety of quantitative and qualitative test questions, or you can create your own tasks from scratch. If you decide to create your own tasks, remember to ask questions that don’t lead to any user bias, are open-ended, and as simple as possible. Whether you choose to create your tasks from scratch or to use our templates, be sure to preview how your tasks look before launching your test.

Was this post helpful?

We can Also help with

Our Blog

Our Blog

Your websites, applications, mobile apps, prototypes, even competitor assets; optimize your customer journey, the user interface, and your users' experience.

Phone Contact

Phone Contact

USA & Canada: +1 888-809-0047; UK: +44 20 3966 0575; Germany: +49 800 001 0206; France: +33 4 11 92 06 80;
Spain: +34 919 01 17 41


FAQ Clients

Here you can find the most popular User and Usability Testing Questions. For example, what kind of User Testing does Userlytics do or What is prototype usability testing?