What are the Different Ways to Test a Mobile App on Userlytics?

Userlytics’ advanced UX testing platform allows you to test your mobile app with target customers to ensure it is well designed, efficient, and meeting your customers’ needs. There are two different ways to conduct a user study of your mobile app on Userlytics’ platform: 1) within the Userlytics mobile app or 2) through our app in-browser system. 

Below, we’ll go over both the in-app method of testing your mobile app and the in-browser method to determine which one is best for your business needs.

How Does Conducting an App Usability Study Within the Userlytics Mobile App Work?

Userlytics has native Android & iOS applications for remote mobile usability testing. For many clients who are testing the functionality of a mobile app, conducting participant studies from within the Userlytics app can offer them a reliable way to gain key UX insights.

To create a Userlytics mobile app study, first select “Create New Study” from within the Userlytics client dashboard.

Then, you will be prompted to select whether you want to conduct an unmoderated study or a moderated study. For traditional testing via our mobile app, select the option that says “Unmoderated Testing.”

Next, you will need to specify that you will be testing an “App.”

Next, define whether your participants will be testing your app on an iPhone or an Android device.

If you select iPhone, then you will be prompted to paste your mobile application’s App Store URL.

If you select Android, then you will be prompted to paste your mobile application’s Google Play URL.

Lastly, within the “Participants” section of the study builder, select “Smartphone” or “Tablet” as the device you would like participants to take your usability study on.

What are the Pros of Testing my App within the Userlytics Mobile App?

  • Offers study participants a very realistic idea of how your app looks and functions in the real world, giving you valuable UX feedback and data
  • Allows participants to test native app functions such as screen taps, zooming in and out, etc.
  • Offers quick and easy download for participants

What are the Cons of Testing my App within the Userlytics Mobile App?

  • Because studies are typically taken on a mobile device, they are subject to interruption due to phone calls or other unprecedented notifications, which may compromise study results
  • Older phones that are not updated may be subject to app crashes, which may compromise study results
  • Onboarding experience is more complicated for participants due to native technical limitations (that Userlytics cannot control)
  • Our system is limited to testing apps that don’t require access to the webcam, audio or screen sharing

How Does Conducting an App in-Browser Usability Study Work?

App in-browser testing refers to a technology that runs a virtual machine simulating a real mobile device. The technology uses a real Android version of a mobile app, but without real hardware, meaning there’s no mobile phone being used during the study. The screen can be customized to select specific mobile devices or brands.

During the testing process, your participants will see a demo of your app, website or prototype on their computer screens.

If you decide you would like to run an app in-browser study, contact your Userlytics Account Manager, and they will help coordinate your study details.

What are the Pros of Testing my App within a Browser?

  • In-browser studies can be moderated, allowing you to gain additional insights that may not be possible with studies taken within our mobile app
  • Computer keyboard allows for easier completion of written tasks
  • There are no interruptions of the study on a browser and less crashes, providing you with more accurate study results
  • Quick and easy onboarding for participants – they simply open a URL and are ready to start the study. This is crucial when you bring your own participants that are not high-level tech persons (Ex: people older than 80, people without any tech background, people that have already experienced onboarding problems in other studies, etc.)

What are the Cons of Testing my App within a Browser?

  • Because some native gestures such as screen taps and zooming in and out cannot be recreated on this system, the participant may not get to experience the app’s full functionality

Our Recommendation

Although there are certain cases where testing within the Userlytics app is the best option, whenever possible, we suggest clients consider testing their app in-browser. With the added capability of allowing moderated testing, the simplified participant onboarding experience, and the significant decrease in study interruptions and unexpected crashes, in-browser testing usually proves to be a simpler, more efficient remote user testing experience.

Was this post helpful?

We can Also help with

Our Blog

Our Blog

Your websites, applications, mobile apps, prototypes, even competitor assets; optimize your customer journey, the user interface, and your users' experience.

Phone Contact

Phone Contact

USA & Canada: +1 888-809-0047;
UK: +44 20 3966 0575;
Germany: +49 800 001 0206;
France: +33 4 11 92 06 80;
Spain: +34 919 01 17 41


FAQ Clients

Here you can find the most popular User and Usability Testing Questions. For example, what kind of User Testing does Userlytics do or What is prototype usability testing?