What are the Different Ways to Test a Mobile App on Userlytics?

Userlytics’ advanced UX testing platform allows you to test your mobile app with target customers to ensure it is well designed, efficient, and meeting your customers’ needs. There are two different ways to conduct a user test of your mobile app on Userlytics’ platform: 1) within the Userlytics mobile app, or 2) through our app in-browser system.

Below, we’ll go over both the in-app method of testing your mobile app and the in-browser method to determine which one is best for your business needs.

How Does Conducting an App Usability Test Within the Userlytics Mobile App Work?

Userlytics has native Android & iOS applications for remote mobile usability testing. For many clients who are testing the functionality of a mobile app, conducting participant tests from within the Userlytics app can offer them a reliable way to gain key UX insights.

To create a Userlytics mobile app test, first select “Create New Test” from within the Userlytics client dashboard.

Then, within the “Test Type” section of the test builder, select “App” as the type of asset you will be testing.

Next, define whether your participants will be testing your app on an iPhone or an Android device.

Lastly, within the “Participants” section of the test builder, select “Smartphone” or “Tablet” as the device you would like participants to take your usability test on.

What are the Pros of Testing my App within the Userlytics Mobile App?

  • Offers test participants a very realistic idea of how your app looks and functions in the real world, giving you valuable UX feedback and data
  • Allows participants to test native app functions such as screen taps, zooming in and out, etc.
  • Offers quick and easy download for participants

What are the Cons of Testing my App within the Userlytics Mobile App?

  • Because tests are typically taken on a mobile device, they are subject to interruption due to phone calls or other unprecedented notifications, which may compromise test results
  • Older phones that are not updated may be subject to app crashes, which may compromise test results
  • Onboarding experience is much more complicated for participants due to native technical limitations (that Userlytics cannot control)
  • Currently, moderated testing is not yet possible when conducting tests via our mobile app

How Does Conducting an App in-Browser Usability Test Work?

App in-browser testing refers to a technology that runs a virtual machine simulating a real mobile device. The technology uses a real Android version of a mobile app, but without real hardware, meaning there’s no mobile phone being used during the test. The screen can be customized to select specific mobile devices or brands.

During the testing process, your participants will see a demo of your app, website or prototype on their computer screens.

If you decide you would like to run an app in-browser test, contact your Userlytics Account Manager, and they will help coordinate your test details.

What are the Pros of Testing my App within a Browser?

  • In-browser tests can be moderated, allowing you to gain additional insights that may not be possible with tests taken within our mobile app
  • Computer keyboard allows for easier completion of written tasks
  • There are no interruptions of the test on a browser and less crashes, providing you with more accurate test results
  • Quick and easy onboarding for participants – they simply open a URL and are ready to start the test. This is crucial when you bring your own participants that are not high-level tech persons (Ex: people older than 80, people without any tech background, people that have already experienced onboarding problems in other tests, etc.)

What are the Cons of Testing my App within a Browser?

  • Because some native gestures such as screen taps and zooming in and out cannot be recreated on this system, the participant may not get to experience the app’s full functionality

Our Recommendation

Although there are certain cases where testing within the Userlytics app is the best option, whenever possible, we suggest clients consider testing their app in-browser. With the added capability of allowing moderated testing, the simplified participant onboarding experience, and the significant decrease in test interruptions and unexpected crashes, in-browser testing usually proves to be a simpler, more efficient remote user testing experience.

Was this post helpful?

We can Also help with

Our Blog

Our Blog

Your websites, applications, mobile apps, prototypes, even competitor assets; optimize your customer journey, the user interface, and your users' experience.

Phone Contact

Phone Contact

USA & Canada: +1 888-809-0047; UK: +44 20 3966 0575; Germany: +49 800 001 0206; France: +33 4 11 92 06 80;
Spain: +34 919 01 17 41


FAQ Clients

Here you can find the most popular User and Usability Testing Questions. For example, what kind of User Testing does Userlytics do or What is prototype usability testing?