Urgent.News

What's breaking now, across thousands of outlets.

Tech

Getting 12 testers is the easy part: what 1,500+ Google Play closed tests taught us about tester activity

If you're running a Google Play closed test right now, the headcount is not the hard part. Getting 12 people to opt in takes a day or two. What decides whether Google opens production for you is whether those 12 people actually use the app during the 14 days. I run TesterBee, a paid service that manages closed tests for Android developers, so I see the outcome of a lot of them. We looked at…

Securing 12 testers for a Google Play closed test may seem straightforward, but retaining those testers throughout the 14-day engagement period can be challenging. TesterBee, a paid service specializing in managing closed tests for Android developers, analyzed data from over 1,500 campaigns to uncover patterns that determine whether an app receives approval for production access.

Google's guidelines state that personal developer accounts created after November 13, 2023, must run a closed test with at least 12 testers who have opted in continuously for a minimum of 14 days. The key issue lies in the second requirement: insufficient tester engagement during the testing period. While Google does not publish a specific threshold for "enough engagement," TesterBee examined what engaged apps had in common.

During the 14-day period, approved apps had testers opening the app on 10+ different days (97% of cases) and developers pushing two or more updates (89% of cases). In contrast, rejected apps had testers opening the app on 5-7 days (41% of cases) and developers pushing no updates (53% of cases). Of the rejected apps, 91% were approved on the second attempt once the developer addressed Google's flagged issues. Ultimately, 98.4% of apps eventually secured production access.

It is essential to note that these findings represent correlations rather than definitive thresholds. Apps that maintain tester engagement for 10+ days tend to have better-built apps, which contribute to their approval. Moreover, an active day refers to a day when a tester opens the app at least once, not a day they spend an hour using it. Nevertheless, a significant gap exists between the 41% and 97% rates, highlighting the importance of tester activity throughout the testing window.

The most critical period for tester activity is days 4 to 7, as app novelty wears off, and friends and family may become less engaged. To maintain tester interest, focus on fixing launch crashes and releasing two or three small updates during this time. Each update provides testers with a reason to engage with the app again and demonstrates your commitment to improving the app, which aligns with the purpose of the closed test.

Monitor active days, not just opt-ins, as Play Console tells you which testers have opted in but not who opened the app. Utilize app-open event logging to track distinct days per tester. If a tester does not open the app for three consecutive days, reach out to them. Additionally, recruit two or three extra testers to replace any who leave during the test.

When preparing the application for production access, provide honest engagement details to Google. Include the testers' activities, their reported issues, and the changes you made based on their feedback. Demonstrating the improvements you've made to the app during the closed test will strengthen your case for approval.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in Tech

How to Answer 'Tell Me About Yourself' in a Scrum Master Interview

How to Answer “Tell Me About Yourself” in a Scrum Master Interview The best way to answer “Tell me about yourself” in a Scrum Master interview is to stop listing your certifications and start telling…

  • Focus on optimizing flow and eliminating systemic blockers rather than managing Jira tickets
  • Bridge technical and business perspectives to convert roadmaps into clear, value-driven sprints
  • Cultivate psychological safety through constructive Sprint Retrospectives and inclusive daily syncs

More from Wednesday 18 November →