I recommend you to go for the latest versions; like Android 11 or 12 because these versions come with the latest features like security. As you know FRP security of Samsung devices is a headache for today's users. But if you are somewhere stuck on such use (https://easyfirmwarex.com/)
All of these are optional, be sensible with money as paying money for bug fixing likely won't provide a positive ROI. The emulator, monkey, Google and Samsung Test suites are really good at picking up bugs. Personally for a growing app, I'd only bother with the free options and handling user support issues on a 1:1 basis, but since you asked:
Free
Run a full range of emulator tests for the API levels that you use and perform a visual inspection with the lowest API emulator that you support.
Thank you DavidAllison, for your thourough response. This is invaluable. We are just starting out and know nothing about Androids. I love your advice, "Personally for a growing app, I'd only bother with the free options and handling user support issues on a 1:1 basis,"
I will save all your suggestions, however since it's all a step in the right direction. I appreciate your honesty and pointers. Thank you!!
Oh wow that's interesting. That is a lot of testers! For the google phone testing simulators is the website like the samsung website? That one seems straightforward. I couldn't find the one for Google. I am a complete newbie to apps and testing.
It's called the Google Play Store Pre-Launch report. It's automated testing on real devices by Google which occurs (during/before?) the app is published to our alpha channel.
You should be able to find more information now you know what to Google.
I'd recommend some from low end and problematic like Samsung S6 (if you still support that version), something in the middle that should work by default like a Pixel 2, or a mid huawei/one plus, and something with latest software like Pixel 5 or latest Samsung/OnePlus/Huawei devices for the latest OS features.
Thank you so much for the detailed response. This is extremely helpful as I know nothing about Android phones. Really appreciate your help and time to write this. :)
I recommend you to go for the latest versions; like Android 11 or 12 because these versions come with the latest features like security. As you know FRP security of Samsung devices is a headache for today's users. But if you are somewhere stuck on such use (https://easyfirmwarex.com/)
All of these are optional, be sensible with money as paying money for bug fixing likely won't provide a positive ROI. The emulator, monkey, Google and Samsung Test suites are really good at picking up bugs. Personally for a growing app, I'd only bother with the free options and handling user support issues on a 1:1 basis, but since you asked:
Free
Run a full range of emulator tests for the API levels that you use and perform a visual inspection with the lowest API emulator that you support.
Run the monkey: https://developer.android.com/studio/test/monkey
The Samsung Remote Test Lab lets you test on real devices for free (be warned: do NOT enter any logon details on these, they are NOT reset after use): https://developer.samsung.com/remotetestlab/rtlDeviceList.action
Paid
Any Samsung device.
Get a MIUI device (Xiaomi) if you target East Asia, as MIUI breaks some UI paradigms, especially regarding context menus.
Get a tablet-style device to test the UI on a tablet (or use an emulator)
Pick something which will likely have long-term support (something that will support API 32/33).
Pick the worst specced phone you can find - this will bring out any performance issue quickly
A phone with an SD card (if you use it).
As a daily driver, Google phone of some sort.
----
Thing will occasionally still break (the app I'm working on has ~10k+ beta testers, a few bugs still only manifest after a full release).
Thank you DavidAllison, for your thourough response. This is invaluable. We are just starting out and know nothing about Androids. I love your advice, "Personally for a growing app, I'd only bother with the free options and handling user support issues on a 1:1 basis,"
I will save all your suggestions, however since it's all a step in the right direction. I appreciate your honesty and pointers. Thank you!!
Oh wow that's interesting. That is a lot of testers! For the google phone testing simulators is the website like the samsung website? That one seems straightforward. I couldn't find the one for Google. I am a complete newbie to apps and testing.
It's called the Google Play Store Pre-Launch report. It's automated testing on real devices by Google which occurs (during/before?) the app is published to our alpha channel.
You should be able to find more information now you know what to Google.
Best,
David
I'd recommend some from low end and problematic like Samsung S6 (if you still support that version), something in the middle that should work by default like a Pixel 2, or a mid huawei/one plus, and something with latest software like Pixel 5 or latest Samsung/OnePlus/Huawei devices for the latest OS features.
Thank you so much for the detailed response. This is extremely helpful as I know nothing about Android phones. Really appreciate your help and time to write this. :)