5
12 Comments

[freebie] I Scraped 860k Apps From AppStore; here is what I found

Hey, Hackers!
Recently I received an email from Trends.co.
They came across a project called Validated Ideas. In a nutshell, it's a list of 5k Android apps with 100k+ downloads each and ratings lower than 3.2

That's sick! — I thought. Many products out there prove the demand, and their lousy execution opens an opportunity for indie devs.

The product is generally good with some flaws. There are many apps in the list serving the hardware or saas, some of them built by tech giants, etc.

I wanted to see the whole data myself. So I opened VS Code and scraped the hell out of AppStore.

Statista is saying that AppStore has 1.96m apps. I'm wondering if iPad and iPhone version of the same app is considered 2 apps. Scrapping AppStore top to bottom, left to right, I succeeded in collecting 860,702 apps and games.

In my DB I have: app id, name, description, price, icon, screenshots, release date, update date, version number, latest release notes, current rating, number of reviews, the size on the app, app category, developer name, developer website.

Instead of checking poorly executed products, I wanted to see what is actually trendy. Here is the list of 122 apps published in the last 4 months with 500+ reviews and rating 4.5+
https://www.dropbox.com/sh/cwh9bw70am6i1th/AACLk0cllkqzTK-POc7DYyrVa?dl=0

Think what you would like to know and leave your request in the comments.
I will put together a list for you.
Example: list of games with price > 0, rating < 3.2 and number of reviews > 1,000

on February 1, 2021
  1. 4

    How can I get the entire list?

    1. 1

      Guys, the point is to discuss and analyze data inside community. Tell us what query you would like to execute, and I’ll publish the result so everyone can use it

    2. 1

      Also this haha

  2. 1

    Can I see educational apps for children that are not free?

    1. 1

      Here is the list https://www.dropbox.com/s/lxedj9lwl99kqtv/children-educational-paid-apps.csv?dl=0
      I selected apps that belong to Education category and excluded Games category. Out of those I selected apps with price that are related to kids and children.

      Mind that app developers are heavily using subscriptions. The app itself can be free, but it offers in-app purchases. Those apps are not in the list. Unfortunately I don't have info about in-app purchases.

      1. 1

        Thanks. That's very true, so apps with in-app purchases show up as free?

        1. 1

          Yes, they show up as free, and in order to get a subscription price I need to scrape each app individually (maybe I will later). I uploaded free educational kids apps for you https://www.dropbox.com/s/9rhxgygzcjtr5n9/children-educational-free-apps.csv?dl=0

  3. 1

    Love your ingenuity!

    I don't have any need for this kind of data, but if I'm ever looking for someone to collect a bunch of data for me (which I actually might need), I'll be sure to contact you to see if you can help :)

  4. 0

    Awesome man! I like to see apps like my app: FriendTime.co - it's a contact and productivity app. Is that a category?

    1. 1

      Hey, Wijnand. There is a productivity category. What you would like to know? Apps with plenty of reviews, but low rating?