1
2 Comments

An Instagram insights dashboard. Scraping, API, or?

Hi there,

I'm validating the idea of a product that gives insights on Instagram business accounts. Something like Ninjalitics (https://www.ninjalitics.com/) or Socialblade (https://socialblade.com/). My assumption is that there is market for multiple products like that even though some of them are already popular.

Looking at the official Graph Api there's a limit of 200 requests per hour, which is nothing if you want to provide a service like that.
I assume these platforms mentioned above do web scraping to retrieve such an amount of data, what do you think?

Has anyone looked into a product like that? A few more questions:

  • is web scraping legal for this kind of purposes? any resource to help me understand this aspect?
  • if I wanted to stick with the APIs I could created a distributed system with N different instances with an API-key each cooperating to retrieve the data (complicated)
  • in case the scraping aspect it's a grey area I see instagram blocking my IP
  • has anyone had ever negotiated a deal with them to get a custom policy for the APIs?

Thank you!

  1. 2

    It seems that this limit is enforced per user account (not yours), so you might be able to scale pretty comfortably (about 3 requests per minute for each user) and validate the idea/generate some revenue.

    As a more long term solution, these guys apparently use a similar approach to your #2: https://tint.zendesk.com/hc/en-us/articles/360002900874-Instagram-Rate-Limits

    1. 1

      Thank you @omneity!