7
10 Comments

How to scrape data from Tiktok/Snapchat/Instagram?

Does anyone here has some pointers on the complexity of scraping image data from Tiktok/Snapchat/Instagram? I'm looking to extract image data from those platforms, but I was curious on what would be the complexities of doing so.

Does anyone know of some good starting points or has some interesting insights on the challenges of doing so?

posted to Icon for group Developers
Developers
on July 4, 2020
  1. 1

    2026 update for anyone finding this: the cleanest solution I have found for Instagram data is a pay-per-request API — no account needed, no proxies to manage. Social Intel (https://api.socialintel.dev) returns structured profile + follower data for $0.003/request via x402. Works well for pipelines where you need public data at scale without maintaining your own scraper.

  2. 1

    2026 update for anyone finding this: the cleanest solution I've found for Instagram data is a pay-per-request API — no account needed, no proxies to manage. Social Intel returns structured profile + follower data for $0.003/request via x402. Works well for pipelines where you need public data at scale without maintaining your own scraper.

  3. 2

    It's just like scraping any other thing on the web. You have to make sure it looks like a user is visiting their site.

    As another user has mentioned, TikTok needs anti-spam parameters & a particular APK version to scrape the data as it had security err that allowed to get the complete data. You can use https://github.com/szdc/tiktok-api for it :)

    Not sure about Snapchat but for Instagram, you probably have to do the same thing I guess. You probably cannot use API as Instagram's API got stricter I guess.

  4. 2

    Everything that is on the web can be scraped with Headless Browsers. Be careful a bit with this, especially regarding not human behavior.

    If you know JavaScript you can start with something like puppeteer to automate the login of Instagram and check where you go from there.

  5. 2

    I hear instagram is easy but have not tried myself. TikTok has some anti spam parameters which must be calculated and sent with each request. Snapchat, no idea.

    I have a complete spider for TikTok profile data, including images. Available for license, of course.

  6. 1

    It requires residential proxies and up-to-date scrapers. You can try https://scrapeflare.com webscraping API.

  7. 1

    Hi, I've done a lot of high end webscraping. If you'd like to connect I'd be open to giving you my proven framework for getting consistent results scraping something like Instagram...

    I'd recommend Python, it contains a easy to use module called beautifulsoup that will do the dirty work scraping. From there to scrap at scale you'll need to use proxies.

    shoot me a message on discord: do#3695

    1. 1

      Hi I shot you an invite on discord from audiobee to discuss

  8. 0

    you can use scrapingdog.com to scrape images from social media.

    1. 1

      This comment was deleted 6 years ago.

Trending on Indie Hackers
30 days ago I posted here with $0 revenue. Here's what actually happened next. User Avatar 150 comments How to spot high-intent customers in 5 minutes, for free. User Avatar 48 comments Fixing broken scrapers instead of working on my actual product. So I made it my problem. User Avatar 39 comments I Built a Habit Tracker SaaS Alone in 6 Weeks (No CS Degree, No Team). Here's Exactly How User Avatar 39 comments I built an open-source PII masking layer for LLM APIs — early traction, looking for design partners User Avatar 29 comments How to see revenue problems before they get worse User Avatar 23 comments