7
8 Comments

How to scrape data from Tiktok/Snapchat/Instagram?

Does anyone here has some pointers on the complexity of scraping image data from Tiktok/Snapchat/Instagram? I'm looking to extract image data from those platforms, but I was curious on what would be the complexities of doing so.

Does anyone know of some good starting points or has some interesting insights on the challenges of doing so?

  1. 2

    It's just like scraping any other thing on the web. You have to make sure it looks like a user is visiting their site.

    As another user has mentioned, TikTok needs anti-spam parameters & a particular APK version to scrape the data as it had security err that allowed to get the complete data. You can use https://github.com/szdc/tiktok-api for it :)

    Not sure about Snapchat but for Instagram, you probably have to do the same thing I guess. You probably cannot use API as Instagram's API got stricter I guess.

  2. 2

    Everything that is on the web can be scraped with Headless Browsers. Be careful a bit with this, especially regarding not human behavior.

    If you know JavaScript you can start with something like puppeteer to automate the login of Instagram and check where you go from there.

  3. 2

    I hear instagram is easy but have not tried myself. TikTok has some anti spam parameters which must be calculated and sent with each request. Snapchat, no idea.

    I have a complete spider for TikTok profile data, including images. Available for license, of course.

  4. 1

    It requires residential proxies and up-to-date scrapers. You can try https://scrapeflare.com webscraping API.

  5. 1

    Hi, I've done a lot of high end webscraping. If you'd like to connect I'd be open to giving you my proven framework for getting consistent results scraping something like Instagram...

    I'd recommend Python, it contains a easy to use module called beautifulsoup that will do the dirty work scraping. From there to scrap at scale you'll need to use proxies.

    shoot me a message on discord: do#3695

    1. 1

      Hi I shot you an invite on discord from audiobee to discuss

  6. 0

    you can use scrapingdog.com to scrape images from social media.

    1. 1

      This comment was deleted 4 years ago.

Trending on Indie Hackers
How I grew a side project to 100k Unique Visitors in 7 days with 0 audience 48 comments Competing with Product Hunt: a month later 33 comments Why do you hate marketing? 28 comments $15k revenues in <4 months as a solopreneur 14 comments My Top 20 Free Tools That I Use Everyday as an Indie Hacker 13 comments Use Your Product 13 comments