5
3 Comments

Anyone used Puppeteer for Web Scraping? Whats your coolest project?

I've recently started using Puppeteer and Node.js for web scraping and am finding the power and flexibility you get with it amazing. Of course you need to write a bit of code but its very simple and the browser emulation you get with it is great for javascript heavy websites. I'm currently using it on some more difficult to scrape sites like social media etc.

Interested to hear if anyone else has experience and what you've used it for

posted to Icon for group Webscraping
Webscraping
on September 9, 2021
  1. 1

    I have never used Puppeteer, I always use Cheerio for web scraping, I will try it!

  2. 1

    I tried using Puppeteer for HTML to pdf conversion and but the thing was I had to use Nodejs with it so switched to Playwright which I can use with Python.

  3. 1

    At @supermonitoring we use Puppeteer for page speed and transaction monitoring.

Trending on Indie Hackers
I spent $0 on marketing and got 1,200 website visitors - Here's my exact playbook User Avatar 58 comments Veo 3.1 vs Sora 2: AI Video Generation in 2025 🎬🤖 User Avatar 28 comments Codenhack Beta — Full Access + Referral User Avatar 21 comments I built eSIMKitStore — helping travelers stay online with instant QR-based eSIMs 🌍 User Avatar 20 comments 🚀 Get Your Brand Featured on FaceSeek User Avatar 18 comments Day 6 - Slow days as a solo founder User Avatar 16 comments