Home
Starting Up
Tech
Creators
A.I.
Lifestyle
Money
Idea Board
Vibe Coding Tools
Products
Ideas DB
Case Studies DB
Subscribe to IH+
Starting Up
Tech
A.I.
Creators
Lifestyle
Money
Join
1
Like
0
Bookmarks
2
Comments
Report
[Poll] What is your biggest challenge related to web scraping?
by
Robert Balazsi
I'd be curious to find out what your biggest challenge is related to web scraping.
What is your biggest challenge related to web scraping?
Coming up with robust element selectors
Scraping AJAX pages
Website's structure updated quite often
Bypassing anti-scraping measures
Getting past geo-blocking
Something else (please comment)
Vote
Trending on Indie Hackers
I spent $0 on marketing and got 1,200 website visitors - Here's my exact playbook
58 comments
Veo 3.1 vs Sora 2: AI Video Generation in 2025 🎬🤖
29 comments
Codenhack Beta — Full Access + Referral
21 comments
I built eSIMKitStore — helping travelers stay online with instant QR-based eSIMs 🌍
20 comments
🚀 Get Your Brand Featured on FaceSeek
18 comments
Day 6 - Slow days as a solo founder
16 comments
Selenium does almost everything “well” BUT scraping sites with dynamic content is challenging. Don’t you think?
It is indeed, especially for scalability reasons. A headless browser is much slower and more resource-intensive as a HTML parser, so a good practice would be to use headless browsers only if absolutely necessary.