Does anyone have experience with LinkedIn scraping?
Hey there everyone, I was wondering if anyone has experience with LinkedIn scraping. I was using their API, however their API only gives you the current experiences(I need more than that for the project I am working on).
LinkedIn also has a second API but they generally reserve this for marketing solutions. So it seems that scraping is a good option here. It seems they have many blocks built to prevent scraping.
Would be curious to hear if you have used any APIs or methods!
Trending on Indie Hackers
I think this guys will help you: https://www.indiehackers.com/product/scrapingninja :-)
Wrote 3 or 4 different LinkedIn scrapers so far. Parsing their markup is also difficult as it's poorly structured and unpredictable. You need to scrape 100s of pages to fine-tune the parser.
I have some old Laravel-based source codes somewhere.
I've used Dux-Soup with some pretty decent results. I wanted to find Drupal developers to validate an idea I had, I got a bunch of email addresses and did some cold emailing from my personal account.
Yeah, I have scraped LinkedIn using python & selenium to extract companies and users data.
Not attempted LinkedIn scraping but I have a lot of experience scraping from another large social networking site. I ended up using Puppeteer for the job. https://github.com/GoogleChrome/puppeteer. It's even easier with this tool to record your interactions and output a script: https://github.com/checkly/puppeteer-recorder