6
5 Comments

Does anyone have experience with LinkedIn scraping?

Hey there everyone, I was wondering if anyone has experience with LinkedIn scraping. I was using their API, however their API only gives you the current experiences(I need more than that for the project I am working on).

LinkedIn also has a second API but they generally reserve this for marketing solutions. So it seems that scraping is a good option here. It seems they have many blocks built to prevent scraping.

Would be curious to hear if you have used any APIs or methods!

on September 16, 2019
  1. 1

    Wrote 3 or 4 different LinkedIn scrapers so far. Parsing their markup is also difficult as it's poorly structured and unpredictable. You need to scrape 100s of pages to fine-tune the parser.

    I have some old Laravel-based source codes somewhere.

  2. 1

    I've used Dux-Soup with some pretty decent results. I wanted to find Drupal developers to validate an idea I had, I got a bunch of email addresses and did some cold emailing from my personal account.

  3. 1

    Yeah, I have scraped LinkedIn using python & selenium to extract companies and users data.

  4. 1

    Not attempted LinkedIn scraping but I have a lot of experience scraping from another large social networking site. I ended up using Puppeteer for the job. https://github.com/GoogleChrome/puppeteer. It's even easier with this tool to record your interactions and output a script: https://github.com/checkly/puppeteer-recorder