1
4 Comments

Scraping Job Sites

Hi - I’m considering making ANOTHER job site…. Yes perhaps a saturated market but treating it more as an experiment than a business idea..

Anyway, when scraping for content from other job sites, is it ok to copy the job spec word for word? Are there any do’s and don’ts?

Cheers

on October 16, 2022
  1. 1

    This is definitely against their TOS. I wouldn't recommend this unless you want them to take legal action against you and your new site. Hope this helps!

    1. 1

      So how did sites like remoteok manage to scrape other job sites in the beginning and not get in trouble for it?

  2. 1

    I think that it's not ok to copy word for word, for legal and SEO reasons, but some job platforms may give you the license to do so. Google will treat you like a duplicate and penalize your site. Maybe you can run the scraper for a while, but when you will get notified by some of these platforms you may get a Cease and Desist letter or worse.

    1. 1

      Ahh ok. Sounds like I need some sort of ai service to reword the data