Hi Everyone,
I run a job board for the Oregon tech community (https://www.thesiliconforest.com/) and I currently collect the jobs that I post manually. Does anyone have any recommendations for how to source jobs for your job board?
I saw this collection of APIs to pull from (https://www.indiehackers.com/post/directory-of-apis-that-we-can-leverage-for-job-boards-55474ae789). Do most of you automate your job collection with those APIs? Does anyone use any scraping tools?
Let me know if you have any recommendations.
Thanks!
I use nokogiri (https://github.com/sparklemotion/nokogiri) to scrape individual career sites from relevant companies. The scraping is a daily cron job that puts the jobs into an incoming queue. I review the incoming queue on my website and push the relevant jobs to the main page.
Scraping individual career sites is a lot of work, but many companies use Lever or Greenhouse, so you can abstract that part of your scraping.
Thanks! I'll look into scraping a few sites to try it out.