How Would You Move Forward?

tldr: Validated idea early but having issues scraping airlines

For the last few months I have been hacking away on PointsParty.io. It's a simple idea. Scrape airlines for award flight data and alert users of great deals

I built a prototype in spreadsheets after building scrapers for 4 airlines and launched on reddit to validate the idea and boom! Huge response. It was the 2nd most upvoted post ever in a 500,000 user subreddit with 2,000+ comments.

Since then, I have had nothing but hardship trying to scrape all other airlines. Everything I try gets blocked.

• Reproducing the specific API requests.
• Using ISP proxies
• Using puppeteer
• Deploying puppeteer on lambda.
• etc.

I know it is possible to scrape these airlines because there are other tools that do so.

What would you do if you were in my shoes?

Would you give up after not making progress for a few weeks? Giving up the glimmer of PMF I already saw.

Are there books on reverse engineering I should read?

Anything helps! Thanks!