2
1 Comment

ML Web-Crawling

I've built an app which would benefit immensely from integrating ML webcrawling.

But I'd like be able to intelligently navigate of webpages toward an objective. This'd unlock a lot of useful applications. And it's feasible.

Background: I've done a lot of procedural webcrawling (puppeteer, selenium, straight up js - particularly on sites that seek to be crawl-proof). And I've solved captchas autonomously within a webcrawling app using w/ pytesseract. I'm also aquatinted w/ pytorch + brain.js + kaggle.

Any data scientists/devs who'd fit in collaborating to solve this problem (or a subset of it), hit me up. Looking to work with those with a track record of executing/getting things done (rare). :)

-Blake

[email protected]
discord: deepb#4778

posted to Icon for group Looking to Partner Up
Looking to Partner Up
on February 19, 2020
  1. 1

    Not related, but what are you thoughts on scraping linkedin? feasable at scale?

Trending on Indie Hackers
The most underrated distribution channel in SaaS is hiding in your browser toolbar User Avatar 185 comments I launched on Product Hunt today with 0 followers, 0 network, and 0 users. Here's what I learned in 12 hours. User Avatar 156 comments I gave 7 AI agents $100 each to build a startup. Here's what happened on Day 1. User Avatar 98 comments How are you handling memory and context across AI tools? User Avatar 50 comments Do you actually own what you build? User Avatar 38 comments Show IH: RetryFix - Automatically recover failed Stripe payments and earn 10% on everything we win back User Avatar 34 comments