I'm launching a web scraping tool this week, can anyone think of a good vertical to pursue?
http://www.getdigitscout.com
I'm launching a web scraping tool called Digit Scout, www.getdigitscout.com to help companies outsource their data intake needs.
I'm brainstorming possible verticals to pursue. So far I'm thinking AI, eCommerce (price monitoring) and trading companies who use news + social in their algorithms.
Does anyone have scraping needs of their own? I'd be happy to provide my tool for free in exchange for feedback and ideas on companies to pursue.
I would be interested in talking further about this for use with Haystack News. Wanna schedule a call sometime? Otherwise happy to also discuss it via email. My contact details are in my profile.
Just reached out via email :)
Have you thought about building something modular or easily configurable, so folks can use it to scrape multiple things? I always have new projects I’m needing to write a new Python script for, but having something extant that I could just configure for different sites/needs would be pretty useful.
So basically if I could scrape emails from one site, images from another, contents of a certain CSS element from another, etc - I’d pay for that tool!
Yes! I'm actually trying to finish up our MVP this week. Do you have time early next week for a demo?
I'll be needing to scrape amazon at some point in the future to check if reviews I have on my website are the same as those appearing on an amazon product page.
Likely a very specific case, but if your tool is generic enough and can reliably scrape from Amazon (a problem in itself) then I'd be interested in learning more.
Hey Cleippi, yes I can do this for you, do you have a list of products I should check daily?
That list will change constantly depending on who is using my service so I don't really have a static one on hand. I'd need to use an API of some sort.
Gotcha, what would the inputs be? A list of ASINs / Titles / UPCs etc?
Either an ASIN or a direct link to the book's page.
Awesome, ya we are already set up for this. Want to email me at casey@getdigitscout.com, I can get you setup.
Sure, just sent the email.
I am interesting to check it out for product price extraction
Hey Daniel, yes I can do this, what site are you thinking of using this for?