Expert in scraping/data mining/eCommerce looking for new projects
Hi!
I have my current project running solidly and my current team is preoccupied with keeping it working. I'm looking to get into something interesting this year.
I have an expertise in:
data mining & scraping
Everything that relates to eCommerce
I'm interested in:
Scraping Data
Real Estate
eCommerce Data
but I'm really open to anything - just something that would intrigue me
My best expertise: web scraping, currently we are doing more than 60 million requests per day to eCommerce sites and have more than 500 million products in cache
I'm good at finding solutions to problems that are hard to solve and working with devs to explain tasks to them.
I'm originally from Russia and therefore it is easy for me to work with devs from former soviet bloc.
Project does not need to be profitable from day one, I can financially support myself and my family and still spend time on a new project, however I won't be able to invest money into the new project and of course I would be looking for it to being profitable or funding friendly in not very far future.
Currently I live in Paris, France, but your location does not matter.
Hi, I would be interesting in speaking.
Working on an early stage start up and your experience might be useful.
Feel free to contact me on twitter - @jack_wagner3
Hey! I also run a couple of profitable saas projects, I have an idea that I've been thinking on that your skillset would be perfect for. I can do both the dev and marketing to get intial customers if you can do some of the dev/data scraping side of things. Feel free to reach out, my email is in my profile. If you can also include the url of this post that would be much appreciated. Thanks!
I think you have expertise on highly valuable topics.
What do you think about protection against scraping for eCommerce ?
Preferably without too much impact on UI/UX.
Countermeasures :)
you mean try and limit what I actually do ? :) yeah, I thought about that as a future project, because all of the current limitations we pass without a problem, just cost might increase for some solutions.
The problem is that scraping can be so like human nowadays, that it is very hard to distinguish, I'm sure there might be a solution, but most probably it will affect the end user as well - and that is very bad for eCommerce.
if some eCommerce site does not want to share pricing, they should have members only pricing, otherwise I believe they just should go along and actually offer easier way for robots to get pricing as not to mess with their own flow and decrease the resources used. For customers they can always offer special deals and etc, so that the end pricing will be less than the pricing on the page.
I feel you. Probably any anti-scraping technique we can imagine is nowhere near 100% efficiency.
At best you can hope to increase the time required to scrape/use data and the cost to scrape.
This comment was deleted 5 years ago