ScrapingBee

Web Scraping API

Visit Website
December 3, 2020 Open report November - $200k ARR

โœ… $200k ARR

๐Ÿ’ฐ MRR: $17,549 (+51%) ๐Ÿคฏ
๐Ÿ’ต Revenue: $21,129 (+69%) ๐Ÿ˜ฑ
๐Ÿ˜€ Customer Count: 185 (+ 20%)
๐Ÿ’” Churn: 13 (vs 20)
๐Ÿ‘‹ New Trial: 950 (vs 840 )
๐Ÿ”Ž Visitors: 41k (+24%)

Here is what @Daolf and I did this month ๐Ÿ‘‡

First of all, we reached $200k ARR. ๐Ÿ”ฅ

The next stop is at $300k ARR.

At this stage, we will be able to pay ourselves better salaries than what we were paid at our full-time jobs two years ago ๐ŸŽ‰

The revenue growth was insane ๐Ÿ˜ฑ, it is by far our best month ๐Ÿš€

We got "lucky" by signing several big customers on enterprise subscriptions in the same month.

๐Ÿ“ˆOur content is still ranking better and better every month.

โœ๏ธIn terms of content, we spent a lot of effort on a piece about Web Scraping with Charles proxy: https://www.scrapingbee.com/blog/charles-proxy/

We got a lot of shares and backlinks from this one, but the keywords are not that easy, hope it will rank ๐Ÿคž

I recently started to answer some HARO queries: helpareporter.com

Here is what my inbox looks like now ๐Ÿ˜ฑ

It takes a LOT of time to filter out the noise, but we got featured on a few media outlet/company blogs.

Any tips on making this more effective?

About the product, @Daolf worked on scaling our infrastructure and fixed a lot of things with our hosting provider.

It can be a bit frustrating on this part, not having the time to do as much as we would like to. ๐Ÿคทโ€โ™‚๏ธ

But it should change!

Support was sometimes insane: https://twitter.com/SahinKevin/status/1334142247290482688

๐Ÿ’ต We also increased our salaries to 2500โ‚ฌ/mo

It feels great ๐Ÿ‘

And that's it.

See you next month, happy scraping ๐Ÿ :)

11 Comments

  1. 5

    Incredible progress - it's awesome following your story.

    No crazy growth hacks, no wildly new product idea, just building something people want and grinding it out, making good progress every month ๐Ÿ‘๐Ÿผ

    1. 1

      Thanks Ramy ๐Ÿ‘

  2. 2

    Hey @KevinSahin it's great to see ScrapingBee grow month by month. I've been following your progress here on Indie Hackers right from the early days.

    If you don't mind sharing what marketing channels worked best for you in the early days of the product? And what has been the hardest part of marketing?

    1. 2

      Thanks : )

      The hardest part is consistency. Everything is out there online, doing the work is the hardest part.

      In our case, keyword research, writing the best content and promoting it to get backlinks and rank on Google.

      The best channel for our has always been content marketing, even in the early days.

      1. 1

        Hey @KevinSahin thanks for taking the time out to reply back. It's really fascinating to hear content marketing working since the early days. It's certainly an art which very people have mastered. Would love to hear tips or suggestions about how content marketing worked during the early days.

        If you ever do blog or write about it please let me know. Have a good week ahead :)

        1. 1

          Hey @KevinSahin I just across Video to Article through the founder on Indie Worldwide slack group. Since you invest heavy on content marketing would this be of help https://typestudio.co/tool/video-to-article ? Just thought I'd suggest it.

  3. 1

    Cool @KevinSahin.

    I'm interested to use your product for one of my project. But first I would like to know what are the law that are applied for webscraping. For instance I want to scrape some careers websites.

    Where I can find usefull informations about the legal use of that.

    Thank you and good luck. Awesome product. :)

  4. 1

    $17,000 MRR is a sweet number. Especially for european folks from France.
    How did you do it? You still have the bulk of buyers from the USA, right?

  5. 1

    Awesome growth! Congrats~ ๐ŸŽ‰

  6. 1

    Great work! But was there supposed to be an image of your inbox? :)

    1. 1

      Thanks! Yes, basically, they are sending 3 emails in a row, 3 times per day so it's insane and time consuming!

October 7, 2020 Open Report September - $9,854 MRR ๐Ÿ“ˆ

๐Ÿ’ฐ MRR: $9,854 (+10%)
๐Ÿ’ต Revenue: $11,412 (+26%)
๐Ÿ˜ŠCustomer Count: 143 (vs 127)
๐Ÿ’”Churn: 15 (vs 7)
๐Ÿ‘‹ New Trial: ~800 (vs 600)
๐Ÿ”Ž Visitors: 33k (+13%)

Stats are looking good and for the first time, we crossed $10k revenue in one month.

We hope to "MRR" this in October.

We also had a lot of churns but I'm not worried.

I reached out to everyone asking them why they churned, and almost everyone told me something like this:

"Good product, but I don't need it anymore"

BTW, here is a template that works well for requesting churn feedback (75% reply rate):

Regarding the product, we launched the Google Search API: https://scrapingbee.com/api-store/google/.

And several new features to our web-scraping API, such as the ability to easily scroll on a web page.

We have also published a very nice PHP tutorial and already featured in the Symfony newsletter ๐Ÿ˜Ž.

https://www.scrapingbee.com/blog/web-scraping-php/

We also improved our marketing website following Lianna Patch's advice.

Being part of TinySeed allowed us to have a private review of our landing page and Lianna gave us great insights Folded hands.

Those videos helped a lot too:
https://youtube.com/watch?v=YEmSMF9vbbc
https://www.youtube.com/watch?v=F_urkVueszI

This month felt a bit like the end of the "Phase 1" for the ๐Ÿ.

We have managed to make the product do almost everything we wanted to do 15 mo ago.

We also deployed a content strategy, designed in January, that worked very well but we feel it's time to move on and try smth new.

We have also decided to develop a new product, built upon the
ScrapingBee core web-scraping engine but targeting people who don't know how to code.

Stay tuned.

๐Ÿ‘‹

6 Comments

  1. 1

    Hey Pierre, good job. You're killing it!

    Based on your email, what if you did something way more personal than what you're doing? Although it'll take time but I feel it'll even make people keep their subscriptions.

    Here it is.

    **Hi [name],

    Pierre here, noticed you canceled your subscription, and I wanted to know why?

    I ordered drinks and figured maybe we could chat.

    [below, add a picture of you holding two cups. One with your name on it ;the other with theirs.]

    We are a young startup ( Just Kevin and I) and you gave us a try. You leaving now is critical to us and we'd like to know why.

    Cheers,
    Pierre.

    Ps: Drinks on the house.**

    ( Won't advice you use the word "churn" as it me as you only care about your MRR)

    @Daolf what do you think??

  2. 1

    Sounds great! And what's the team size?

    p.s. I've added your pricing to SaaSHub https://www.saashub.com/scrapingbee-alternatives

    1. 2

      Thank you!

      Only 2 of us, @KevinSahin and I.

  3. 1

    Fรฉlicitations! Big! Great milestone, too.

    1. 1

      Thank you !

  4. 1

    This comment was deleted 5 years ago

    1. 1

      Thank you.

      We use chartmorgul. Free until $10k MRR ;)

      1. 1

        This comment was deleted 5 years ago

September 2, 2020 Open Report August - $8890 MRR ๐Ÿ“ˆ

August Open Report for @ScrapingBee

๐Ÿ’ฐ MRR: $8890 (vs $7875 )
๐Ÿ’ต Revenue: $9200 (vs $8290)
๐Ÿค New Customers: 31 (vs 18)
๐Ÿ˜€ Customer Count: 127 (vs 103)
๐Ÿ’” Churn: 7 (vs 7)
๐Ÿ‘‹ New Trial: 634 (vs 651)
๐Ÿ”Ž Visitors: 28,800

Here is what @Daolf and I did this month:

Our content is ranking better and better on Google, more traffic, more sign-ups, and more paying customers ๐ŸŽ‰ So even the traffic increase is not as impressive as last month, the content strategy is still working well.

This month we didn't have a lot of requests for enterprise plans (>$99/mo), and since we almost rely exclusively on inbound traffic, I guess we didn't have much luck with that.

We've tested different ad channels:

Facebook ads retargeting ๐Ÿ˜ - It could work but the cost per sign up is high. We could probably tweak the copy/creative to improve it.

Reddit ads ๐Ÿ‘Ž We didn't find how to target people interested by web scraping. Didn't convert AT ALL
3
Google Display Network retargeting ๐Ÿ‘Ž - The CPC was really high and conversion rates really low.

Reddit Ads ๐Ÿ‘Ž- CPC was low, but the traffic didn't convert. The targeting options are limited on Reddit. You cannot target every sub, and the interesting subs for us have very low impressions.

The next step is to test Twitter / Linkedin. ๐Ÿ”ฅ

Ideally, we'd like to leverage our existing traffic to retarget people.

Regarding content marketing, we are working on lot of content but we didn't publish anything this month.

Two articles were updated, like this one:

https://www.scrapingbee.com/blog/web-scraping-without-getting-blocked/

๐Ÿ‘‹ Last month we had a HUGE problem of sign-ups abuse (people signing up with disposable email addresses ) and it seems to be solved.

We used a third-party API to detect those emails.

@Daolf added Google Auth and Github Auth to our sign up page... and 50% of new sign-ups are now using either Google or Github Oauth ๐Ÿ˜ฑ

It also increased our conversion rate on the signup page ๐ŸŽ‰

We are soon going to work on our copywriting, both on the landing page and email campaign. I think it is even more important because we are not native English speakers.

Regarding the next marketing steps, there are still too many things we want to try so we need to focus... ๐Ÿ˜€

๐Ÿ On the product side, we didn't do a lot this month. But lots of things are coming!

And that's it, thanks for reading this far.

--

Kevin & Pierre

19 Comments

  1. 3

    Congrats, gents! Your consistent marketing execution continues to pay off.

    1. 1

      Thanks Rob :)

  2. 2

    Thanks and great work!

    Can you describe a bit more what you have done on the content marketing side to get yourself ranking higher?

    1. 4

      Thanks for the kind words!

      It's very classic - Basically, everything that you can find on this wonderful Ahrefs course https://ahrefs.com/academy/blogging-for-business

      There is no shortcut:

      • Keyword research
      • Writing great content
      • Building backlinks
      • Rinse & Repeat
  3. 1

    Congratz and thanks for the stats!

    Out of topic:
    I would like to ask a question about legal stuff if you do not mind. How come, Instagram or Google won't open a case because ScrapingBee crawling the data that they do not want to share with other services. Crawling is not technical problem, but legality, isn't it?

    Would be great if you could share your know-how with us.

  4. 1

    Congrats, Best wishes for more sales. :)

    Would you like to share the third-party API to detect disposable emails?

    1. 1

      Hi there, hit me on twitter, we don't really want to share it in the open :)

  5. 1

    How much did it improve conversion when you added Google and Github Auth?

    1. 1

      Hi there, almost 30% on the /register page.

  6. 1

    Great work!, learning a lot from your experience.

    Do you mind sharing the name of the 3rd party api, you used to filter out bogus email addresses?

    1. 1

      Hi there, hit me on twitter, we don't really want to share it in the open :)

  7. 1

    Cool progression Kevin, keep up the good work :)!

  8. 1

    What do you use to get those analytics?

    1. 2

      I'm not sure to understand the question, what analytics are you talking about?

      We use Google Analytics for the website visitors stats, and Chartmorgul for the financial metrics.

      1. 1

        Cool. How do you know the % that logged in using each auth method?

        1. 1

          This can be done with a simple request to your own database

  9. 1

    Thanks for sharing, very interesting stuff...

    1. 2

      Thanks, glad you liked this report!

August 26, 2020 Reaching $100,000k ARR. A highly symbolic goal ๐Ÿ‘‡

After 14 months ScrapingBe is now a 6-figures company ๐Ÿ˜Š

โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–’โ–’โ–’โ–’โ–’โ–’โ–’โ–’โ–’โ–’
50% of $200k ARR.

A highly symbolic goal for me.

When Kevin and I left our full-time job, 2y ago, we were making approximately $50k per year (๐Ÿ‡ซ๐Ÿ‡ท salaries).

So with taxes, we were costing our companies ~ $100k per year each.

So assuming they were not losing money on us, we were "creating" around $100k per year of "value"

Reaching $200k ARR means that with ScrapingBee we're creating as much value as when we were employed.

I'm glad we're halfway to that point, it means we've made up for 1 full-time salary.

Looking forward to completing that goal, and then go as far as possible. ๐Ÿคž

30 Comments

  1. 2

    Thats great! Hope you'll reach 200k ARR soon๐Ÿ™Œ๐Ÿ™Œ

    1. 1

      Thank you very much!

  2. 1

    Congrats guys :)! Keep up the good work!
    Talked to Kevin at the beginning of the year (or end 2019 maybe)...

    What would you say your best marketing channel is?

  3. 1

    very cool. love the ascii

    1. 1

      /\ \
      ___ \:\ \
      /\\ \:\ \
      /:/ / ___ /::\ \
      /:/
      / /\ /:/\:\\
      /::\ \ \:\/:/ \/
      /
      /:/\:\ \ \:://
      \/
      \:\ \ \:\ \
      \:\\ \:\\
      \// \//

      1. 2

        Damn, that did not work at all!

    1. 1

      Thank you !

  4. 1

    This is amazing! Congrats ๐ŸŽŠ

    What has been your biggest learning getting to 100k ARR?

    1. 2

      Once you've found an acquisition channel that works, double down on it.
      If you think you've done enough, think again :)

      For us it was SEO, so we learned about SEO, watched videos about SEO, read articles about SEO, and only did SEO the first year.

      Last month we thought we might have reached a peak. We thought again and found tons of other traffic opportunities here and there.

  5. 1

    This is amazing! and inspirational. Huge congrats! And keep up the awesome work. ๐Ÿค—

    1. 1

      Thank you!

  6. 1

    Well done! Itโ€™s amazing how you talk of bringing value to roles which shows how much you care about your impact and footprint โœจ

    Youโ€™ve got a great product, letโ€™s hope the next 100K is right round the corner :)

    1. 1

      Thank you very much for the support :).

  7. 1

    Amazing! :) do you still work on the project just you and your co-founder? What you'd be your first hire at this point?

    1. 1

      Thank you!

      Yes, it's only us :)

      At this point, we don't know. It's still early to make our full-time and we would not really need it right now.

      However, we have big plans for the product between now and early 2021 and we might come to a point where we'd need to get some help ๐Ÿ˜‰

      1. 1

        Thanks. How did you define roles and responsibilities with your co-founder? Are u both developers?

        1. 2

          We are both developers.

          At first, we were both doing the same thing. Eventually, and naturally, one of us, Kevin, wanted to learn more about marketing and decided to take the lead on this part.

          I then focused on the tech side and so far, it works great. For the important decision, both technical and regarding marketing, we still talk together about what should be done.

  8. 1

    Goodluck with your goal

    1. 1

      Thank you very much!

  9. 1

    Amazing! Congrats!

  10. 1

    Congratulations Pierre and team! That is a huge achievement ๐Ÿ‘

    1. 1

      Thank you!

  11. 1

    Congratulations Pierre. All the very best on your journey to 200 K ๐Ÿฅณ

    1. 1

      Thank you !

  12. 1

    Nice! That is such a sweet milestone to reach. Many congratulations, and here is to 10x-ing that ARR in the near future! ๐Ÿ™Œ

    1. 1

      Thanks for the support!

  13. 4

    This comment was deleted 3 years ago

    1. 1

      Thanks a lot ๐Ÿ™

August 18, 2020 โฑ Setting up our first attribution model in 1 min

At ScrapingBee we wanted to know what were the marketing channels that brought the most ๐Ÿ’ฐ.

GA makes it very easy to know where do your visitors/users come from.

But when it comes to customers, and their values, it is harder.

Here is our very simple attribution system that takes 1 minute โฑ to integrate

First, store in a cookie UTM tags and referrer.

It's important to set up the domain of the cookie if you use a subdomain for your app. And it's also important to set the expiration date otherwise the cookie would disappear on each session.

Here is the snippet we added on every page of our marketing website.

https://gist.github.com/daolf/e66ec71c603cec4e502190788e75a2f6

Then, on your signup pages, add those 2 things:

hidden fields for the info you want

this snippet that will populate those fields with your cookie ๐Ÿ‘‡

https://gist.github.com/daolf/a93371c414aadc0ce7f77b3098acfa31

Store those in your DB, subscription analytics and that's it!

It's not perfect, but it takes 5 minutes to implement and will help us a lot with understanding what marketing channels are worth focusing on ๐Ÿ“ˆ.

Curious to know how you do it.

8 Comments

  1. 2

    We do a similar thing and we also add those details to our #sales-trailling channel in Slack which is a feed of new user signups.

    The other thing you can do is use the attribution features of Google Analytics. Are you familiar with those? If not, here's a really good post by Devesh Khanal on how to measure for content marketing but totally applicable for other channels too.

    1. 1

      I used to use GA but I found it hard to set up the user -> customer thing and keeping all the UTM tags and all.

      Will take a look at the article.

      Thank you very much!

  2. 1

    Pierre, it's a nice workaround, but not sure what you're trying to "work around".

    1. Adblock has nothing to do with attribution and tracking. it blocks ads, but shouldn't block GA / http requests - and if adblock was actually blocking something, it would block tracking all together - the visit, goal, event and co...
    2. google has an attribution system that allows you to see first, last and other touch points leading to a conversion.
    3. Goals are indeed built for tracking these actions.
    4. Google Analytics lets you track unique users and their journey (see user explorer),
    5. Avoid using UTM tags for internal linking - Doing this reset your "campaign" sessions / last click attribution. Classic error on setting up internal links.
    6. In the audience section, you have access to cohort analysis and other rich data.

    In essence, when you "workaround" the GA attribution system by "hardcoding" some values, you cut off all possibilities to discover what are your true conversion lifters.
    For example, you run a campaign on FB, and retarget on Google Ads.
    the lead came from FB, but the final acquisition is on from Google Ads.
    Or, you bring leads from social media channels, but the actual "activation" comes from your email sequences.

    By forcing the UTM data, you discard "google ads conversion lifter", which might be 90% responsible for closing the "sale".

    Finally, there are more suitable solutions for user/mrr/churn analytics - i.e. mixpanel.

    Hope that helps.

    1. 1

      Hey there and thank you very much!

      You seem to know a lot more about tracking than I do so don't take what I'll take as a challenge, but rather as what I thought happened.

      1. If AdBlocks blocks GA, how does Google know that the same user did landing -> signup page. How can it be shown in GA? I checked and my AdBlock definitely blocks GA requests.

      2. I did not know about this view but I have trouble finding how to leverage it considering it's all anonymized data.

      3. I don't think this is what I do? I just store UTM tags in a cookie, I don't think I'm changing any internal links

      4. I need to learn to use this ๐Ÿ˜Š

      Those tags and attribution are indeed sent to suitable solutions for us, i.e: MixPanel

      1. 1

        Hey there,
        Yeah, tracking is my tradecraft;)
        Correction regarding ad blockers: you are 100% right about ad blockers - many do block GA, which makes a few of my advice irrelevant.
        Yet, in order to get over the blockade, you need to detect and circumvent the adblockers using server side tracking. There are some interesting posts about it (check simoahava.com's blog).

        GA is not meant to be used for PII data. Therefore, no matter what you try to do, you should consider GA as an aggregated dataset, but use other tools like mixpanel & co to analyze specific users.
        GA has a special view for UserID- where you should send your internal userid and tie it to the GA Client ID, so you can "identify" your users. (The same userid you send to mixpanel).

        UTM's - Again, since GA has its own data processing / attribution, if you override it with your own, you actually "pollute" (excuse the term), the GA dataset and lose the GA powerful attribution capabilities.

        RE Mixpanel, why don't you let mixpanel attribution system work on its own?

        last but not least - if your solution does the job and satisfies you, then perhaps you've got another startup idea at your fingertips;)

        Be well!

  3. 1

    don't you think that GA Goals are made to do just that ?

    Just set a goal url like a thank you page after user have signed up and you are done.

    In GA Dashboard you will be able to back track which channels converted more, etc.

    Or i am confused ?

    1. 1

      This is not as simple.

      Your solution would not work for users with AdBlock.

      And because GA does not allow to uniquely track and identify user it would not allow us to track TLV / Churn rate / MRR per channel.

August 6, 2020 Open Report July: 1๏ธโƒฃ0๏ธโƒฃ0๏ธโƒฃ customers edition ๐Ÿคฏ

๐Ÿ’ฐ MRR: $7875 +24%
๐Ÿ’ต: $8290 +5%
๐Ÿค: 18
๐Ÿ˜Š: 103
๐Ÿ’”: 7 (vs 11)
๐Ÿ‘‹: 651 (vs 287) <- Pirate flagHeavily inflated
๐Ÿ”Ž: 24,800 +35% Rocket

Firstly, this month we crossed the 100 customers mark.

When we built our first SAAS, at the top, we only managed to have 6 customers at the same time.

The number was so small that we could name all our customers on the top of our head.

We can't do that now ๐Ÿ˜Š

๐Ÿ“ˆ On the marketing side of things, our content marketing strategy continues to pay off with a 37% MoM increase in organic traffic.

And we have multiplied by 3๏ธโƒฃ our traffic from this channel since the beginning of the year.

We prefer quality over quantity regarding our blog posts.

Hence why we have only posted 2 in July.

One comparing all the free proxy tools available, with a detailed benchmark for each:

https://www.scrapingbee.com/blog/best-free-proxy-list-web-scraping/#benchmark

And another, written by Ari, explaining in detail how to use Scrapy with JavaScript.

A technical subject that could only be written by an experienced developer.

https://www.scrapingbee.com/blog/scrapy-javascript/

The same Ari developed our Scrapy integration, now available on Github Down pointing backhand index
https://github.com/ScrapingBee/scrapy-scrapingbee

We've also tried new things.

Like this tweet:

It was sponsored, cost us $500, and brought us a whopping 1๏ธโƒฃ customer.

So I guess we'll break even in about 18 months ๐Ÿ˜‚.

๐Ÿ‘‹ Regarding signups, we had at least hundreds of spam account looking to take advantage of our free plan.

It is annoying as it's really mess up with all our statistics/reporting but we might have found a solution.

๐Ÿ Regarding the product, we haven't pushed a lot of features.

We're currently not in our most productive phase.

We're trying a lot of new things here and there and probably need to organize ourselves a bit better ๐Ÿค“.

For example, regarding marketing, there are so many opportunities out there that it's hard to keep focus.

We also need to clearly decide what should be the next step for ScrapingBee product-wise and execute ๐Ÿ—

Until next month.

11 Comments

  1. 2

    Great product man, I have tried ScarpingBee and ScraperAPI. The consistency with your endpoints is much better.

    1. 2

      Thank you very much. It means a lot!

  2. 1

    Congrats on the milestone!

    We also have an issue with the "spam signups" - curious to know how you are planning to handle yours

    1. 1

      Thank you, DM on Twitter and I'll let you know. I don't really want to talk about it in the open.
      It's nothing fancy but I hope it works

  3. 1

    Heyyyyyyy congrats on 100! Big milestone ๐Ÿ™Œ

    1. 1

      Thank you very much !

  4. 1

    $500 for a tweet and only 1 customer ๐Ÿ˜ฒ

    When you say there are so many opportunities regarding marketing you mean different channels?

    I'm curious, what else have you tried?

    1. 1

      Ahah yes.

      Actually, since yesterday, it's 2 customers ๐Ÿคทโ€โ™‚๏ธ.

      We have a rather long time to signup -> customer.

      By many opportunities I'm talking about:

      • blog sponsorship
      • newsletter sponsorship
      • Facebook / Google / Twitter ads
      • influencer sponsorship
      • marketing by side-project

      There are many other channels but those are the ones we talked about the most with Kevin.

      We haven't really begun experimenting, hopefully soon :)

      1. 1

        I think I saw retargeting ads from ScrapingBee so that's good. That should with making that Signup to Customer conversion window shorter.

  5. 1

    Congrats Pierre & team. Great post and very inspiring. I checked your app and I think we can use it at our company too. ๐Ÿ‘Œ๐Ÿผ

    PS. I love the โ€œhack the planetโ€ reference

July 24, 2020 ๐Ÿคฏ 100 Customers in over 12 months

It took us more than one year but ScrapingBee has finally reached 100 recurring customers.

1 year ago, I never thought that this would be possible. With our previous project, PricingBot, the best we achieved was 6 customers after nine months.

And now, every day, we have more than 3 people paying monthly to use something we built.

We probably could have reached that milestone sooner, but in February we got rid of the $9 plan for several reasons.

We would like to thank the IH community for being so awesome and supportive since day one.

Now, let's reach 200!

Happy Scraping.

34 Comments

  1. 4

    Nice job Pierre! Could you share the reasons why you got rid of the $9 plan?

    1. 2

      Thank you!

      The main problem was support.

      Those people accounted for 5% of our revenue but 80% of our support ticket.

      Of course, you could tell me "then don't do support with those people".

      But we don't want that:

      • an angry $9 customers can create as much damage to your reputation as a $900 one
      • it did not feel right to not answer support request from people who had a problem

      Ultimately we thought that getting rid of the $9 was the only logical thing to do.

      There is only Kevin and I running ScrapingBee and we have to be careful on how we spend our time an reducing the number of customers we have, while increasing ARPU is a good way to do this.

  2. 2

    Like they say...

    The first 100 customers are almost impossible to get. The next 100 are no sweat.

    1. 5

      Ahah who's saying that? Because I'm definitely still sweating!

      1. 2

        Obviously not me, Iโ€™m at 28 customers right now for BuildFaster.co. I donโ€™t know how Iโ€™ll get to 200 ๐Ÿ˜‚

  3. 1

    Congrats @Daolf, amazing milestone to reach! Upwards and onwards! ๐Ÿš€

    1. 1

      Thank you very much!

  4. 1

    Congrats to getting traction from search engines and forums such as Product Hunt and IH.
    Not sure whether you are open to partnerships, but I'd like to invite you to partner up with our startup conveythis.com We have products that complement our audiences.

  5. 1

    Congratulations

    1. 1

      Thank you !

  6. 1

    Great job! I specially like your one upcoming product, Product API. Signed up to get notified ;)
    I tried to build a product search engine in the past! So I may revive the site with your API, if the pricing is on the cheap side. :)

    1. 1

      Thank you!

      Coming soon ๐Ÿ˜‰.

      1. 1

        Great! looking forward to it :)

  7. 1

    Congratulations,
    More power to Scrapping

    1. 1

      ๐Ÿ๐Ÿ’ช

  8. 1

    Congratulations ๐Ÿพ

    1. 1

      Thank you!

  9. 1

    Congratulations! I've been following your updates, it's great to see things are paying off for you.

    1. 1

      Thank you so much !

  10. 1

    Nice ! Keep going guys !

    1. 1

      Thanks for the support Fabrice :)

    1. 1

      Thank you!

  11. 1

    Hey Pierre good job! What's the reason Scraping Bee is doing so well compared to PricingBot ?

    1. 1

      Thank you Andrea!

      Many things but the main reason is this one.

      With PricingBot we tried to sell a product to an audience we did not know and understand. It was a price monitoring system for e-commerce and we knew nothing about e-commerce.

      But we know a lot about web-scraping and are developers ourselves which mean that:

      • we know how to appeal to our users
      • we know how to reach out to them
      • we can write content that our audience will like and leverage
  12. 1

    Great! Have been following your journey :)
    What channel has helped you the most with customer acquisition?

    1. 1

      Thank you very much!

      SEO and word of mouth mainly.

      We've also been very active on IH for the last 2 years and people started to notice us.

      1. 1

        Yes, have seen a lot of post from ScrapingBee, I believe it was called something different earlier.

        What kind of SEO strategy is working out for you guys? Link Building? Guest Blogging? How many posts do you do per week/month?
        SEO has been our main acquisition channel too for Draftss.com and we are trying to double down on it.

        1. 1

          Ping me on Twitter @pierredewulf or by email: pierre@scrapingbee.com with your questions and I'll let you know what worked for us.

          I can't share everything here ๐Ÿ˜‰

          1. 1

            Perfect ๐Ÿ‘

  13. 1

    Good Job, growing slowly but steadily

    1. 1

      Exactly! Thank you very much.

      1. 1

        if you are interested in working in more projects we can discuss maybe?

        1. 1

          I'm currently very busy but I'm always happy to learn what other people have in mind pierre@scrapingbee.com ๐Ÿ˜‰

July 3, 2020 Open report June: ๐Ÿœ profitability edition ๐Ÿ“ข

1y anniversary ๐ŸŽ‚ and ๐Ÿœ profitability Edition

๐Ÿ’ฐ MRR: $6358 +27%
๐Ÿ’ต Revenue: $7877 +54%
๐Ÿค New Customers: 22 +46%
๐Ÿ˜Ž Customer Count: 94 +12%
๐Ÿ’” Churn: 11 +100%
๐Ÿ‘‹New Trial: 287 +11%
๐Ÿ”Ž Visitors: 18,200 +30%

So, what did we do this month ๐Ÿ‘‡

The huge milestone this month to reach ramen profitability.

Reaching $5k MRR means that we can:

  • pay 2 minimum wages (1200โ‚ฌ)
  • taxes
  • servers/tools etc

And not lose money.

Tbh, since we raised money with TinySee we pay ourselves more (2kโ‚ฌ).

ScrapingBee is also 1 year old this month and seeing it still alive after 12 months is a victory in itself โœŒ๏ธ.

Especially considering that our last SAAS, PricingBot, only lasted 9 months.

This month we got lucky with revenue expansion. 6 big customers increased their usage.

Kevin's SEO efforts are also still paying dividends +30% MoM organic traffic Clapping hands sign.

We published 2 great pieces of content this month written by ๐Ÿ‘ people.

A detailed guide about web scraping in JavaScript, and a detailed guide about web scraping in Ruby.

The later was โœ๏ธ by the talented Sylwia Vargas and was viewed by > 2400 people!

https://www.scrapingbee.com/blog/web-scraping-ruby/.

On the product side, we improved our custom routing algorithm and cut our error rate by half.

We also released a new version of our Google API, cheaper and more reliable.

https://www.scrapingbee.com/api-store/google/

I got used to stumbling across shitty copycat those last few months.

But 2 weeks ago I found one that takes the cake.

Like the others, they copy-pasted copywriting, doc, etc.

But they also took entire paragraphs of our blog posts and even stole our cover image. Funny thing is that this guy is also on IndieHacker and sharing his stolen content with 0 shame.

Our road map for next month is simple:

  • double down on content.
  • improving the speed and success rate of the API

We will also try some new things during the summer.

Kevin and I love to play with new tools and we have several ideas we want to try out

Until next month ๐Ÿ‘‹

15 Comments

  1. 1

    This is so nice. Do you Ming walking through some of the strategies you used mate? Will help many indies like me.

    1. 1

      Thank you,

      I'm currently writing a big blog post about exactly that, will share it soon :)

      1. 1

        That's nice. Looking forward to learning from you mate. :)

  2. 1

    Great work! Love your recap with emoji!

    1. 1

      Thank you!

  3. 1

    That's fantastic - awesome!

    Would love to hear about your content/seo strategy - I'm embarking on that myself. What worked for you? Long format pieces? Video? Something else?

    Nice job!!!

    1. 1

      Do not hesitate to shoot DM me on twitter @PierreDeWulf with your questions.

      This is something I don't really want to share publicly ๐Ÿ˜‰

      1. 1

        Hi Pierre, I shot you a DM!
        Thanks
        Simon

  4. 1

    Technical question , do you manage the proxy servers by your self or you using service ?
    Proxy server to avoid blocking ip from the scraped site
    Thanks

      1. 1

        where can i read about building and manage proxy servers, how did you learn about it ?

  5. 1

    Iโ€™m sorry that you have to deal with the copycats, Pierre, but I admire your journey. Thank you so much for sharing your progress. Congratulations!

    1. 1

      Thank you very much ๐Ÿ˜Š!

  6. 1

    So amazing to see your product growing so much. Good luck in the next weeks, months and years :)

    1. 1

      Thank you Kevin!

June 2, 2020 Open report May: $4937 MRR ๐ŸŽ‰

๐Ÿ”Ž Visitors: 13,900 (+49%)
๐Ÿ‘‹ New Users: 273 (+ 35%)
๐Ÿค New Customers: 15 (+140%)
๐Ÿ’” Churn: 5 (-54%)
๐Ÿ’ฐ MRR: $4937 (+22%)
๐Ÿ’ต Revenue: $5100 (+7%)

What did we do this month?

As we mentioned in previous open reports, we are really focused on SEO.

What this means is that we want to write more quality content on different topics around web scraping / extracting data from the web.

Pierre has a strong Python background, and I have a Java background. The thing is, we wanted to write about web scraping with R, Node.js , Rubyโ€ฆ

So in May, we decided to hire our first freelancers to work on technical content.

We posted a listing on dev.to , asked our friends / Linkedin / Twitter, and we were surprised by the number of emails we received.

๐Ÿค After a few Zoom interviews, we hired three different content writers, and we are really happy about the content they wrote. Time will tell if these blog posts perform well, both in terms of traffic and conversion. Here is an example of a blog post: https://www.scrapingbee.com/blog/web-scraping-r/

The other big milestone this month was the migration of our infrastructure from Heroku to CleverCloud.

Heroku is great and saved us a lot of time in the beginning. But there are some annoying technical limitations, for example, the HTTP requests have a 30 seconds timeout on the Heroku router, and we needed to increase this timeout to at least 60 seconds.

๐Ÿ‡ซ๐Ÿ‡ท CleverCloud is a French company, and itโ€™s like the French Heroku. Their support is great, itโ€™s flexible, and the price is much more competitive than Heroku. The setup is very Heroku-like, Pierre did this alone in a few days ๐Ÿ’ช

In terms of metrics, we made a lot of SEO progress this month, old articles rank better, and new ones are starting to rank too so thatโ€™s great. The sign up also increased significantly, which means that the visitors weโ€™re bringing to the blog are converting.

About the trial-to-paying conversion rate, we were really worried in April because it was really low (~2.4%), this month is more than double this number at (~5.4%).

We donโ€™t really explain these numbers, is it Covid-19 related, did we broke somethingโ€ฆ?

In March 1st we increased our minimum monthly pricing from $9/mo to $29/mo, and we didnโ€™t see any effect on the conversion rate. Itโ€™s possible that the effect was delayed since our average sales cycle is 18 days. ๐Ÿคทโ€โ™‚๏ธ

There will be some exciting things coming in June, new content, new proxy offer, and maybe a new productโ€ฆ ๐Ÿ™ˆ Stay tuned!

2 Comments

  1. 2

    Great numbers. How is the affiliate program going?

    1. 1

      Thanks! We're starting to get some results from the affiliate program, here are the metrics for May: https://twitter.com/SahinKevin/status/1267130352633610245

May 5, 2020 Open report April: We are joining TinySeed ๐ŸŽ‰

Disclaimer: we forgot to publish the March open report. The variation you are seeing below a computed from March.

๐ŸŽ‰ Seed Round: 1
๐Ÿ”Ž Visitors: 9,302 (- 25%)
๐Ÿ‘‹ New Users: 202 (+ 5%)
๐Ÿค New Customers: 5 (-75%)
๐Ÿ’” Churn: 11 (-45%)
๐Ÿ’ฐ MRR: $4038 (-10%)
๐Ÿ’ต Revenue: $4759 (-6%)

First, let's talk about TinySeed ๐ŸŒพ.

We are thrilled to join TinySeed batch 2 and to spend the year with such good company. With ScrapingBee the goal has always been to build a strong, sustainable (understand profitable) mid-size company. This vision does not align very well with traditional VC but it does with those new kinds of funds such as TinySeed.

(If you want to learn more about this new way of doing venture capitalism, you can read this nice article: https://www.entrepreneur.com/article/345866)

I'll probably go deeper about the how, why, and what of that fundraising in a future blog post but basically it all comes down to two things.

๐Ÿ’ฐ First, this fundraising multiplied by 4 our runway. Meaning that we are now managing the company with much more serenity and less stress than 3 months ago. For example this month, we did -10% MRR, I know a few months ago this fact would have taken a big toll on my sleep quality.

Now we can take our time and think mid-term/long-term. The peace of mind that comes with this fundraising is invaluable to us.

๐Ÿ˜ฎ Then there is loneliness. Since we've began our Indie Hacking journey 18 months ago it's been hard to find external help. Sure you can always ask for some advice about very particular topic here and there, IH being a cool place to do that, but with TinySeed this is different as you are now part of a group of people strongly incentivized in your success (investors). Basically we:

  • have access to top-notch mentorship. If we have trouble, a question, we just ask to be put in touch with the relevant mentor and boom, we can have a 30 minutes / 1 hours private mentorship class.
  • are part of a batch of eleven other companies having the same problems as us. Being part of this smaller community is really great. The Slack channel is the perfect place to ask advice, give advice, or just hang around talking about the weather or your weekend plans.

That's is about the TinySeed ๐ŸŒพ, let's now talk about the ๐Ÿ.

Basically everything looks good beside trial to paid conversion rate. This one as completely plummeted in April. The simplest explanation is COVID19 and we know for sure that at least 3 "would be" big customers have not paid because of this.

We'll see in May how things go.

Product-wise March was a "tidy-up" month. The initial version of ScrapingBee has been built in less than 6 weeks and of course, some parts of the product were far from being perfect.

Before going further in the development of the API we felt it was a good time to clean things up a bit, and so we did:

  • refactoring the whole core API
  • tests, tests, tests, and a bit more tests
  • brand new documentation
  • brand new knowledge base
  • request builder in seven languages
  • usage graph
  • new marketing emails flow

We've also decided about our next 4-6 months marketing strategy and it feels good to have a precise vision of what we want to do. This I can't share right now for obvious reasons, but soon enough I will ๐Ÿ˜‰.

Next month we will go back improving and adding features to our products.

And that's it,

Happy Scraping

13 Comments

  1. 1

    Publicly sharing the journey of joining an accelerator is valuable because it gives founders a clearer view of what happens beyond the funding announcement. The interesting part is how the additional capital and network translate into better product decisions, customer acquisition, and sustainable growth. For investors, the strongest signal isn't simply that a company gets funded, but how effectively it converts that support into durable business fundamentals.

  2. 2

    ๐Ÿ˜Š Excited to have you on board at TinySeed!

  3. 1

    Awesome! Keep pushing Pierre

  4. 1

    Congratulations. Do you mind if I video roast your landing page as a good example of a well executed landing page and post it to my twitter @Daolf

    1. 1

      Thank Olly.

      No problem at all, roast it as much as you want ๐Ÿ˜.

      1. 2

        Here's what I thought. It was fun to do something a bit different: https://www.loom.com/share/5ac0d3a1044142f1bf12b93ab3f84ce8

  5. 1

    How good!

    Ate you getting traffic from https://www.colorsandfonts.com?

    1. 1

      We don't because you haven't linked to ScrapingBee.com but to our Marketing Material gist ๐Ÿ˜…

      1. 1

        That's the link I had...

        1. 1

          Sorry about the misunderstanding then, our marketing gist is here to help you write a small paragraph introducing the company to your readers.

          Here is your affiliate link: https://www.scrapingbee.com?fpr=michael-10 :)

  6. 1

    Hey Pierre, great news! Can you explain in a few words the difference between these new small VC funds and the traditional ones?

    1. 1

      Thank you.

      In a few words, traditional VCs make 1000 bets and they expect 1 of them to bring them more than 1000 times their money.

      What it means is that they expect your endgame company to make 9, 10 or 11 figures.

      Those new VCs want sustainable companies, making healthy profits. They don't put pressure on you to grow fast at all costs. To give you a better idea, this is what you can read on the TinySeed.com about page:

      "To venture capitalists, a company doing $10m in annual revenue is a miss. To us, itโ€™s a great business. "

      This is really simply put, you can read more about it here https://tinyseed.com/faq :)

      1. 1

        Got it. Oh cool, Iโ€™ll have a look!

About

My co-founder and I worked on Web Scraping projects for many years, for startups and bigger companies. We realized we always encountered the same problems. We decided to create an API to solve these problems.