SmartGrade

Multiple choice test grading app

Visit Website
October 19, 2019 Launched on Producthunt

https://www.producthunt.com/posts/smartgrade

Recent weeks have been a little slow, with just a handful of purchasing users. On the other hand, I am happy with the few feedbacks I've been getting, so I decided to go for it and submit it to ProductHunt.

Wish me luck!

1 Comment

  1. 2

    This comment was deleted 6 years ago

    1. 1

      Thanks @shiva_prabhakaran! 💪

July 6, 2019 Failed at a little marketing stunt

Following up on the update from last weekend, one Instagram teacher/influencer agreed on doing a sponsored post with a tiny demo of SmartGrade. We agreed on a few bullet points for her Instagram stories, and she delivered yesterday [0].

Some stats:

  • Number of followers on her Instagram account: 28.8k
  • Number of new followers on the @smartgrade Instagram account: 8
  • Number of visits to smartgrade.net: 50

Even though it's an interesting learning, the numbers are much lower than what I had in mind.

Some hypotheses I have:

  • No interest for the app on this channel (maybe at all)
  • The video feels too staged. I think coming up with a set of bullet points made the too mechanical and not very relatable
  • There were many unrelated stories on her account before and after the demo, which might have discouraged people to watch it through
  • Teachers are on summer vacations, and rightfully thinking about other things (I know I would!)

[0] https://www.instagram.com/stories/highlights/18063335044099545/

11 Comments

  1. 2

    Interesting. I wonder if this sorta thing is better as testimonial content on your own site. Can you take that video and repost on your homepage?

    For instagram, what ad content have you seen that seemed good? I suspect it's really simple stuff that connects the your brand to the celebs identity. Like "Quick note, I really like what smartgrade is doing. Gonna be trying it out in the next couple weeks. Check it out here: "

    1. 1

      Yes, I agree with both points. I think these sort of demos (~1 minute) might be too long for instagram. It could work as a highlight, so people visiting your profile, who are already interested, can dig a little deeper via these videos.

      I really wanted to do something to bring people to the website in the first place. I put a longer tutorial one other teacher did on the website, but I think it's too long (~5 min), so I may swap for this one. Good idea!

  2. 1

    SmartGrade is free, and everyone knows that free software is crap (sarcasm).

    But honestly, you're saving people hours of time. How much is each hour worth? Let's just say $40/hour, and you're saving 10 hours a month. Why note charge $100 dollars a month, subscription!?

    Sure, 99/100 teachers won't sign up because it's "expensive." Don't worry, sign up the ones who understand value of time and make them successful. If they can hack the system, they will passionately tell their friends and get you more users.

    1. 1

      I've heard "charge more" from many many smart people (even on IH podcast), and I couldn't agree more. Still it's tragic how easy it is to think that it doesn't apply to me (yet).
      I do think that's the way to go, but right now I'm having trouble with the previous step of getting those 100 teachers to know that the app exists. My initial idea was to make it free, grow a little user base and charge for premium features / number of scans, but even that is not too easy. I am getting convinced that charging from the start might actually bring value. Like you said, charging may even increase the perceived value of it.

    2. 1

      p.s. I would imagine teachers might like this app, but be extremely skeptical of whether it would work 100% of the time. If they mess up, it's on them.

      How can you convince them this app works 100% of the time?

      1. 1

        That's a very good point. Whenever there's image processing + user input (in this case, analog user input on the answer sheet) involved, there's always the concern with accuracy. I have thought about that a lot and put these two mechanisms in place:

        • Bechmarking. I manually generated a large-ish set of photos I develop the algorithm against. Many of these are pathological (they use light pencil marks, sheets are bent, dirty, lots of weird shadows). I currently get 99.7% of questions correctly recognized, which is not optimal but regular use should be better - if users don't "hold it wrong". I received a nice feedback about this and added the instructions on the answer sheet itself (use black/blue pen, fill the bubbles completely)
        • Visual inspection. After every scan, users are redirected to a visual inspection screen, where they can see which questions were recognized and hit "looks good" or "scan again". It usually takes only a couple of seconds to see when something went wrong. I think this is an advantage over the specialized scanning machine, that blindly scans batches of answer sheets

        Of course users don't care about technical details like benchmarking and the challenge is how to communicate that the app is reliable. This is one of the reasons I wanted to get a few teachers to do a demo of the app - showing how you can do a visual inspection and make sure everything looks good.

        1. 1

          99.7% is almost certainly better accuracy than teachers doing it manually, they just don't know they are making mistakes. What you could offer is for them to use the app for free for x-many scans, and to scan through their old answer sheets, to confirm the machine works, and maybe even works better than themselves.

          I think if you pair your app with Scanbox, and make it run continuously, you could enable teachers to grade 100 papers in 2-3 minutes. How cool would that be?

          https://www.kickstarter.com/projects/limemouse/scanbox-turn-your-smartphone-into-a-portable-scann

  3. 1

    Dont focus on the number of followers on her account.

    1. look at her past posts, see how engaged she is and her followers. Are there lots of likes? Are there lots of comments from her followers?
    2. Ask her to send you screenshot of her Insights --> Feed Posts (so you can see how many impressions each of her post typically gets).
    3. Ask her to send you screenshot of her Insights --> Activity and look at the Interactions and Discovery Stats.

    Follower Accounts can be bought so an "influencer" can inflate their follower count... some followers only follow someone because of a follow me-i'll follow you scheme. Bots and these kind of followers are useless.

    1. 1

      Thanks Owel. I didn't think about the insights screenshot idea. I'll ping her about it, although I might have missed the train, since the stories is more than 24 hours old. I'll add that to the list of things to do better next time.

  4. 1

    I like the concept..and thought that ..while you didnt get the results you may have wanted....
    you learned from your marketing test run .

    It's marketing..dont take it personal..the features are hot...it has all the stuff i would have built I to it as if I had made the app myself .

    SmartGrade
    👩‍🏫 Grade multiple choice tests in seconds
    📱 Scan answer sheets with your phone
    📊 Get immediate feedback and statistics
    smartgrade.net

    So here are somethings I would do .

    • Create a special version of the app..where you can send it to your target demographics..but they can not share the FREE version to another phone .
    1. Research and create a worldwide marketing plan ...BASED on quality of school system rankings IN THE TOP 10 COUNTRIES ...Locate 100 teacher emails - send out app for free - to teachers in those cuntries..say 20 free app downloads to each contry .

    2 . Locate best school districts in those countries - find the teacher of the year for the past 5 years - send those teachers your app for FREE .

    1. Then start again..This time worst schools .

    Here is the reasoning behind this....Whats the 1st thing you learn in school...?

    To share

    Teachers are overworked and underpaid ...EVEN in good schools...many take work home..

    Find teachers OF NOTE in every country and give away the app a few times -
    these teachers become your brand ambassadors !

    1. 1

      Hi Edward, thanks for the kind words. I don't take it personally at all - it's very valuable learning.
      It's getting clear to me how important it is having key people onboard. I really like the idea of approaching some teachers individually like you suggest. It's something I will keep doing for sure. I haven't given much thought about making a paid version right off the bet, but I'm thinking making it free for ambassadors might be an interesting approach. Thanks!

June 30, 2019 Learning online marketing the hard way

Over the last month, I have been focusing almost exclusively on generating content and reaching out to users for feedback and marketing. Here are some lessons and stats:

Emails
======

I have been manually writing emails to teachers with an online presence on Instagram ranging from 1k-30k followers. On the emails, I have been very direct: "This is who I am, this is what the app does and the reason I am reaching out to you to ask if you would be open to discussing a sponsored post about it".

  • Emails sent: 32
  • Email responses: 7
  • Positive responses: 3 (1 out of my budget, 2 negotiating)
  • Negative responses: 4 (3 don't use multiple choice tests, 1 uses a competitor)

Some of the responses are very professional and oddly similar - they send back a "media kit" with values for posts/stories/blog post, so far all in the same style, with the same fonts and colors even. Makes me think some teachers are following a "recipe" for becoming a teacher influencer, which I thought was very interesting on its own.

Instagram DMs
=============

I initially sent DMs for teachers asking for feedback and answers to a Google Form I put together with questions like:

  • What grade to you teach?
  • Do you use multiple choice tests?
  • Do you use any apps?
  • Does this screen with exam statistics make sense?
  • Want updates?

I only received 7 responses and they are mostly positive. Here's a public link to the raw data: https://docs.google.com/spreadsheets/d/1207oTjRANfYdNRlFgWxiXIm72jK8nViNq8FFDtIlHig

Then I switched gears and started asking about the possibility of a sponsored post:

  • DMs sent: 44
  • DMs responses: ~10

Out of the responses, two interesting things happened:

  • @busy.science.teacher did a instagram post and a video on her stories for free. Afterwards, I commissioned a longer video tutorial from her, which is now live at https://smartgrade.net (https://vimeo.com/342587643). It turned out a little longer than I expected (even after editing), so for the next one I will keep it much shorter, around 1-2 minutes. I also really appreciate the fact that she has been mentioning @smartgrade in a few related posts and directing people to me for questions;

  • @yourclassroomhelper did a couple of posts and stories, and even a 10-minutes demo of the app (https://www.youtube.com/watch?v=o2FRbyA8keE). It was really nice because it was completely organic - I didn't suggest anything like it. She did because she liked the app and thought it was valuable for her audience, which I thought was amazing. In the tutorial, she also compares with the biggest competitor (ZipGrade) and I was happy to hear that, even though SmartGrade has fewer features, it's more pleasurable to use. The moment I heard it I thought about the "build half a product, not a half-assed product" maxim and how important the distinction is. I also got incredibly rich feedback both from the video and from her messages, some of which I have already implemented in the app.

Medium
======

Wrote a total of 5 short blog posts of various formats to test the waters. So far, very few views (28 over the last 30 days), with virtually no traffic to the website.

Seasonal effects
================

Teachers calendars are very seasonal/cyclical. Right now, because of the summer break, the interest in multiple choice tests is as low as it gets, as shown on Google Trends for Scantron (a test scanning machine) and ZipGrade (biggest competitor):
https://trends.google.com/trends/explore?date=today 5-y&geo=US&q=scantron,zipgrade
Going forward, I think it makes sense to coordinate the biggest marketing efforts with these peaks of interest. For now, I will keep generating content and partnerships to have a better online presence when the next peak happens.

Ads
===

I experimented with both Google Ads and promoting Instagram posts. I made a trial run targeting middle/high school science teachers in the US. I didn't spend more than $50 overall. It's clear that I will have to invest more effort into optimizing the campaigns if I choose to go that route, because the naïve approach was not effective at all.

Comment

May 25, 2019 Started engaging with teachers on social media

In an effort to go where the users are, I set up an Instagram account (https://instagram.com/smartgrade) with photos and videos of the app in action. I started following and interacting with as many teachers as I could. To my surprise, many were open to answering some of my questions and a few were even excited about sharing the app on their feed! This was the first time strangers downloaded the app, which was very exciting. Around 15-20 people installed on each platform.

Comment

May 23, 2019 Wrote the first blog post

After listening to one of the indie hacker's Podcast episodes, I decided to learn a little bit about content marketing and I ended up setting up a Medium account (https://medium.com/@smartgrade) and writing a little about technology and education.

5 Comments

  1. 1

    What do you think of medium.com? I've been researching it and while it's great to get that exposure you don't get on your own blog, there might be some cons too. For example, I read that major content publishers are leaving medium because of pressure to put their content behind paywalls among other things.
    I don't write often, but would like to do so more consistently and hope medium remains a sustainable platform.

    1. 1

      I share the same concerns, specially after the whole hackernoon episode (https://hackernoon.com/about-removing-medium-from-hackernoon-com-7c72353ba6e).
      In the spirit of trying things quickly, I decided to test the waters with Medium because it was super quick to set up something that looks good, so I could focus on the content. One other reason is I wanted to explore interacting with potential users there, since there are lots of people writing about education/edtech on the platform. If the blog actually starts driving traffic and the network effect isn't that relevant, I think I will be more comfortable with hosting the blog myself in the future.

  2. 1

    Well done! Not always easy to sit down and bang out a blog post.

    1. 1

      Thanks @csallen. Staring at an empty page is not easy, but I also recalled another advice I got from the podcast: editing is a lot easier than writing, so just write whatever comes to mind and edit later. That helped a lot getting the first few paragraphs out.

      1. 1

        Yes, this helps me a lot too!

May 14, 2019 Launched on AppStore

iOS app got accepted and published on AppStore.

Comment

May 12, 2019 Launched on Google Play

Published version 1.0.0 on Google Play.

Comment

April 3, 2019 Initial commit

After tinkering with the concept for a long time and doing a (very!) quick market/competitor analysis, on this date I wrote the first line of code for SmartGrade. It was the initial image processing code that was eventually going to support both the iOS and Android apps.

Comment

About

SmartGrade grading multiple choice tests using your smartphone's camera. It also generates actionable analytics for those tests, as well as for each individual student.