Inspired by this post, I would love ๐ any brutal honesty you're willing to give.
Why wouldn't you try Meeshkan? Do you want a human on testing? Is it unclear how much value you'd receive? Do you have policies against installing GitHub apps? Is it too corporate looking?
i don't use github. i use gitlab.
I wouldn't try it because I don't understand how it helps me. I'm worried that running this would create a huge pile of issues that would be hard to resolve because it sounds like they might not even really be part of my codebase. I'm worried it would create too much noise: a backlog of a whole pile of things that ought to be fixed but that no one has time for because there are more urgent things to handle.
(None of this might be valid but it's my honest reaction.)
Two items of specific feedback:
With all that said, this looks like a cool product and the landing page design is really nice, good job!
Good eye with those details! Thank you for the walkthrough of your thoughts.
Hi Makenna, here is my feedback.
I think adding a video showing how it works will make a lot of sense. The description is vague and the comparison with traditional testing makes me feel like too much is being promised. There is certainly room for improvement there. Maybe you can also describe who the product is for.
All the best and I hope this helps.
It definitely helps me get a more whole picture, thank you for your perspective!
I like the idea, I'm guilty of having production code that's been deployed for years without (any) tests. Having this background, here is my thought process when I visited the landing page:
Some tips that could help:
I hope this helps!
Thank you for the feedback, and the tips ๐
Hi Makenna,
You asked for brutal so you're getting brutal ;-)
My gut feeling was that I don't like it, and I needed a few seconds to understand why.
Then I remembered the old discussion that code coverage doesn't mean anything. I can write 100% code coverage that would barely catch basic bugs.
My feeling from reading your LP is that you'll create automated tests that are not worth anything, i.e. I'll get boilerplate tests that are worthless for my product and just bloat my testing suite.
I would love to see more proof on your LP that says that these are quality tests and not just quantity.
Hope this helps,
Jonathan
Super valuable feedback, thank you! For brutal honesty, you went easy on me haha.
re. code coverage - I totally concur that coverage alone is virtually useless. Would something along the lines of "coverage of potential crash cases" resonate better with you? The topic I'm trying to dig into is that unit+integration+e2e tests don't cover variables that external dependencies (such as your DB or Stripe API) introduce into the codebase.
re. proof - you would like to see like an example bug that could be found or more like a case study of what bugs we've found in other projects?
What your saying is nice, but I'd give you the feedback that I feel you're describing your solution and not "me" - your customer.
I'm actually writing a blog post about this now :)
I feel that you should find quotes from your customers (even if future customers) and use their words.
If you'd like, I'm doing free consults for members of the community - book me and let's chat about it - https://calendly.com/jonathanoron
Yes, Alpha means it's not working yet.
Thank you for taking the time :)
So "alpha" puts you off, as well?
Yes.
Basically Alpha means it's not ready at all, it's just a proof of concept almost. Probably really buggy.
Beta would be closer to working. Still has bugs.
A first release is supposed to be working and then I'd be willing to try something. First release has most bugs sorted out and enough functionality to be useful.
That's how I see my own process of software development as well.
"PRIVATE ALPHA" puts me off.
If it works just launch it.
Thanks for the feedback mate!
Follow up question with context -
We're still building out core features, and a lot of things aren't automated for users yet. We decided to try a private alpha to "hand-hold" early adopters to make sure we were building the right things. What approach would you take to this (if any) contrary to the alpha route?
Then it isn't at MVP stage.
I wouldn't focus on LP. Go talk to customers with the problem.
Thanks again for your perspective โ