I built an AI that has a conversation with people about their AI skills — it reveals stuff that quizzes never will.
First off - I have deep expertise in this area (I've written books, given professional trainings and worked in the industry so know the nuances well) I also worked as a PM and as UX, and managed dev teams.
I kept seeing the same problem from both sides. Companies saying "we need AI-ready people" with no way to measure it. Candidates listing "ChatGPT" on their CV like it means something.
Multiple-choice tests are theatre. Self-assessments are fiction. What actually tells you how someone uses AI? Watching them talk about it — in depth, unprompted, for 30 minutes.
So I built Aisa.to
She's a conversational AI that has a genuine, peer-level chat with someone about how they work with AI. No quiz format. No scripted questions. She adapts to what you say, probes deeper on interesting threads, runs little exercises mid-conversation, and moves on when you're tapped out on a topic.
We went through 80 ITERATIONS! and it's still not perfect. Honesly, giving the prompt and see Claude code spit out code is impressive but that's the easy bit - everyone can do it. The real differentiator is being a good PM - talk to users, do research, think critically about features and user journeys, jobs to be done and overall create a product for which there is a demand. The early signs I'm seeing are encouraging.
Behind the scenes we have some sophisticated systems that track the fatigue level of candidates as well as judge when to give them challenges.
The candidate gets a full report: composite score, dimension breakdown, one of 10 persona types (from "Bystander" to "Architect"), personalised coaching, and a learning plan.
The biggest finding: people are terrible at estimating their own AI skills. The ones who say "I'm basically an expert" often score 35/100 — they use ChatGPT daily but accept every output at face value. The quiet ones who say "I'm still learning" sometimes score 75+ because they've built real workflows with verification steps and multi-tool pipelines.
Quizzes can't catch this. You need a conversation.
Give it a go https://aisa.to
I happen to know a couple of individuals who use AI in their work and would probably be willing to answer any questions you have about their self-assessment of skills. If you want, I can pass along some questions for them to answer.
I'm more focused on getting this product perfected first. I'm confident IF it's highly useful, it will inevitably become profitable. So try it out, see your AI profile and give me any feedback you think that can be useful at [email protected]