the hardest part of building an AI assessment isn't the AI
been building aisa.to for a while now — its a conversational AI that assesses peoples AI skills through dialogue instead of quizzes.
the AI part (scoring, calibration, persona classification) was honestly the easier problem to solve. the thing that took way longer than expected? defining what "good" actually means.
like, what does it mean to be good at using AI? is it about prompting? output verification? knowing which tool to use when? integrating AI into your workflow vs just using it occasionally?
ended up with 11 criteria across 5 dimensions and 10 distinct user personas. sounds clean on paper but getting there was messy — lots of conversations where someone scored high on prompting but couldnt tell when the AI was making stuff up. or someone whod never heard of prompt engineering but had this incredibly efficient workflow.
the biggest surprise: self-reported skill barely correlates with observed skill. ppl who say theyre 8/10 routinely demonstrate 4/10 practices. and some who say "i barely use AI" turn out to have really thoughtful verification habits.
anyone else building assessment or evaluation tools? curious whether you hit the same "defining the rubric is harder than building the product" problem.
This is a strong insight because the real product is not “AI skill testing.” It is judgment measurement.
Most people can claim they know how to use AI, but the valuable part is observing whether they can verify outputs, choose the right tool, understand failure modes, and actually integrate AI into real work. That makes the rubric the product, not just the conversation layer.
I’d be careful with the name before this gets positioned more widely. aisa.to is short, but it feels a little unclear for something that could become a serious AI capability assessment platform for teams, hiring, training, or internal upskilling.
For this category, the name needs to feel more credible than a quiz tool or AI experiment. Beryxa .com would fit that direction better because it sounds like a serious assessment and intelligence platform, while still leaving room if the product expands beyond individual skill checks into team benchmarking, role-fit analysis, or workforce AI readiness.
The product is already touching trust, scoring, calibration, and professional credibility. The brand should help carry that seriousness instead of making the homepage do all the work.