1
2 Comments

I tried to build an AI that "understands" pedagogy. It was harder than I thought.

I’m Amir. I’ve spent the last few months building Edulavo, an AI platform that generates personalized learning roadmaps.

I wanted to share a technical struggle I faced, hoping for some feedback from other AI builders here.

The Challenge: "Hallucinated" Curriculums

When I first started with the MERN stack + LLMs, the AI would generate courses that looked good but made no sense. It would suggest learning "Advanced React Patterns" before "JavaScript Basics." It was just guessing keywords.

How I (mostly) fixed it:

Instead of one giant prompt, I broke the architecture into a pipeline:

  1. The Assessor Agent: A dedicated prompt that only scores the user's chat answers (0-100 skill scale).

  2. The Architect Agent: Takes that score and builds a JSON tree of modules (no content yet, just structure).

  3. The Curator Agent: Only then searches our database/YouTube API to fill those modules with real content.

Separating the "Structure" from the "Content" reduced hallucinations by about 80%.

But... I need your eyes on it.

I’m still tweaking the "Curator Agent." Sometimes it pulls a video that is 5 years old. I’ve opened up a Free Plan where you can generate 2 full courses.

Could you try to generate a roadmap for a skill you already know? I want to know: Does the AI actually get the progression right, or is it still guessing?

Be as harsh as you want. I’m here to fix it.

https://www.edulavo.com/

posted toAvatar for product Edulavo
Edulavo
  1. 1

    Really interesting breakdown, Amir. The multi-agent pipeline you designed makes a lot of sense — separating assessment, structure, and content is exactly what reduces hallucinations in educational AI. The roadmap progression definitely feels more accurate now compared to the early “keyword soup” most builders run into.

    The Curator Agent pulling older videos is a common issue. Maybe add a recency filter or give priority to channels with active posting? I tried generating a roadmap for a skill I already know, and the structure looked solid, so you’re definitely on the right track.

    1. 1

      Thanks! That separation of structure vs. content was definitely the 'aha' moment for reducing hallucinations.

      I fully agree on the recency filter. We are currently trying to figure out how to weigh 'upload date' against 'like/dislike ratio' so we don't accidentally filter out great foundational lectures.

      Out of curiosity, which skill did you generate the roadmap for? I’d love to check the logs and see how the agent handled it.

  2. 1

    This comment was deleted 9 months ago