On-Device AI Assistant
I am working on a open-source SLM agentic framework to inference and auto-tune models locally, this is geared to towards on-device use-case , it supports things like MCPs , document processing, skills and also with the openAI compatible API taht anyone can use to build their own AI productivity app.
The data remains in your device , initially M1 macs are supported but more platform support is on its way.
Two versions of the product:
TUI (Terminal User Interface) : For more power user
Desktop app - For rest of us
It's written ground up and geared towards much personal assistant type use cases and rest of us, supports conversations, attachment, and complex documents processing.
Just added it to GitHub, therefore feedback , love and contribution would be deeply valued.
Please try it out for free:
#slm #AI #auto-tune #agents
