
ELI
Your AI, Your Machine, Your Data – Zero Cloud, Zero Telemetr
My last update was about why I started building ELI.
This one is about what happened when I started actually hammering on it and finding the things that were wrong.
And there were quite a few.
Over the last few weeks, I've probably learned more from fixing broken things than I would have from adding another 50 capabilities.
The main thing I've been trying to do is make ELI tell the truth.
Not just give an answer that sounds right.
If it says it did something, I want the software underneath to have actually done it.
ELI was remembering things it shouldn't
I found a pretty nasty memory bug where ELI could basically remember things that ELI itself had said, rather than things the user had actually told it.
So if ELI hallucinated something, that statement could end up getting stored as knowledge, come back later, and then ELI would treat its own bullshit as a fact.
Not ideal.
That's fixed now. I've also cleaned the bad memories out of the existing database.
New conversations were sometimes carrying old conversations with them
Another one was just stupid.
I'd start a new conversation and ELI could pull in turns from the previous one.
The model wasn't necessarily doing anything wrong. I was giving it the wrong context in the first place.
That's been fixed so normal conversation history is properly scoped to the current session, while deliberate long-term memory can still cross sessions.
ELI sometimes thought normal conversation was a coding task
I was having a completely normal conversation with it and it saw a capitalised word, decided it looked like a code identifier, searched through a bunch of files and started dumping code into the conversation.
That was a fun one.
I've tightened up the detection so it doesn't decide that every capitalised word is a programming symbol.
Tool calling has also been getting stricter
I've added grammar-constrained tool calling so the model can't just make up a capability that doesn't exist.
Then, naturally, I found 11 actual capabilities that existed in the code but weren't properly exposed through the catalogue.
So those got fixed too.
This is becoming one of the bigger things I'm trying to get right with ELI:
If ELI says it can do something, I want to know that the action actually exists, that it can reach it, that it executes, and that the result is real.
I also had to correct one of my own claims
I used to call the action system a "No-Fake-Actions guarantee."
I've changed that.
That's too absolute.
I can't honestly promise that an LLM-based system will never get something wrong.
What I can say is that ELI is built not to fake an action.
There are guards around the action system, constrained tool calls, verification, and a lot of effort going into making it fail honestly instead of confidently saying "done" when nothing actually happened.
I'd rather ELI say:
"I couldn't do that."
than:
"Done."
when it didn't actually do anything.
Real hardware has been finding problems too
Bluetooth reported the wrong adapter.
The microphone could look dead when the speakers were drowning it out.
Media playback could report success because the player process existed, even though the actual stream hadn't opened.
The self-updater could say it upgraded ELI without actually replacing the installed build.
All of those have been fixed or tightened up.
None of this is particularly exciting to put in a feature list.
But this is the stuff that matters when you give an AI actual access to your computer.
And then there's all the boring stuff
I've spent a stupid amount of time fixing documentation that had drifted away from what the software actually did.
Release assets and capability counts needed correcting.
The licence needed to be consistently included with the different builds.
I removed some of the old voice presets that were imitating characters from other people's IP.
I've also added tooling to check v2 against v3 because the two have separate histories and it was getting too easy for something to exist in one and quietly disappear from the other.
None of that makes for a very exciting demo.
But ELI is getting to the point where I'm less interested in how many things it can do and more interested in whether the things it says it can do actually work.
And honestly, that's probably the biggest change I've made recently.
The next problem is a much harder one.
Does anyone actually want this?
Not:
"Is this cool?"
Not:
"Is local AI interesting?"
I want to know whether people would actually use ELI regularly.
What would they use it for?
What would they keep coming back to?
What would they completely ignore?
Would the privacy/local aspect actually matter enough to put up with the setup?
And eventually:
Would anyone actually pay for it?
I don't know yet.
That's what I want to find out.
So if you've looked at ELI and think I'm building the wrong thing, I'd genuinely rather hear that than another "looks awesome."
If something is over-engineered, stupid, unreliable, badly designed, or just doesn't make sense, tell me.
I'd rather find that out now.
The Short Version
ELI exists because the people who most need an AI assistant are exactly the ones cloud AI serves worst.
People who can't justify another monthly subscription
People who live with bad internet or none
People who don't want their conversations sitting on a stranger's machine
People who work with sensitive material they'd never paste into someone else's website
People who just want to own their tools
The Longer Version
I Came at This from Physics and Engineering
I didn't come at this from computer science. I came at this from physics and engineering. I learned most of it the hard way, in the wrong order, on my own. A year of working on it nearly every day.
I built ELI because I looked at the AI landscape and saw a problem:
Every "AI assistant" is a tenant arrangement. Your data lives on their machines, under their terms, subject to their pricing, their outages, their policy changes, and their ability to read it.
ChatGPT, Claude, Gemini, Copilot — they're all thin apps talking to someone else's datacenter. You don't own the assistant. You rent it. And if the company disappears, changes the price, or reads your conversations, you have no recourse.
I wanted to build something different. Something that actually belongs to you.
The Technical Reason
I Wanted an AI That Never Fakes an Action
Most AI assistants are fundamentally dishonest. They "say" they did something, but they actually just generated text that sounds plausible. If you ask a cloud assistant to open an app or send an email, it might say "Done!" but it never actually did anything.
ELI is different. If ELI says it did something, it really did—and if it couldn't, it says so plainly instead of bluffing. This is built into the software, not just good manners. It's the "No-Fake-Actions" guarantee, and it's enforced in code.
I Wanted an AI That Actually Runs Locally
Most "local" AI assistants still phone home. They claim to be private, but somewhere in the fine print, they're sending your data to a server.
ELI is offline by default, enforced at the socket. When networking is off, a process-wide guard fail-closes at the socket. Even if some component tried to phone home, it physically can't.
I Wanted an AI That Can Actually Do Things
Most AIs are just text boxes. You type, they reply. That's it.
ELI has a body, not just a mouth. It opens apps, plays music, controls windows, takes screenshots, sees images and your live screen, reads text out of pictures, and can even click where your eyes are looking via webcam gaze tracking.
I Wanted an AI That Improves Itself
Most AIs are static. They never get better.
ELI logs its own failures. It can write, syntax-check, import-test, apply, and automatically roll back patches to its own code. It can fine-tune its own model on your conversations via LoRA.
The Philosophical Reason
ELI Is Ownership, Not Tenancy
"It runs with the internet cable pulled out. It keeps working if the company that inspired it vanishes. It costs nothing to run beyond your own electricity. It answers only to the person at the keyboard."
ELI is a statement about privacy, sovereignty, and self-determination.
ELI Is for People Who Can't Trust Cloud AI
For anyone who works on sensitive material—research, inventions, personal life, anything you would not paste into a stranger's website—cloud AI is not an option. It's a non-starter.
ELI is for those people.
ELI Is a Challenge to the Cloud AI Model
Most companies want you to believe that AI must run in the cloud. That it's too big, too complex, too expensive to run locally.
ELI is proof that they're wrong. 152,000 lines of Python. 209 capabilities. 15 agents. 12-stage pipeline. 4-layer memory. Self-healing. Vision. Voice. Gaze. All running on hardware you already own.
2 Likes
9 Comments
9 Comments
-
1
You nailed it Aryan. AI will be inherintly embeddedd our future (for the most part), and who wants a conglomarate/company, running and using your data for their own benefit? Eli is soveirgnty and privacy focused (also version 2 will forever be source-available), v3 is in the making and will be a once off charge, no subscriptions, no data scraping. That is what AI should be used for. I wouldn't rent a hammer to build a house, i would buy it
-
1
What stood out to me is that you're making an argument about ownership more than AI itself.
That gives people a different reason to care. Features can change over time, but a product built around a clear belief tends to stay recognizable even as it evolves.
-
1
You nailed it, Aryan. That's exactly the philosophy behind Eli.
AI is inevitably becoming part of everyday life, but ownership matters more than features. I'd rather own the tool I rely on than rent access to it while a company profits from my data.
That's why Eli is privacy-first and sovereignty-focused. Version 2 will always be source-available, and Version 3 will be a one-time purchase—no subscriptions, no data harvesting.
I wouldn't rent a hammer to build a house. I'd buy it, and make sure it is mine alone!
Thank you for the feedback, i really appreciate it! Here is the Github page for the project if you ant to check it out ( i cannot post links yet as this is a new page) by going to the github main page, and up in the search bar t the top right, paste; ShadowESC95/ELI_v2.0, and it will pop up!
-
1
I appreciate you taking the time to explain your thinking.
I'd be interested in continuing the conversation by email if you're open to it. What's the best email to reach you on?
-
1
Thank you for the interest Aryan! You can go to the GH page and open an issue in which i can respond there. In regards to the email, I cannot post my email here for some reason (new account i would imagine) but if you go to the github page, my email, issues section and details are all on there
-
2
Thanks! I’ve just sent it over.
Looking forward to hearing your thoughts whenever you have a chance.
-
1
Hi Aryan, I haven't received an email as of yet. Did you find my address?
-
1
Hey Jason — I found jaybridgeman0095@gmail.com listed on your GitHub. I sent you an email from hello@beryxa.com, and I also sent you a follow-up 4 days ago. Could you check your inbox/spam and reply to the latest note I sent there?
-
1
My apologies for the delay Aryan, sent over reply to you just this moment.
-
-
-
-
-
-
-
About
Everything runs on your machine: the model, data, all of it. No cloud, no account, no telemetry. Offline isn't a setting you toggle, with networking off, a process-wide guard fail-closes at the socket. Local home server


Comment