Home
Starting Up
Case Studies DB
Products
Ideas DB
Vibe Coding Tools
Subscribe to IH+
Starting Up
Case Studies
Ideas DB
Products DB
Sign in
Join
1
Like
4
Comments
How much do you trust AI agents with internal systems?
by
Nick van Dort
I’m curious what the biggest blocker is for people actually building with agents.
Auditability, for me — but slightly upstream of just logging what was checked. The agents I've ended up trusting are the ones that state their own confidence level explicitly (this is settled vs. this is still provisional) rather than reporting every result the same flat way. A good log still matters, but it only helps once you know which outputs were worth auditing in the first place.
Yeah, this. A log that treats everything the same isn't that useful if you can't tell "I'm pretty sure" from "I actually checked this."
The confidence bit has to come first — otherwise you're auditing noise.
Auditability, and it tends to get picked last. An agent that fails loudly is a nuisance you fix in an afternoon. One that reports success while having done nothing is the expensive kind, and you only catch it if the log records what was actually checked rather than what the agent believed it checked.
Totally. A loud failure is annoying but at least you know. The scary one is "looks fine" while nothing actually ran.
Logs need to show what was executed, not what the agent thought it did.