A few months ago while I was working with ChatGPT I experienced how it can sometimes fail to give the correct result from simple mathematical operations. I got intrigued to explore how many times it would mistake a result and started digging deeper into the topic.
If you search the internet you find many posts like this:
OP: why is AI so bad at math?
Random commenter 1: you are doing everything wrong, LLMs are not made for math and don't make computations, they just give you the most probable result.
Random commenter 2: don't do math inside LLMs, do this and then proceeds listing 2-3 workarounds
These alternative strategies are valid but often come with higher token usage and lead to time lost and an overcomplicated workflow. Not to mention that all users know how to run Python/Excel/WolframAlpha. Plus, LLMs get the right answers most of the time, the problem is to be able to intervene when the error appears, before the disaster happens.
For me not trusting LLMs with computations was not the answer. So, I decided I am going to try and create a seamless tool that can verify LLMs’ equations, as slick as possible, that you can turn on in the background and forget about. At least until better LLMs come along.
And that is why I created pheebo, a Chrome extension that allows you to fully exploit the power of AI for your work tasks or everyday problems. There are modes:
Selection mode: click&drag to draw a frame around the formula you want to verify and pheebo computes the correct result instantaneously.
Automatic mode: pheebo works in the background, scanning the page you are working on, highlighting the errors and providing the correct answer.
pheebo computes the result to computer accuracy, so you don't have to worry about missing mathematical errors anymore. Right now pheebo is an extension that you can download on the Chrome store. However, I am working to bring the pheebo functionality also on the mobile.
To activate pheebo you need to create your account on the website. Afterwards, enjoy 7-days free trial.
I am looking forward to hearing your comments. Try it for free and let me know what you think. I want to know if pheebo is useful and if it can solve a daily struggle for users. Looking forward to any input!
Looks useful. I’m also wondering how it handles more complex expressions. Nice work.
@markgen_ Thanks for this. So about the more complex expressions: we parse the text looking for formulas and mathematical expressions, then we clean it using pattern-matching highlighting mathematical computations. That's how we find the valid and suitable expressions we want to check. Then the Python backend is able to check the result also for more complex expressions.
For someone non-technical like me, pheebo is a tool that simplifies my life and I am surprised how much it helped me initially. I jumped on board to work on the product as I myself have stumbled on many errors calculating with ChatGPT and of course was too lazy to use a calculator instead. pheebo made much sense as a product in the AI-driven world we live in and I showed it to my dad who also uses it now. Hope we can develop it even more with @ggange and I hope that people find it useful as it was made to simplify life and to assist where you don't feel like taking out your calculator. Let us know what you think: comment, email, DM...we are here to hear you and to try and make it better :)
😒