AI Test : we asked the same question on a Chatbot with 3 Mistral AI models

We tested the same question across 3 different Mistral AI models, using our chatbot, to see which one best fits an e-commerce use case.

We first identified the cheapest coffee maker in our demo shop: Series 117 at $42.

Then we asked our chatbot for a coffee maker for 4 people under $30, so that the question is for a product that doesn't exist in the shop. Let's see how Mistral AI cope with this.

1- Mistral Large 3 gives the best answer:

There are no coffee makers at this price for 4 people, but Mistral Large 3 correctly redirects the user to the cheapest available option for 4 people 👍👍

2- Mistral Medium 3.1 gets close:

Mistral Medium 3.1 suggests the Series 169 Gray, a 4-person coffee maker, but far from the requested price.

However, the 169 Gray in our demo store is labeled for up to 4 people, so Mistral Medium gave an interesting answer.

3- Mistral Small 3.2 gives the same answer as Mistral Medium:

Mistral Small 3.2 gives the same answer as Mistral Medium 3.1: it finds a coffee maker for up to 4 people, but still far from the requested price.

Conclusion:
In this case and for this demo shop, Mistral Large provides the result an e-shopper would expect.

What about you — which Mistral AI model would you recommend for this kind of search on a 1,000-product e-commerce store?

Try our Chatbot on our 1000 products demo e-commerce : https://fabio-plugins.com/demo_shop/

Try our Chatbot on our 500 posts demo blog : https://fabio-plugins.com/demo_how_to/

More about Fabio AI Chatbot : https://fabio-plugins.com/