Why do answers differ between the Interactive tester and the live environment?

In this article, we explain why the answers generated by the AI Agent in the Interactive tester and the live environment may differ and how to address these differences.

It’s possible for answers in the Interactive tester and the live environment (via the chat widget, WhatsApp, Facebook, or Instagram) to vary. Several factors can cause this. Below, we outline why this happens and what you can do about it.


The AI Agent generates answers based on current knowledge

Every time a question is asked, the AI Agent generates an answer based on the most recent knowledge stored in it. This applies to both the Interactive Tester and the live environment. However, some factors can affect the consistency of answers:

  • Conflicting knowledge: If conflicting information is present in the AI Agent, it may result in different answers. For example, discrepancies between information retrieved through the Web Crawler and instructions added manually in the Instructions section can cause inconsistencies.
  • Incomplete knowledge: Missing information can prevent the AI Agent from providing a consistent response.
  • Insufficiently specific instructions: If instructions in the AI Agent are not clear enough, this can lead to variation in the answers provided.

To minimize these differences, ensure that the AI Agent's knowledge and instructions are clear and complete.


Cookies and cache in the browser

When using the chat widget to interact with the AI Agent, the browser stores cookies and cache. These stored files can affect how recent updates to the AI Agentare displayed. If you’ve made changes to the AI Agent's settings and then test further in the chat widget, it’s possible you may see older answers because the browser hasn’t refreshed its stored data.

Solution:

Clear your browser’s cache before continuing to test. This ensures the latest version of the AI Agent is loaded. You can find a step-by-step guide on how to clear your cache in this Help Center article.


Still experiencing issues?

If you’re unable to determine why the answers remain inconsistent after following the above steps, feel free to send your examples to our support team at support@watermelon.ai. We’ll be happy to assist you!