Teaching the AI Agent to handle images

This article explains how you can teach the AI Agent how to respond when it receives images from users.

The AI Agent can recognize when a user sends an image, including the file name or attachment title. However, the Agent cannot see what is in the image or interpret its content.

To ensure the AI Agent responds appropriately to images, you can add specific instructions in the Domain Knowledge on how the Agent should handle them.

Adding an instruction in the domain knowledge

You can decide how the AI Agent should respond when someone sends an image. To do this, include a clear instruction in the Domain Knowledge.

Example instruction

If someone sends you an image, let them know that, as an AI Agent, you cannot view or interpret it, and therefore cannot respond to it in detail.

Tips for writing the instruction

  • Use clear and simple language
  • Explicitly mention that the AI Agent cannot see image content
  • Encourage the user to describe the image