Monitoring

The monitoring tab on the left side menu allows you to observe your chatbot's metrics in real-time, providing an up-to-date overview of its performance and activities. This feature allows you to quickly identify any emerging issues within your LLM as they arise.

Monitoring Dashboard

The Monitoring Dashboard is the initial screen you encounter when you click on the Monitoring tab. Here, you can choose your chatbot and specify the time interval you wish to review.

On the left side, you'll find the criticality levels of potential issues identified by Fireraven metrics. These issues are visually represented over time in the graph on the right. You can filter the issues found by criticality by clicking on them on the left.

Below the graph, there is a detailed view of the detected metrics. By clicking on any of these metrics, you will be directed to the Message Explorer for further analysis.

You can also go to the Message Explorer directly with the button on the top right of the Monitoring Dashboard.

Message Explorer

The Message Explorer allows you to review messages identified as having potential issues with either the input or output.

When you select a message, you will be able to see all the metrics related to the message, and the issues detected. You can also see what were the input and output messages that lead to those results.