New Feature Announcement: LLM Monitoring
We are excited to announce the release of a new LLM (Large Language Model) dashboard, which offers detailed visibility into your users' interactions with LLM chat agents, such as ChatGPT. You can find this new report under Dashboards > All Dashboards > LLM.
This dashboard is designed to help you monitor and understand how your team utilizes AI/LLM tools by allowing you to:
View key details, including the direction of the interaction (user's input/prompt vs. AI agent's response), chat title, the specific LLM model used, the full message content, and any attached files uploaded by the user.
Access the full context of any conversation by right-clicking on a row and selecting the View LLM Conversation option.
Enabling LLM Monitoring:
To begin tracking, enable LLM monitoring from Configurations > Monitoring Profiles and specify the LLM applications you wish to track.
Current Limitations:
Only ChatGPT Web is currently supported for tracking.
The system tracks only uploaded files at this time; file downloads are not captured.
Some data points, such as audio input or prompts embedded within images, are not captured.
Updated Overview Dashboard for All Customers
We’ve updated the Overview dashboard to make the Live Montage widget available to all customers, including those migrated from the Teramind Legacy platform. This ensures everyone benefits from the latest monitoring capabilities that were previously exclusive to new accounts.
New Create Widget Button
We’ve added a Create Widget button to all built-in dashboards. Clicking the button opens the AI Generated Widget panel, where you can test the generator and preview results. Note that you cannot save the widget on a built-in dashboard; if you try to save it, you will be guided to clone the dashboard where you can add new widgets.
