Skip to main content

AI Audit

The AI Audit widget helps you track AI usage across multiple dimensions, enabling more effective monitoring and troubleshooting.

AI Audit dashboard widget

Enabling permissions​

To enable permissions for the AI Audit widget:

  1. Click .
  2. Under Additional Permissions, select Audit Dashboard Permission.
  3. Ensure the role is applied to the users you want to have access to the AI Audit widget.

Configuring the AI Audit widget​

To configure the AI Audit widget:

  1. Create or open a shared or one-off dashboard that includes an AI Audit Dashboard Widget.

    tip

    Brightspot recommends adding an additional dashboard tab for the AI Audit widget so that you can view it more easily.

  2. Click Save.

Using the AI Audit widget​

To use the AI Audit widget:

  1. Navigate to your dashboard and locate the widget.
  2. Use the following filters to find assets:
    • All Completion Types — View assets based on completion type (Complete, Error, Stop).
    • Any Guard — View assets by the reason they are flagged (Sensitive Information, Harmful Content, Denied Topic).
    • All Time — Filter for assets based on when they were submitted.
  3. View the individual asset line items. Each contains the following column headers:
    • ID — The ID of the audit record.
    • User — The user who initiated the request to the model.
    • Timestamp — The time when the audit record was created (when the request was initiated).
    • Guard(s) — The flags applied to the given asset.
    • Completion Type — The completion status of the given asset.
    • Model ID — The name of the AI model used for this asset.
    • Response Time — How long the AI model took to respond to the submitted prompt for this asset.
    • Token Count — The total number of tokens used for both the request and the response.
  4. (Optional) Click an asset's ID to explore the AI Audit Metadata pop-up, which shows read-only information about the AI interaction. This information includes more granular details about the asset than the widget's overview, such as the specific request made to the model and its response, the content that was referenced for the response, and any guards.

Exporting data from the AI Audit widget​

To export data from the AI Audit widget:

  1. Navigate to your dashboard and locate the widget.
  2. In the top-right corner, click Export CSV.