Dashboard

View a dashboard with information about activities on your account

Our application features two types of dashboards: the Main Dashboard and the Activity Dashboard. These dashboards provide users with comprehensive insights into their service usage and activities.

Main Dashboard

Displays quick usage statistics for the past 24 hours on the primary dashboard page. The data is segregated by service, allowing users to view statistics for each specific service individually.

Location

Found on the primary dashboard page

Features

LLM as a Service

The dashboard displays four key graphs:

  1. Prompt Usage: Total prompt tokens used across all models (hourly bars)

  2. Completion Usage: Total completion tokens used across all models (hourly bars)

  3. API Requests: Total REST requests across all models (hourly bars)

  4. Cost Tracker: API usage cost for all models combined (5-minute interval bars)

Activity Dashboard

Provides detailed insights into user activities for each individual service, filtered by month (default: current month, up to 12 months of historical data available).

Location

  • Accessible within the Services, appears as a side menu "Activity".

Features

LLM as a Service

The dashboard includes four main components:

  1. Prompt Usage: Daily prompt token usage across all models

  2. Completion Usage: Daily completion token usage across all models

  3. API Requests: Daily REST requests across all models

Bars represent daily usage, with colors distinguishing between models.

  1. Activity Log: Tabular view of all activities across all models, grouped hourly. Includes timestamps, requests, prompt usage, completion usage and average time for comprehensive usage tracking and analysis.

One Click Deploy

The activity dashboard appears in each instance, displaying individual instance activity logs. The dashboard comprises three main components:

  1. Token Usage: Visualizes daily token consumption for this model instance. Each bar represents daily usage, with distinct colors differentiating between prompt and completion token usage.

  2. API Requests: Illustrates daily REST requests made to this model.

  3. Activity Log: Tabular view of all activities happen in this model instance, grouped hourly. Includes timestamps, requests, prompt usage, completion usage and average time for comprehensive usage tracking and analysis.

You can download your activity log as a CSV file. This log is organized hourly and separated by model. To access this feature, simply click the "Download CSV" button in the top of Activity Dashboard page.

Last updated