Dashboard

View a dashboard with information about activities on your account

Our application features the Activity Dashboard. These dashboards provide users with comprehensive insights into their service usage and activities.

Activity Dashboard

Activity Dashboard

Provides detailed insights into user activities for each individual service, filtered by month (default: current month, up to 12 months of historical data available).

Location

• Accessible within the Services, appears as a side menu "Activity".

Features

LLM as a Service

The dashboard includes four main components:

1. Prompt Usage: Daily prompt token usage across all models

2. Completion Usage: Daily completion token usage across all models

3. API Requests: Daily REST requests across all models

Bars represent daily usage, with colors distinguishing between models.

1. Activity Log: Tabular view of all activities across all models, grouped hourly. Includes timestamps, requests, prompt usage, completion usage and average time for comprehensive usage tracking and analysis.

One Click Deploy

The activity dashboard appears in each instance, displaying individual instance activity logs. The dashboard comprises three main components:

1. Token Usage: Visualizes daily token consumption for this model instance. Each bar represents daily usage, with distinct colors differentiating between prompt and completion token usage.

2. API Requests: Illustrates daily REST requests made to this model.

3. Activity Log: Tabular view of all activities happen in this model instance, grouped hourly. Includes timestamps, requests, prompt usage, completion usage and average time for comprehensive usage tracking and analysis.

You can download your activity log as a CSV file. This log is organized hourly and separated by model. To access this feature, simply click the "Download CSV" button in the top of Activity Dashboard page.

Serverless GPU

The activity dashboard appears in each projects in 2 pages: overview and activity, displaying individual project activity logs. The dashboard comprises four main components:

1. Cost: visualize total cost and daily cost separated by type: on-demand, spot, and storage.

2. Tasks Usage: visualize total usage and daily usage separated by trigger type: manual, function, server, and spot.

3. Endpoint Requests: shows hourly endpoint requests for last 24 hours.

4. Spot task: shows active spot tasks