Dashboard

​

Overview

The Untrace Dashboard provides a powerful web interface for monitoring your LLM traces, configuring routing rules, analyzing performance metrics, and managing your observability integrations. Access it at https://app.untrace.dev.

​

Getting Started

​

Accessing the Dashboard

1. Navigate to https://app.untrace.dev
2. Sign in with your Untrace account
3. You’ll land on the overview page showing your LLM trace activity

​

Dashboard Layout

The dashboard is organized into several key sections:

• Navigation Sidebar: Quick access to all dashboard features
• Main Content Area: Displays your selected view (traces, analytics, settings, etc.)
• Activity Feed: Real-time trace activity stream
• Status Bar: Connection status and platform health indicators

​

Real-time Monitoring

​

Live Trace Feed

Monitor LLM traces as they flow through Untrace:

​

Filtering and Search

Filter the trace feed to focus on what matters:

// Example filters
{
  model: "gpt-4",
  provider: "openai",
  status: "success",
  costRange: { min: 0.01, max: 0.10 },
  timeRange: "last-hour"
}

Available filter options:

• Model: Filter by specific models (GPT-4, Claude-3, etc.)
• Provider: OpenAI, Anthropic, Google, etc.
• Status: Success, Failed, Rate Limited
• Cost Range: Filter by token cost
• Latency: Response time thresholds
• Destinations: Filter by routing destinations
• Time Range: Last hour, 24 hours, 7 days, custom range
• Tags: Custom tags and metadata

​

Routing Configuration

​

Creating Routing Rules

Configure how traces are routed to different platforms:

​

Routing Examples

Common routing patterns:

​

Analytics

​

Overview Metrics

View key metrics at a glance:

• Total Traces: Daily, weekly, monthly counts
• Token Usage: Total tokens processed
• Total Cost: Aggregate costs across all models
• Average Latency: P50, P95, P99 response times
• Error Rate: Failed requests and error types
• Model Distribution: Usage by model type

​

Cost Analysis

Deep dive into your LLM costs:

​

Performance Metrics

Monitor LLM performance:

• Latency Distribution: Response time histograms
• Token/Second: Throughput metrics
• Queue Depth: Pending requests
• Error Analysis: Error types and frequencies
• Rate Limit Tracking: Provider limit utilization

​

Custom Reports

Generate custom analytics reports:

1. Select metrics to include
2. Choose aggregation period
3. Apply filters
4. Export as CSV or PDF
5. Schedule automated reports

​

Integrations

​

Managing Platform Connections

Configure connections to observability platforms:

​

Platform-Specific Settings

Configure platform-specific features:

​

LangSmith

• Project mapping
• Environment tags
• Custom metadata fields
• Feedback integration

​

Langfuse

• Session tracking
• User identification
• Score mappings
• Public link generation

​

Keywords.ai

• Cost tracking settings
• Alert thresholds
• Custom dashboards
• API quota management

​

Custom Webhooks

• Payload transformation
• Authentication headers
• Retry configuration
• Response validation

​

Team Management

​

Access Control

Manage team access and permissions:

​

API Keys

Manage API keys for different environments:

# Production key with full access
UNTRACE_API_KEY=utr_prod_xxx

# Development key with limited access
UNTRACE_API_KEY=utr_dev_xxx

# CI/CD key for automated testing
UNTRACE_API_KEY=utr_ci_xxx

​

Advanced Features

​

Trace Sampling

Configure intelligent sampling to reduce costs:

// Sampling configuration
{
  "default_sample_rate": 0.1,  // 10% default
  "rules": [
    {
      "condition": "model == 'gpt-4'",
      "sample_rate": 0.05  // 5% for expensive models
    },
    {
      "condition": "error == true",
      "sample_rate": 1.0  // 100% for errors
    },
    {
      "condition": "cost > 0.50",
      "sample_rate": 1.0  // 100% for high-cost requests
    }
  ]
}

​

PII Detection

Configure privacy protection:

• Automatic Detection: Identify potential PII
• Redaction Rules: Define what to redact
• Allowlist: Specify safe patterns
• Audit Trail: Track redaction events

​

Alerting

Set up alerts for important events:

​

Troubleshooting

​

Common Issues

​

Debug Mode

Enable debug mode for detailed diagnostics:

1. Go to Settings → Advanced
2. Toggle Debug Mode
3. View detailed trace logs
4. Export diagnostic bundle

​

API Access

Access dashboard functionality programmatically:

# Get trace history
curl -X GET https://api.untrace.dev/v1/traces \
  -H "Authorization: Bearer YOUR_API_KEY"

# Get analytics data
curl -X GET https://api.untrace.dev/v1/analytics \
  -H "Authorization: Bearer YOUR_API_KEY"

# Update routing rules
curl -X PUT https://api.untrace.dev/v1/routing/rules \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -d @routing-rules.json

See the API Reference for complete documentation.

​

Next Steps