Observability
The AI Gateway provides complete visibility into every AI request made from your applications or development tools. Know exactly what data is being sent, track usage patterns, and identify issues before they become problems.The Problem
When using AI providers directly, you have limited visibility:- What code is being sent? You don’t know exactly what context is included
- Are secrets exposed? API keys and passwords might be in the request
- How much are you spending? Token usage is hard to track across tools
- What’s failing? Errors are logged on the provider’s side, not yours
Complete Request Logging
Every request through the AI Gateway is logged with full details:
What’s Logged
| Field | Description |
|---|---|
| Timestamp | When the request was made |
| Request Body | Full content sent to the AI provider |
| Response Body | Complete response received |
| Model | Which AI model was used |
| Tokens | Input, output, and total token counts |
| Latency | Response time in milliseconds |
| User ID | Which user made the request (if provided) |
| Session ID | Session tracking for conversation grouping |
| Status | Success, error, or blocked |
Viewing Logs
Access logs in your dashboard:- Navigate to AI Gateway > Logs
- Use filters to narrow down:
- Date range
- Model
- User ID
- Status (success/error/blocked)
- Contains text

See Your Entire Codebase
When using AI coding assistants, the gateway shows you exactly what’s being sent:
What Gets Sent to AI
AI assistants typically send:- The file you’re editing
- Surrounding context from nearby files
- Open tabs in your editor
- Terminal output
- Error messages
Identifying Sensitive Data
The gateway automatically detects potentially sensitive data:Credentials
- API keys (AWS, GitHub, etc.)
- Database passwords
- OAuth tokens
- Private keys
Personal Data
- Email addresses
- Phone numbers
- Social security numbers
- Credit card numbers
Internal Data
- Internal URLs
- Private IP addresses
- Server names
- Database connection strings
Business Data
- Customer data
- Financial figures
- Proprietary algorithms
- Trade secrets
Download and Analyze
Export Options
Export your data for analysis:- JSON - Full structured data for programmatic analysis
- CSV - Spreadsheet-compatible for reporting
- Filtered exports - Only export what you need
What You Can Discover
Sensitive data exposure
Sensitive data exposure
Search logs for patterns like API keys, passwords, or personal data to find and remediate exposure.
Usage patterns
Usage patterns
Understand which features generate the most AI requests and optimize accordingly.
Cost drivers
Cost drivers
Identify which requests use the most tokens and find opportunities to reduce costs.
Error patterns
Error patterns
Find common failure modes and fix issues before users report them.
Real-Time Monitoring
Live Log Stream
Watch requests in real-time:
- Instant visibility - see requests as they happen
- Error highlighting - failed requests are immediately visible
- Sensitive data alerts - get notified when sensitive patterns are detected
Metrics Dashboard

- Requests per minute/hour/day
- Token usage over time
- Error rate trends
- Latency percentiles
- Cost accumulation
Alerts and Notifications
Set up alerts for important events:Available Alert Types
| Alert | Trigger |
|---|---|
| Sensitive Data Detected | When credentials or PII are found in requests |
| High Error Rate | When error rate exceeds threshold |
| Usage Spike | When request volume suddenly increases |
| Budget Warning | When approaching spending limits |
| Unusual Pattern | When usage deviates from normal |
Configuration
Integration with Your Tools
Windsurf / Cursor Usage
See exactly what your coding assistant sends:- Configure your IDE to use the gateway
- Code normally
- Check dashboard to see what context was included
Application Requests
For your own applications, add context headers:Data Retention
| Plan | Retention |
|---|---|
| Free | 7 days |
| Pro | 30 days |
| Enterprise | 90 days (customizable) |
Export data regularly if you need longer retention. All exports are available for download within the retention period.