AIStupidLevel.info
The most comprehensive AI model benchmarking and indexing platform. Continuously track AI "stupidity levels" with 7-axis scoring, access training data from 20+ models, and optimize with Smart Rotator API routing.
Models Tracked
50+
Scoring Axes
7
Update Frequency
Real-time
Smart Rotator
Active
Platform Features
Everything you need to evaluate and optimize AI models.
7-Axis Scoring
Comprehensive evaluation across accuracy, speed, cost, reliability, and more.
Cost Tracking
Real-time cost analysis per model and provider. Optimize your AI spend.
Latency Monitoring
Track response times and performance metrics across all models.
Drift Detection
Monitor model performance degradation over time with automated alerts.
Smart Rotator
Universal API key that intelligently routes requests to optimal models.
Live Dashboard
Real-time analytics and insights into your AI infrastructure.
7-Axis Scoring System
Comprehensive evaluation across all critical dimensions.
- 1Accuracy & Quality
- 2Response Latency
- 3Cost per Token
- 4Reliability & Uptime
- 5Context Window
- 6Rate Limits
- 7Feature Support
Smart Rotator API
One universal API key that intelligently routes your requests to the optimal AI model based on your requirements, budget, and performance needs. Automatic failover, load balancing, and cost optimization.
- ✓Automatic model selection based on task type
- ✓Cost optimization with budget constraints
- ✓Automatic failover and retry logic
AI Benchmark Data for Training Models
Power your AI development with the most comprehensive real-world performance dataset available
Continuous AI Indexing & Search
We run automated benchmarks hourly against 20+ AI models, creating the world's most comprehensive searchable database of AI behavior, failures, and performance patterns. Perfect for training next-generation models.
AI Search Engine Indexer
Searchable index of tens of thousands of AI responses, edge cases, and failure modes
Stupidity Level Benchmarking
Continuous measurement of AI model weaknesses and "stupid" responses for training datasets
Enterprise Licensing
Flexible licensing options from research access to full enterprise deployment
What's Included
- ✓Raw LLM outputs before code extraction and parsing
- ✓Failure pattern analysis with detailed taxonomies
- ✓API version tracking and regression detection
- ✓Safety & adversarial testing with jailbreak attempts
- ✓Per-test-case results with execution timing
- ✓Historical performance data across all models
Data Scale
Models Tracked
20+
Test Runs
Tens of thousands
Frequency
Hourly (24/7)
Coverage
7-axis scoring
Start optimizing your AI infrastructure
Get access to comprehensive benchmarks and Smart Rotator API.