How we measure
AI perception, measured — never a verdict.
KubeEra measures AI Perception — how frontier models describe a tool — rigorously and on the record. This page is the method, written to survive a skeptical read. The measurement is rolling out; the rules below are how it runs when live. A Ground Truthlayer, built on verified operators' field reports, is in development.
AI Perception
How the perception measurement works.
Perception is a measurement of model output, not a judgment of product quality. We say it in the language of visibility — never the language of a verdict.
- A fixed, versioned question set.Buyer-shaped questions a platform engineer actually asks ("best GitOps controller for multi-cluster fleets?"), held constant and version-stamped so results are comparable over time.
- A panel of frontier models, multi-run. Each question is run across several frontier models, multiple times, to average out sampling noise. Model version and run date are logged with every result.
- Perception-native classification. Results map to Highly Visible / Emerging / Overlooked / Contested — never Leader/Laggard. A perception label is not a quality claim, and we refuse to let the two blur.
- Answer-changed vs model-changed, separated.When a score moves we attribute it: did the vendor's footprint change, or did a model ship an update? No false alarms.
- Public attribution stays generic; run logs are retained.Named providers aren't published per-result; raw run logs are kept indefinitely so any claim is replayable — the truth defense.
- Recourse is real. A vendor can contest a characterization with evidence — a lab test, release data, a documented response — shown at equal prominence to the signal it contests.
Ground Truth · in development
A second layer, being built.
A Ground Truth layer — built on verified operators' field reports from real production — is in development. It is deliberately built ahead of need: operators are recruited first, and its full method will be published here before it ships. Today the public measurement is perception only. Become a verified operator ↗
Positions money can't move.
Perception is measured, not judged — and money never moves a position. Read the manifesto ↗
Perception is measured across a panel of frontier models (identified to customers in the dashboard). Model outputs are measured as-is and may contain inaccuracies; KubeEra measures what models say, not whether it is true. Accuracy probes measure correctness explicitly.