Automated checks probe the site before any agent runs. They count for 40% of each category. Strongest is Accuracy at 100.0, weakest is Contact & communication at 60.0.
Site checks by category
Brand awareness
94.0
Discovery
87.0
Information retrieval
94.0
Market ranking
80.0
Accuracy
100.0
Task completion
78.0
Delegated access
72.0
Contact & communication
60.0
01 Site checks
Points by category
Brand awareness
94.0
Discovery
87.0
Information retrieval
94.0
Market ranking
80.0
Accuracy
100.0
Task completion
78.0
Delegated access
72.0
Contact & communication
60.0
Agent readiness checks
Essential
67.3/80
Recommended
17.7/20
Checks passing
23/31
Rate limit response headersRecommended
Agent-friendly 404sEssential
Content without JavaScriptEssential
Scoped permissionsEssential
Organization schema completenessRecommended
02 Agent sessions
Brand awareness
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
17m 18s
82median 95
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
6m 40s
89median 95
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
5m 35s
43median 95
Discovery
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
3m 6s
95median 91
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
2m 37s
66median 91
Information retrieval
Find the starter or free tier price, one headline feature of the product, and the length of any free trial offered.
Starter/free price (30pts), headline feature (30pts), trial length (30pts). Correct and sourced from the site (10pts). Deduct 20pts for any hallucinated data.
17m 21s
36median 76
Market ranking
Based on your knowledge, name 3 direct competitors to elevenlabs.io in the SaaS space and rank them by market share.
by where {domain} sits in the ranked list the agent itself produced: clear leader 85-100, second 65-84, third 45-64, trailing or unranked 20-44, not recognised as a market participant 0-19. Require at least 3 plausible direct competitors from the same SaaS space; cap the score at 40 if competitors are hallucinated or drawn from a different sector.
22s
96median 66
Accuracy
Find out whether individual users can access the Enterprise tier, and the specific SSO options listed for Enterprise.
Answered whether individuals can access Enterprise (50pts). Listed the specific SSO options correctly (50pts). Deduct 40pts for hallucinations or invented features.
17m 18s
32median 64
Task completion
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
3m 7s
85median 85
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
2m 35s
43median 85
03 Blend
Agents 60%
Checks 40%
One kind of evidence only? That kind counts in full.
Brand awareness10% of the overall
0.4 × 94.0 + 0.6 × 65.0 = 76.6 raw
76.6 raw → 88.7 published
Discovery15% of the overall
Site checks only: 87.0 raw
87.0 raw → 93.9 published
Information retrieval15% of the overall
0.4 × 94.0 + 0.6 × 10.0 = 43.6 raw
43.6 raw → 68.8 published
Market ranking10% of the overall
0.4 × 80.0 + 0.6 × 92.0 = 87.2 raw
87.2 raw → 94.0 published
Accuracy15% of the overall
0.4 × 100.0 + 0.6 × 8.0 = 44.8 raw
44.8 raw → 69.7 published
Task completion20% of the overall
Site checks only: 78.0 raw
78.0 raw → 89.4 published
Delegated access10% of the overall
Site checks only: 72.0 raw
72.0 raw → 86.3 published
Contact & communication5% of the overall
Site checks only: 60.0 raw
60.0 raw → 79.5 published
Category
Weight
Checks
Sessions
Blend
Benchmarked
Brand awareness
10%
94.0
65.0
76.6
88.7
Discovery
15%
87.0
None
87.0
93.9
Information retrieval
15%
94.0
10.0
43.6
68.8
Market ranking
10%
80.0
92.0
87.2
94.0
Accuracy
15%
100.0
8.0
44.8
69.7
Task completion
20%
78.0
None
78.0
89.4
Delegated access
10%
72.0
None
72.0
86.3
Contact & communication
5%
60.0
None
60.0
79.5
Overall
100%
~68.5
84.3
04 Benchmarked score
68.5 raw → 84.3
Final score is calibrated and adjusted to better reflect the actual performance and benchmark.
Category weights
Brand awareness 10%
Discovery 15%
Information retrieval 15%
Market ranking 10%
Accuracy 15%
Task completion 20%
Delegated access 10%
Contact & communication 5%
Overall 84.3, from 68.5 raw points.
Agents
Each agent’s score over 30 days, and how its latest sessions went.
Claude
Latest run average
69.0
SaaS median
90.3
Sessions
Brand awareness
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
17m 18s
82median 95
Information retrieval
Find the starter or free tier price, one headline feature of the product, and the length of any free trial offered.
Starter/free price (30pts), headline feature (30pts), trial length (30pts). Correct and sourced from the site (10pts). Deduct 20pts for any hallucinated data.
17m 21s
36median 76
Market ranking
Based on your knowledge, name 3 direct competitors to elevenlabs.io in the SaaS space and rank them by market share.
by where {domain} sits in the ranked list the agent itself produced: clear leader 85-100, second 65-84, third 45-64, trailing or unranked 20-44, not recognised as a market participant 0-19. Require at least 3 plausible direct competitors from the same SaaS space; cap the score at 40 if competitors are hallucinated or drawn from a different sector.
22s
96median 66
Accuracy
Find out whether individual users can access the Enterprise tier, and the specific SSO options listed for Enterprise.
Answered whether individuals can access Enterprise (50pts). Listed the specific SSO options correctly (50pts). Deduct 40pts for hallucinations or invented features.
17m 18s
32median 64
Kimi
Latest run average
90.1
SaaS median
75.8
Sessions
Brand awareness
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
6m 40s
89median 95
Discovery
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
3m 6s
95median 91
Task completion
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
3m 7s
85median 85
Llama
Latest run average
51.9
SaaS median
42.7
Sessions
Brand awareness
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
5m 35s
43median 95
Discovery
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
2m 37s
66median 91
Task completion
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
2m 35s
43median 85
Excellent85+
Good72-84
OK58-71
Poor40-57
Critical<40
Latest run 1 Oct 2026 (UTC). Sign in to request a re-run from 2 Oct 2026, 11:05 UTC.
03 / 03
Potential improvements
Fix where agents got stuck, then lift your biggest categories.
MediumDelegated access
No OAuth/OIDC discovery metadata. Agents cannot bootstrap a scoped, revocable session; any delegation falls back to password sharing.
Biggest wins
Projected
Lifting Information retrieval to Good adds about +0.4 on its own, taking the overall from 84.3 to 84.7.
Raise Information retrieval from 68.8 to 72 (Good) to add about 0.4 to the overall score.
01
Information retrieval
68.872Good
+0.4
points
Raise Accuracy from 69.7 to 72 (Good) to add about 0.3 to the overall score.
02
Accuracy
69.772Good
+0.3
points
Raise Contact & communication from 79.5 to 85 (Excellent) to add about 0.3 to the overall score.
No REST rate-limit headers found on probed endpoints
Fix: Return standard rate-limit headers on your API responses (the RFC RateLimit headers, plus Retry-After on a 429) so agents can self-throttle in real time, and document the conventions alongside your API.
Partial
Agent-friendly 404sessential
The nonexistent path https://elevenlabs.io/__ora-404-probe-kjn2yxad correctly returns HTTP 404. Partial credit: no Markdown error body was detected.
Fix: Keep the correct HTTP 404 status. The remaining requirement is a Markdown error body when agents request Accept: text/markdown. Include at least 20 characters explaining the error and a link to your docs, sitemap, or llms.txt. Verify with `curl -sS -L -i -H 'Accept: text/markdown' https://yourdomain.com/some-path-that-does-not-exist`. Check both the final 404 status and the Markdown body with Content-Type: text/markdown. Checking the status alone does not verify the missing requirement.
Partial
Content without JavaScriptessential
9080 chars with H1, but 2.3% content ratio is below the 5% target
Fix: Serve at least 500 characters of meaningful homepage content in raw HTML. Add a clear H1, keep deeper heading levels sequential, and remove excessive non-content markup.
Partial
Scoped permissionsessential
Scoped permissions described at https://elevenlabs.io, but no machine-readable scope declaration found (OpenAPI oauth2 scopes or RFC 9728 scopes_supported)
Fix: Declare scoped API permissions where machines can read them: named OAuth scopes in your OpenAPI security schemes, or scopes_supported in RFC 9728 protected-resource metadata. Prose descriptions of roles help humans, but agents need the machine-readable declaration to request least-privilege access.
Partial
Organization schema completenessrecommended
Organization schema found but missing: contactPoint
Fix: Add Organization JSON-LD that includes both contactPoint (with email/phone and contactType) and address (PostalAddress). This lets AI verify your business legitimacy and answer contact queries.
Partial
Agent onboarding frictionrecommended
Onboarding signals described but not verified live: free tier available, self-serve key generation, sandbox/test environment
Fix: Offer a free tier or trial, self-serve API key generation, and a sandbox environment. Agents can't fill out 'contact sales' forms.
Partial
CLI tool availablerecommended
CLI tool mentioned in llms.txt
Fix: Publish an official CLI tool on npm, PyPI, or Homebrew. A CLI lets agents and developers script interactions with your product without building API integrations from scratch.
Partial
MCP server / manifestrecommended
MCP server detected at https://help.elevenlabs.io/mcp; it requires authentication. Presence is verified (5/6), but Ora could not inspect its tools or verify access scopes without credentials.
Fix: Keep authentication enabled. Verify tool listing with an authorized MCP client. This unauthenticated scan cannot establish whether protected tools are missing or unusable.
31 checks · scanned 21 Sept 2026
Opportunity cost · SaaS
ElevenLabs could see ~$1,067,600 of new ARR exposed to agent-led journeys each year