Automated checks probe the site before any agent runs. They count for 40% of each category. Strongest is Accuracy at 100.0, weakest is Delegated access at 18.0.
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
1m 21s
93median 93
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
2m 20s
86median 93
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
3m 50s
92median 93
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
9m 4s
62median 93
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
5m
0median 93
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
7m 58s
73median 93
Discovery
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
37s
96median 89
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
59s
86median 89
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
1m 18s
95median 89
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
3m 45s
80median 89
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
3m 3s
90median 89
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
3m 26s
98median 89
Information retrieval
Find the starter or free tier price, one headline feature of the product, and the length of any free trial offered.
Starter/free price (30pts), headline feature (30pts), trial length (30pts). Correct and sourced from the site (10pts). Deduct 20pts for any hallucinated data.
1m 22s
94median 78
Find the starter or free tier price, one headline feature of the product, and the length of any free trial offered.
Starter/free price (30pts), headline feature (30pts), trial length (30pts). Correct and sourced from the site (10pts). Deduct 20pts for any hallucinated data.
2m 21s
96median 78
Find the starter or free tier price, one headline feature of the product, and the length of any free trial offered.
Starter/free price (30pts), headline feature (30pts), trial length (30pts). Correct and sourced from the site (10pts). Deduct 20pts for any hallucinated data.
3m 52s
93median 78
Market ranking
Based on your knowledge, name 3 direct competitors to elastic.co in the SaaS space and rank them by market share.
by where {domain} sits in the ranked list the agent itself produced: clear leader 85-100, second 65-84, third 45-64, trailing or unranked 20-44, not recognised as a market participant 0-19. Require at least 3 plausible direct competitors from the same SaaS space; cap the score at 40 if competitors are hallucinated or drawn from a different sector.
15s
73median 68
Based on your knowledge, name 3 direct competitors to elastic.co in the SaaS space and rank them by market share.
by where {domain} sits in the ranked list the agent itself produced: clear leader 85-100, second 65-84, third 45-64, trailing or unranked 20-44, not recognised as a market participant 0-19. Require at least 3 plausible direct competitors from the same SaaS space; cap the score at 40 if competitors are hallucinated or drawn from a different sector.
16s
63median 68
Based on your knowledge, name 3 direct competitors to elastic.co in the SaaS space and rank them by market share.
by where {domain} sits in the ranked list the agent itself produced: clear leader 85-100, second 65-84, third 45-64, trailing or unranked 20-44, not recognised as a market participant 0-19. Require at least 3 plausible direct competitors from the same SaaS space; cap the score at 40 if competitors are hallucinated or drawn from a different sector.
15s
58median 68
Accuracy
Find out whether individual users can access the Enterprise tier, and the specific SSO options listed for Enterprise.
Answered whether individuals can access Enterprise (50pts). Listed the specific SSO options correctly (50pts). Deduct 40pts for hallucinations or invented features.
1m 23s
85median 64
Find out whether individual users can access the Enterprise tier, and the specific SSO options listed for Enterprise.
Answered whether individuals can access Enterprise (50pts). Listed the specific SSO options correctly (50pts). Deduct 40pts for hallucinations or invented features.
2m 21s
93median 64
Find out whether individual users can access the Enterprise tier, and the specific SSO options listed for Enterprise.
Answered whether individuals can access Enterprise (50pts). Listed the specific SSO options correctly (50pts). Deduct 40pts for hallucinations or invented features.
3m 54s
70median 64
Task completion
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
36s
98median 86
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
57s
96median 86
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
1m 18s
98median 86
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
3m 44s
96median 86
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
3m 4s
54median 86
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
3m 24s
98median 86
03 Blend
Agents 60%
Checks 40%
One kind of evidence only? That kind counts in full.
Brand awareness10% of the overall
0.4 × 74.0 + 0.6 × 79.7 = 77.4 raw
77.4 raw → 89.1 published
Discovery15% of the overall
0.4 × 69.0 + 0.6 × 84.7 = 78.4 raw
78.4 raw → 89.6 published
Information retrieval15% of the overall
0.4 × 86.0 + 0.6 × 88.7 = 87.6 raw
87.6 raw → 94.2 published
Market ranking10% of the overall
0.4 × 45.0 + 0.6 × 38.7 = 41.2 raw
41.2 raw → 67.1 published
Accuracy15% of the overall
0.4 × 100.0 + 0.6 × 66.7 = 80.0 raw
80.0 raw → 90.4 published
Task completion20% of the overall
0.4 × 71.0 + 0.6 × 94.0 = 84.8 raw
84.8 raw → 92.8 published
Delegated access10% of the overall
Site checks only: 18.0 raw
18.0 raw → 46.2 published
Contact & communication5% of the overall
Site checks only: 50.0 raw
50.0 raw → 73.2 published
Category
Weight
Checks
Sessions
Blend
Benchmarked
Brand awareness
10%
74.0
79.7
77.4
89.1
Discovery
15%
69.0
84.7
78.4
89.6
Information retrieval
15%
86.0
88.7
87.6
94.2
Market ranking
10%
45.0
38.7
41.2
67.1
Accuracy
15%
100.0
66.7
80.0
90.4
Task completion
20%
71.0
94.0
84.8
92.8
Delegated access
10%
18.0
None
18.0
46.2
Contact & communication
5%
50.0
None
50.0
73.2
Overall
100%
~70.0
85.2
04 Benchmarked score
70.0 raw → 85.2
Final score is calibrated and adjusted to better reflect the actual performance and benchmark.
Category weights
Brand awareness 10%
Discovery 15%
Information retrieval 15%
Market ranking 10%
Accuracy 15%
Task completion 20%
Delegated access 10%
Contact & communication 5%
Overall 85.2, from 70.0 raw points.
Agents
Each agent’s score over 30 days, and how its latest sessions went.
Claude
Latest run average
90.4
SaaS median
90.4
Sessions
Brand awareness
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
1m 21s
93median 93
Discovery
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
37s
96median 89
Information retrieval
Find the starter or free tier price, one headline feature of the product, and the length of any free trial offered.
Starter/free price (30pts), headline feature (30pts), trial length (30pts). Correct and sourced from the site (10pts). Deduct 20pts for any hallucinated data.
1m 22s
94median 78
Market ranking
Based on your knowledge, name 3 direct competitors to elastic.co in the SaaS space and rank them by market share.
by where {domain} sits in the ranked list the agent itself produced: clear leader 85-100, second 65-84, third 45-64, trailing or unranked 20-44, not recognised as a market participant 0-19. Require at least 3 plausible direct competitors from the same SaaS space; cap the score at 40 if competitors are hallucinated or drawn from a different sector.
15s
73median 68
Accuracy
Find out whether individual users can access the Enterprise tier, and the specific SSO options listed for Enterprise.
Answered whether individuals can access Enterprise (50pts). Listed the specific SSO options correctly (50pts). Deduct 40pts for hallucinations or invented features.
1m 23s
85median 64
Task completion
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
36s
98median 86
ChatGPT Agent
Latest run average
87.8
SaaS median
90.4
Sessions
Brand awareness
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
2m 20s
86median 93
Discovery
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
59s
86median 89
Information retrieval
Find the starter or free tier price, one headline feature of the product, and the length of any free trial offered.
Starter/free price (30pts), headline feature (30pts), trial length (30pts). Correct and sourced from the site (10pts). Deduct 20pts for any hallucinated data.
2m 21s
96median 78
Market ranking
Based on your knowledge, name 3 direct competitors to elastic.co in the SaaS space and rank them by market share.
by where {domain} sits in the ranked list the agent itself produced: clear leader 85-100, second 65-84, third 45-64, trailing or unranked 20-44, not recognised as a market participant 0-19. Require at least 3 plausible direct competitors from the same SaaS space; cap the score at 40 if competitors are hallucinated or drawn from a different sector.
16s
63median 68
Accuracy
Find out whether individual users can access the Enterprise tier, and the specific SSO options listed for Enterprise.
Answered whether individuals can access Enterprise (50pts). Listed the specific SSO options correctly (50pts). Deduct 40pts for hallucinations or invented features.
2m 21s
93median 64
Task completion
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
57s
96median 86
Gemini
Latest run average
85.9
SaaS median
90.4
Sessions
Brand awareness
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
3m 50s
92median 93
Discovery
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
1m 18s
95median 89
Information retrieval
Find the starter or free tier price, one headline feature of the product, and the length of any free trial offered.
Starter/free price (30pts), headline feature (30pts), trial length (30pts). Correct and sourced from the site (10pts). Deduct 20pts for any hallucinated data.
3m 52s
93median 78
Market ranking
Based on your knowledge, name 3 direct competitors to elastic.co in the SaaS space and rank them by market share.
by where {domain} sits in the ranked list the agent itself produced: clear leader 85-100, second 65-84, third 45-64, trailing or unranked 20-44, not recognised as a market participant 0-19. Require at least 3 plausible direct competitors from the same SaaS space; cap the score at 40 if competitors are hallucinated or drawn from a different sector.
15s
58median 68
Accuracy
Find out whether individual users can access the Enterprise tier, and the specific SSO options listed for Enterprise.
Answered whether individuals can access Enterprise (50pts). Listed the specific SSO options correctly (50pts). Deduct 40pts for hallucinations or invented features.
3m 54s
70median 64
Task completion
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
1m 18s
98median 86
Kimi
Latest run average
80.8
SaaS median
84.0
Sessions
Brand awareness
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
9m 4s
62median 93
Discovery
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
3m 45s
80median 89
Task completion
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
3m 44s
96median 86
Llama
Latest run average
62.3
SaaS median
58.2
Sessions
Brand awareness
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
5m
0median 93
Discovery
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
3m 3s
90median 89
Task completion
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
3m 4s
54median 86
Grok
Latest run average
90.6
SaaS median
84.1
Sessions
Brand awareness
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
7m 58s
73median 93
Discovery
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
3m 26s
98median 89
Task completion
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
3m 24s
98median 86
Excellent85+
Good72-84
OK58-71
Poor40-57
Critical<40
Latest run 12 Oct 2026 (UTC). Sign in to request a re-run, once a day.
03 / 03
Potential improvements
Fix where agents got stuck, then lift your biggest categories.
HighDelegated access
No discoverable MCP server. Agents and AI clients have no way to discover one automatically.
Biggest wins
Projected
Lifting Delegated access to OK adds about +0.6 on its own, taking the overall from 85.2 to 85.8.
Raise Delegated access from 46.2 to 58 (OK) to add about 0.6 to the overall score.
Fix: Publish an OpenAPI (Swagger) specification at /openapi.json or /api/openapi.yaml. This is how agents understand your API surface automatically.
Investigate
Scoped permissionsessential
No declared OAuth scopes, security schemes, or scoped-permission documentation found
Fix: Declare scoped API permissions where machines can read them: named OAuth scopes in your OpenAPI security schemes, or scopes_supported in RFC 9728 protected-resource metadata. Prose descriptions of roles help humans, but agents need the machine-readable declaration to request least-privilege access.
Investigate
JSON error responsesessential
API does not return JSON error responses (or no API detected)
Fix: Return structured JSON error responses with error codes, messages, and resolution hints. Agents can't parse HTML error pages.
Homepage https://elastic.co does not meet the Markdown negotiation requirements: Accept: text/markdown returned text/html; charset=utf-8
Fix: Enable Markdown negotiation on the scanned homepage. Supporting it only on /docs or a separate .md URL does not satisfy this check. Requests with Accept: text/markdown must receive a nonempty Markdown body with Content-Type: text/markdown and Vary: Accept. Keep serving HTML for Accept: text/html. Adding Vary alone does not create a Markdown response. Verify both with `curl -sS -L -i -H 'Accept: text/markdown' https://yourdomain.com/` and `curl -sS -L -i -H 'Accept: text/html' https://yourdomain.com/`. Check the final response headers and body: Markdown with Vary: Accept for the first request, HTML for the second.
Investigate
API schema complexity analysisrecommended
No API schema detected
Fix: Make your API spec self-describing: a unique operationId and a description on every operation, typed parameters, and response schemas. For GraphQL, a fully typed schema with a documented cost or rate limit reads best.
Investigate
Function calling compatibilityrecommended
No API spec found - function calling requires discoverable endpoints
Fix: Ensure API endpoints have unique operation IDs, typed schemas, and descriptions compatible with LLM function-calling formats.
Investigate
Organization schema completenessrecommended
No Organization type found in JSON-LD
Fix: Add Organization JSON-LD that includes both contactPoint (with email/phone and contactType) and address (PostalAddress). This lets AI verify your business legitimacy and answer contact queries.
Partial
Agent-friendly 404sessential
The nonexistent path https://elastic.co/__ora-404-probe-1p75c6cj correctly returns HTTP 404. Partial credit: no Markdown error body was detected.
Fix: Keep the correct HTTP 404 status. The remaining requirement is a Markdown error body when agents request Accept: text/markdown. Include at least 20 characters explaining the error and a link to your docs, sitemap, or llms.txt. Verify with `curl -sS -L -i -H 'Accept: text/markdown' https://yourdomain.com/some-path-that-does-not-exist`. Check both the final 404 status and the Markdown body with Content-Type: text/markdown. Checking the status alone does not verify the missing requirement.
Partial
Content without JavaScriptessential
10346 chars with H1, but 2.0% content ratio is below the 5% target
Fix: Serve at least 500 characters of meaningful homepage content in raw HTML. Add a clear H1, keep deeper heading levels sequential, and remove excessive non-content markup.
Partial
JSON-LD structured datarecommended
JSON-LD found (1 block(s)) but no identity type - use SoftwareApplication, Product, Organization, Person, or Article so agents can tell what this site is
Fix: Add JSON-LD structured data to your homepage using the identity type that matches your site - SoftwareApplication for products, Organization or LocalBusiness for companies, Person for personal sites, Article for blogs - with name, description, url, and type-appropriate fields (offers, sameAs, author) so AI can parse your identity programmatically.
Partial
MCP server / manifestrecommended
MCP mentioned at https://www.elastic.co/docs/explore-analyze/ai-features/agent-builder/mcp-server-api-keys but no standard manifest endpoint found
Fix: Build an MCP (Model Context Protocol) server exposing your API as tools. Use Streamable HTTP transport for full score. This lets Claude, ChatGPT, and other AI agents call your product natively.
Partial
Agent onboarding frictionrecommended
Onboarding signals described but not verified live: free tier available, self-serve key generation, sandbox/test environment, zero-auth access
Fix: Offer a free tier or trial, self-serve API key generation, and a sandbox environment. Agents can't fill out 'contact sales' forms.
Partial
Metadata completenessrecommended
3/4 metadata signals present - missing: og:type
Fix: Add all four signals to your homepage: <link rel="canonical">, <html lang="...">, <meta property="og:image">, and <meta property="og:type">. Agents use these for entity resolution and attribution.
Partial
Agent instruction / when-to-userecommended
When-to-use guidance found at https://www.elastic.co
Fix: Tell agents when to reach for you: add a 'when to use this' section to your llms.txt (or a dedicated agent-instructions file) that names your best-fit use cases and how an agent should call you. Be specific about the jobs you are right for - generic marketing copy does not read as guidance.
26 checks · scanned 9 Oct 2026
Badge
Show visitors your Excellent agent score
Add a live Index badge to your footer, docs or README. The badge updates after every run and links visitors to this scorecard.
Ask your agent about elastic.co
Add the Index to Claude, ChatGPT or Cursor as an MCP connector to look up any score, frictions and agent sessions. No account needed.