Aggregate unstructured feedback from real customer conversations at massive scale. Expose key pain points, new opportunities and make decisions fast to drive growth
Automated checks probe the site before any agent runs. They count for 40% of each category. Strongest is Brand awareness at 88.0, weakest is Discovery at 44.0.
Site checks by category
Brand awareness
88.0
Discovery
44.0
Information retrieval
84.0
Market ranking
50.0
Accuracy
85.0
Task completion
65.0
Delegated access
60.0
Contact & communication
60.0
01 Site checks
Points by category
Brand awareness
88.0
Discovery
44.0
Information retrieval
84.0
Market ranking
50.0
Accuracy
85.0
Task completion
65.0
Delegated access
60.0
Contact & communication
60.0
02 Agent sessions
Brand awareness
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
1m 21s
97median 95
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
2m 34s
94median 95
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
7m 11s
80median 95
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
5m 32s
0median 95
Discovery
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
37s
100median 91
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
54s
96median 91
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
2m 44s
96median 91
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
2m 55s
98median 91
Information retrieval
Find the starter or free tier price, one headline feature of the product, and the length of any free trial offered.
Starter/free price (30pts), headline feature (30pts), trial length (30pts). Correct and sourced from the site (10pts). Deduct 20pts for any hallucinated data.
1m 21s
90median 76
Find the starter or free tier price, one headline feature of the product, and the length of any free trial offered.
Starter/free price (30pts), headline feature (30pts), trial length (30pts). Correct and sourced from the site (10pts). Deduct 20pts for any hallucinated data.
2m 34s
90median 76
Market ranking
Based on your knowledge, name 3 direct competitors to fourfour.ai in the SaaS space and rank them by market share.
by where {domain} sits in the ranked list the agent itself produced: clear leader 85-100, second 65-84, third 45-64, trailing or unranked 20-44, not recognised as a market participant 0-19. Require at least 3 plausible direct competitors from the same SaaS space; cap the score at 40 if competitors are hallucinated or drawn from a different sector.
10s
26median 66
Based on your knowledge, name 3 direct competitors to fourfour.ai in the SaaS space and rank them by market share.
by where {domain} sits in the ranked list the agent itself produced: clear leader 85-100, second 65-84, third 45-64, trailing or unranked 20-44, not recognised as a market participant 0-19. Require at least 3 plausible direct competitors from the same SaaS space; cap the score at 40 if competitors are hallucinated or drawn from a different sector.
9s
26median 66
Accuracy
Find out whether individual users can access the Enterprise tier, and the specific SSO options listed for Enterprise.
Answered whether individuals can access Enterprise (50pts). Listed the specific SSO options correctly (50pts). Deduct 40pts for hallucinations or invented features.
1m 21s
82median 64
Find out whether individual users can access the Enterprise tier, and the specific SSO options listed for Enterprise.
Answered whether individuals can access Enterprise (50pts). Listed the specific SSO options correctly (50pts). Deduct 40pts for hallucinations or invented features.
2m 37s
70median 64
Task completion
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
37s
98median 85
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
52s
96median 85
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
2m 43s
96median 85
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
2m 56s
97median 85
03 Blend
Agents 60%
Checks 40%
One kind of evidence only? That kind counts in full.
Brand awareness10% of the overall
0.4 × 88.0 + 0.6 × 90.5 = 89.5 raw
89.5 raw → 95.1 published
Discovery15% of the overall
0.4 × 44.0 + 0.6 × 96.0 = 75.2 raw
75.2 raw → 88.0 published
Information retrieval15% of the overall
0.4 × 84.0 + 0.6 × 80.0 = 81.6 raw
81.6 raw → 91.3 published
Market ranking10% of the overall
0.4 × 50.0 + 0.6 × 5.0 = 23.0 raw
23.0 raw → 51.6 published
Accuracy15% of the overall
0.4 × 85.0 + 0.6 × 55.0 = 67.0 raw
67.0 raw → 83.5 published
Task completion20% of the overall
0.4 × 65.0 + 0.6 × 93.5 = 82.1 raw
82.1 raw → 91.5 published
Delegated access10% of the overall
Site checks only: 60.0 raw
60.0 raw → 79.5 published
Contact & communication5% of the overall
Site checks only: 60.0 raw
60.0 raw → 79.5 published
Category
Weight
Checks
Sessions
Blend
Benchmarked
Brand awareness
10%
88.0
90.5
89.5
95.1
Discovery
15%
44.0
96.0
75.2
88.0
Information retrieval
15%
84.0
80.0
81.6
91.3
Market ranking
10%
50.0
5.0
23.0
51.6
Accuracy
15%
85.0
55.0
67.0
83.5
Task completion
20%
65.0
93.5
82.1
91.5
Delegated access
10%
60.0
None
60.0
79.5
Contact & communication
5%
60.0
None
60.0
79.5
Overall
100%
~70.3
85.3
04 Benchmarked score
70.3 raw → 85.3
Final score is calibrated and adjusted to better reflect the actual performance and benchmark.
Category weights
Brand awareness 10%
Discovery 15%
Information retrieval 15%
Market ranking 10%
Accuracy 15%
Task completion 20%
Delegated access 10%
Contact & communication 5%
Overall 85.3, from 70.3 raw points.
Agents
Each agent’s score over 30 days, and how its latest sessions went.
ChatGPT Agent
Latest run average
86.8
SaaS median
84.0
Sessions
Brand awareness
Find the product name, its one-sentence value proposition, and the primary user persona it targets.
Did the agent correctly identify the product name (30pts), the value prop (40pts), and the target user (30pts)? Deduct 20pts for hallucinations.
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
Find the starter or free tier price, one headline feature of the product, and the length of any free trial offered.
Starter/free price (30pts), headline feature (30pts), trial length (30pts). Correct and sourced from the site (10pts). Deduct 20pts for any hallucinated data.
Based on your knowledge, name 3 direct competitors to fourfour.ai in the SaaS space and rank them by market share.
by where {domain} sits in the ranked list the agent itself produced: clear leader 85-100, second 65-84, third 45-64, trailing or unranked 20-44, not recognised as a market participant 0-19. Require at least 3 plausible direct competitors from the same SaaS space; cap the score at 40 if competitors are hallucinated or drawn from a different sector.
Find out whether individual users can access the Enterprise tier, and the specific SSO options listed for Enterprise.
Answered whether individuals can access Enterprise (50pts). Listed the specific SSO options correctly (50pts). Deduct 40pts for hallucinations or invented features.
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
Find the starter or free tier price, one headline feature of the product, and the length of any free trial offered.
Starter/free price (30pts), headline feature (30pts), trial length (30pts). Correct and sourced from the site (10pts). Deduct 20pts for any hallucinated data.
Based on your knowledge, name 3 direct competitors to fourfour.ai in the SaaS space and rank them by market share.
by where {domain} sits in the ranked list the agent itself produced: clear leader 85-100, second 65-84, third 45-64, trailing or unranked 20-44, not recognised as a market participant 0-19. Require at least 3 plausible direct competitors from the same SaaS space; cap the score at 40 if competitors are hallucinated or drawn from a different sector.
Find out whether individual users can access the Enterprise tier, and the specific SSO options listed for Enterprise.
Answered whether individuals can access Enterprise (50pts). Listed the specific SSO options correctly (50pts). Deduct 40pts for hallucinations or invented features.
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.
Navigate to the pricing page, and note its URL and the names of any pricing tiers shown.
Found the pricing page within 3 nav hops (60pts). Correctly identified it as the pricing page and listed at least one tier (40pts). Deduct 20pts for each dead end.
Click the primary CTA for any paid plan and reach the signup or upgrade form.
Found the pricing page (20pts). Clicked the primary CTA (20pts). Reached the signup/upgrade form (40pts). Reported the URL and form fields (20pts). Deduct 20pts for each bot challenge or CAPTCHA hit.