Session 88cb89ed
Provider: Claude • Model: claude-sonnet-5-5 • Category: support • Score: 90.4 (Excellent)
Rubric evidence
The agent found the pricing FAQ on cancellation and stated the proration wording accurately. It said no refund policy is published and checked the Terms of Service to confirm. It did not find a concrete cancellation path in the app, and the transcript doesn't show the FAQ text expanded. It also didn't check other pages such as a help page or footer links.
- 2026-10-04T21:45:46.148277+00:00 · tool_call · navigate
{ "step": { "ts": "2026-10-04T21:45:45.912Z", "kind": "tool_call", "name": "navigate", "input": { "url": "https://www.stuntdouble.io" } }, "stepIndex": 0 } - 2026-10-04T21:45:47.764876+00:00 · tool_result · navigate
{ "step": { "ts": "2026-10-04T21:45:47.518Z", "kind": "tool_result", "name": "navigate", "text": "Navigated to https://www.stuntdouble.io/\nNow on https://www.stuntdouble.io/ (Stunt Double: product testing and user research by AI users)" }, "stepIndex": 1 } - 2026-10-04T21:45:49.256068+00:00 · screenshot
{ "stepIndex": 1 }
- 2026-10-04T21:45:49.62213+00:00 · tool_call · find
{ "step": { "ts": "2026-10-04T21:45:48.923Z", "kind": "tool_call", "name": "find", "input": { "query": "terms, FAQ, help, refund links" } }, "stepIndex": 2 } - 2026-10-04T21:45:50.059524+00:00 · tool_result · find
{ "step": { "ts": "2026-10-04T21:45:49.025Z", "kind": "tool_result", "name": "find", "text": "img \"A checklist run for the Friday booking flow: a 72% weighted score, two checks passed and one failed, the failed check reading that the deposit amount and refund window are stated before payment.\" [ref_1]" }, "stepIndex": 3 } - 2026-10-04T21:45:50.417633+00:00 · tool_call · navigate
{ "step": { "ts": "2026-10-04T21:45:49.025Z", "kind": "tool_call", "name": "navigate", "input": { "url": "https://www.stuntdouble.io/pricing" } }, "stepIndex": 4 } - 2026-10-04T21:45:51.562666+00:00 · tool_result · navigate
{ "step": { "ts": "2026-10-04T21:45:51.353Z", "kind": "tool_result", "name": "navigate", "text": "Navigated to https://www.stuntdouble.io/pricing\nNow on https://www.stuntdouble.io/pricing (Pricing | Stunt Double)" }, "stepIndex": 5 } - 2026-10-04T21:45:54.195706+00:00 · screenshot
{ "stepIndex": 5 }
- 2026-10-04T21:45:54.560032+00:00 · tool_call · get_page_text
{ "step": { "ts": "2026-10-04T21:45:52.290Z", "kind": "tool_call", "name": "get_page_text", "input": {} }, "stepIndex": 6 } - 2026-10-04T21:45:54.946445+00:00 · tool_result · get_page_text
{ "step": { "ts": "2026-10-04T21:45:52.305Z", "kind": "tool_result", "name": "get_page_text", "text": "Cheaper than a complaint No participant fees and no panel credits. You pay for the runs you use. Solo Trial €9 /mo One person, for up to 3 months Kick the tires solo before bringing the team Start trial Hobby €69 /team/mo 3 collaborators For individuals and small projects Choose Hobby Startup €249 /team/mo 10 collaborators, then €5 each For growing product teams Choose Startup Pro €529 /team/mo 25 collaborators For teams that need more power Choose Pro Enterprise Bespoke Custom seats For organisations with specific needs Talk to us Compare plans Solo Trial Hobby Startup Pro Enterprise TEAM & USAGE Collaborators 1 3 10, then €5 each 25 Custom Usage (2x on annual plan) Fair use, while you trial 160 min, then €0.34/min 560 min, then €0.34/min 1,000 min, then €0.34/min Negotiable Actors 3 5 7 15 Custom History 90 days 30 days 90 days 360 days Full history Comments retention 90 days 30 days 90 days 360 days Unlimited ENVIRONMENT & ACCESS Environment Browser Browser Browser Browser Browser Connection Public & private URLs Public & private URLs Public & private URLs Public & private URLs Public & private URLs, VPN/VPC Agent credentials Included Not included Included Included Included Self-hosted workers Desktop app Desktop app Desktop app Desktop app Desktop app, Docker, dedicated Integrations Linear, Slack Not included Linear, Slack API, Linear, Slack Custom Before you choose a plan Minutes, caps, trials and private URLs. What counts as a minute? Do I pay for participants or recruitment? Can I stop usage charges running away? Can I try it before I pay? Can actors test staging, previews or internal tools? Can I change or cancel my plan? Which currencies can I pay in? Do you offer startup, education or non-profit pricing? GET STARTED Your cast is ready to start Create your first actor in minutes. Run your first scene" }, "stepIndex": 7 } - 2026-10-04T21:45:55.29642+00:00 · tool_call · find
{ "step": { "ts": "2026-10-04T21:45:53.817Z", "kind": "tool_call", "name": "find", "input": { "query": "Can I change or cancel my plan? question" } }, "stepIndex": 8 } - 2026-10-04T21:45:55.677431+00:00 · tool_result · find
{ "step": { "ts": "2026-10-04T21:45:53.840Z", "kind": "tool_result", "name": "find", "text": "button \"Can I change or cancel my plan?\" [ref_1]\nbutton \"Can I try it before I pay?\" [ref_2]\nbutton \"Can actors test staging, previews or internal tools?\" [ref_3]\nlink \"Cast an actor\" href=\"https://app.stuntdouble.io/login\" [ref_4]\nbutton \"Do I pay for participants or recruitment?\" [ref_5]\nbutton \"Can I stop usage charges running away?\" [ref_6]\nbutton \"Which currencies can I pay in?\" [ref_7]\nbutton \"Do you offer startup, education or non-profit pricing?\" [ref_8]\nlink \"Changelog\" href=\"/changelog\" [ref_9]\nlink \"Download for Mac\" href=\"/api/desktop/download\" [ref_10]\nlink \"Investors\" href=\"/investors\" [ref_11]\nheading \"Before you choose a plan\" [ref_12]\nimg \"stuntdouble.io Stunt Double Index agent score\" [ref_13]" }, "stepIndex": 9 } - 2026-10-04T21:45:56.027278+00:00 · tool_call · click
{ "step": { "ts": "2026-10-04T21:45:54.679Z", "kind": "tool_call", "name": "click", "input": { "ref": "ref_1" } }, "stepIndex": 10 } - 2026-10-04T21:45:56.396985+00:00 · tool_result · click
{ "step": { "ts": "2026-10-04T21:45:55.322Z", "kind": "tool_result", "name": "click", "text": "left click on ref_1 at (633, 329)\nNow on https://www.stuntdouble.io/pricing (Pricing | Stunt Double)" }, "stepIndex": 11 } - 2026-10-04T21:45:57.51795+00:00 · screenshot
{ "stepIndex": 11 }
- 2026-10-04T21:45:57.949521+00:00 · tool_call · navigate
{ "step": { "ts": "2026-10-04T21:45:56.670Z", "kind": "tool_call", "name": "navigate", "input": { "url": "https://www.stuntdouble.io/terms" } }, "stepIndex": 12 } - 2026-10-04T21:45:58.554611+00:00 · tool_result · navigate
{ "step": { "ts": "2026-10-04T21:45:58.327Z", "kind": "tool_result", "name": "navigate", "text": "Navigated to https://www.stuntdouble.io/terms\nNow on https://www.stuntdouble.io/terms (Terms of Service | Stunt Double)" }, "stepIndex": 13 } - 2026-10-04T21:45:59.621429+00:00 · screenshot
{ "stepIndex": 13 }
- 2026-10-04T21:46:00.001831+00:00 · tool_call · get_page_text
{ "step": { "ts": "2026-10-04T21:45:59.139Z", "kind": "tool_call", "name": "get_page_text", "input": {} }, "stepIndex": 14 } - 2026-10-04T21:46:01.019587+00:00 · tool_result · get_page_text
{ "step": { "ts": "2026-10-04T21:45:59.154Z", "kind": "tool_result", "name": "get_page_text", "text": "Terms of Service Last updated 3 Sep 2026 1. Introduction These Terms of Service (\"Terms\") govern your use of the services provided by Turnout Labs (\"we\", \"our\", \"us\"), accessible through our website or any related platforms. By using our services, you agree to be bound by these Terms, which constitute a legally binding agreement between you and Turnout Labs and our products and services including Stunt Double. If you do not agree with these Terms, you must not use our services. Contact Details: support@stuntdouble.io 2. Services Turnout Labs offers various artificial intelligence solutions, including but not limited to data analytics, natural language processing, and machine learning applications (\"Services\"). We reserve the right to modify or discontinue any part of our Services without notice, at any time. We reserve the right to enforce a 'fair-use' policy. 3. Intellectual property rights All intellectual property rights related to the Services, including copyrights, trademarks, patents, trade secrets, and other proprietary rights, are and shall remain the exclusive property of Turnout Labs and its licensors. Your use of the Services does not grant you ownership of any intellectual property rights in our Services or the content you access. \"Stunt Double\", \"Aictors\", and \"Turnout Labs\" are registered trademarks of Turnout Labs Ltd. 4. Limitations of liability To the fullest extent permitted by law, Turnout Labs shall not be liable for any indirect, incidental, special, consequential, or punitive damages, or any loss of profits or revenues, whether incurred directly or indirectly, or any loss of data, use, goodwill, or other intangible losses, resulting from your access to or use of or inability to access or use the Services. 5. Data security and compliance 5.1 Security standards We ensure that our security controls and policies align with recognised industry frameworks such as ISO/IEC 27001:2022, NIST Cybersecurity Framework (CSF), or equivalent. Where such frameworks are not explicitly adopted, we demonstrate comparable security maturity. 5.2 Compliance obligations We shall at all times throughout the term of any agreement comply with information security requirements and other applicable security legislation (including, but not limited to intellectual property, cryptography restrictions, and retention of records) and shall: Not be entitled to use information except to the extent strictly necessary to perform our obligations; Not provide information to any unauthorised third party; and Upon request, provide evidence of the existence, adequacy, and effectiveness of the controls implemented to comply with these terms. 5.3 Security incident management If at any time we suspect or have reason to believe that a Security Incident has occurred impacting customer information or services, we shall notify affected customers within 48 hours of discovery and take all reasonable steps to mitigate the consequences in consultation with affected customers. 6. Privacy Your use of our Service is also governed by our Privacy Policy. Please review our Privacy Policy, which also governs the Site and informs users of our data collection practices. 7. Disclaimer The materials on Stunt Double are provided \"as is\". Stunt Double makes no warranties, expressed or implied, and hereby disclaims and negates all other warranties, including without limitation, implied warranties or conditions of merchantability, fitness for a particular purpose, or non-infringement of intellectual property or other violation of rights. 8. Limitations In no event shall Stunt Double or its suppliers be liable for any damages (including, without limitation, damages for loss of data or profit, or due to business interruption) arising out of the use or inability to use the materials on Stunt Double, even if Stunt Double or a Stunt Double authorized representative has been notified orally or in writing of the possibility of such damage. 9. Governing law These Terms and any disputes arising out of or related to these Terms or the Services shall be governed by and construed in accordance with the laws of the United Kingdom, without giving effect to any choice or conflict of law provision or rule. You irrevocably submit to the exclusive jurisdiction of the courts in that State or location. 10. Indemnification You agree to defend, indemnify, and hold harmless Turnout Labs, its officers, directors, employees, and agents, from and against any claims, liabilities, damages, judgments, awards, losses, costs, expenses, or fees (including reasonable attorneys' fees) arising out of or relating to your violation of these Terms or your use of the Services. 11. Handling of user data Turnout Labs is committed to protecting your privacy and data. We collect, use, and manage user data according to our Privacy Policy, which is incorporated by reference into these Terms. By using our services, you consent to such processing and you warrant that all data provided by you is accurate. 12. Communications By using our Services, you agree to receive electronic communications from us. These communications may include notices about your account and information concerning or related to our Services. 13. Prohibited use Usage of our platform, products, and services is strictly with the consent of the registered domain owner. Turnout Labs prohibits any use related to the development of weapons, social scoring, biometrics, identification of people, impersonation of identity, or illegal activity. Non-compliance will result in account termination. Age-restricted and regulated sites. Sites offering adult content, gambling, alcohol or other age-restricted goods and services may be tested on Stunt Double for performance monitoring and functional reporting only. That means checklist runs, availability and flow verification, and the technical and functional evidence those produce. You must be the registered domain owner, or hold the domain owner's consent, and you must mark the checklist or resource as adult content in the product so that captured material is handled accordingly. Behavioural intelligence is not available for this material. Our behavioural intelligence features, which include user interviews, insights and design reviews, must not be used on age-restricted or adult content, and we may withhold or disable them for any account or workspace that does. These features model how people respond to a product, and we do not offer that modelling for this material. You remain responsible for complying with the law that applies to the sites you test, including the age assurance and content duties under the UK Online Safety Act 2023 and any equivalent obligations in the territories you operate in. Evidence we capture from material you have marked as adult content is displayed behind an age confirmation, and you must not circumvent that control or share captured material with anyone under 18. 14. Dispute resolution Any disputes under these Terms will be resolved by arbitration in the United Kingdom, according to the Arbitration Act 1996. The arbitration will be conducted by a single arbitrator mutually agreed upon by the parties. The decision of the arbitrator shall be final and binding upon the parties. 15. Pilot periods For customers engaging in pilot programmes, these terms serve as the applicable agreement during the pilot period. Following completion of any pilot, commercial terms and conditions may be subject to negotiation and agreement through a procurement process. 16. Changes to Terms Stunt Double reserves the right, at our sole discretion, to modify or replace these Terms at any time. We recommend you check these Terms periodically for any changes. 17. Contact information If you have any questions about these Terms, please contact us at: Email: support@stuntdouble.io Address: 66 Paul Street, London These terms constitute the entire agreement between you and Turnout Labs regarding the use of our Services, superseding any prior agreements between you and us relating to your use of the Services. If any provision of these Terms is held to be invalid or unenforceable, the remaining provisions of these Terms will remain in full force and effect. These Terms of Service are last published and in effect as of the 3rd of September, 2026. We reserve the right to update or change our Terms at any time and recommend you check these Terms regularly. Your continued use of the Services after we post any modifications to the Terms will constitute your acknowledgment of the modifications and your consent to abide and be bound by the modified Terms. Contents Introduction Services Intellectual property rights Limitations of liability Data security and compliance Privacy Disclaimer Limitations Governing law Indemnification Handling of user data Communications Prohibited use Dispute resolution Pilot periods Changes to Terms Contact information" }, "stepIndex": 15 } - 2026-10-04T21:46:03.181164+00:00 · tool_call · done
{ "step": { "ts": "2026-10-04T21:46:02.300Z", "kind": "tool_call", "name": "done", "input": { "message": "Cancellation: The Pricing page FAQ (\"Can I change or cancel my plan?\") says: \"Yes. Upgrade, downgrade or cancel at any time. Changes take effect at the start of your next billing cycle, and upgrades are prorated.\" The site doesn't give step-by-step cancellation instructions. Plans are managed in the web app (app.stuntdouble.io, login required), and I didn't log in to find a cancel button. Contact for questions: support@stuntdouble.io.\n\nRefund policy: No pro-rated refund policy is published. Only upgrades are prorated, meaning a charge adjustment, not a refund. Cancellations and downgrades take effect at the next billing cycle. The Terms of Service (updated 3 Sep 2026) don't mention refunds or cancellation. For refund questions, you'd need to email support@stuntdouble.io." } }, "stepIndex": 16 }