All case studies

Automation at Scale

Conquering Salesforce login complexity to deliver a rock-solid test suite — from a fragile 6-hour run to a fast, trustworthy CI pipeline.

PLAYWRIGHT   PARALLELISATION   SHARED SESSION ARCHITECTURE CLAUDE  TESTRAIL MCP INTEGRATION
Automation at Scale
OVERVIEW

Automation engineering for an integration-heavy sales productivity platform.

The client is an AI-powered sales productivity platform that operates directly inside Gmail, Outlook, and Microsoft Teams. It bridges the gap between email inboxes and Salesforce CRM, eliminating manual data entry and empowering sales teams to book more meetings, track buyer signals, and maintain a cleaner pipeline — all without leaving their inbox. The platform serves over 50,000 customer-facing teams worldwide, including several Fortune 500 enterprises and recognisable consumer brands. Its deep integrations with Salesforce, Google Workspace, and Microsoft 365 make it one of the most integration-intensive SaaS products to test and automate.

Automation for deeply integrated SaaS products requires architectural thinking, not just script writing.

350+

Automated Test Cases

66%

Execution Time Reduced

<2 hrs

FULL SUITE COMPLETION

~0%

Flaky Test Rate

PROJECT AT A GLANCE
Client
SaaS / CRM Productivity (name withheld at client’s request)
Industry
SaaS / CRM Productivity
Website
Confidential (available on request)
AI Coding Tool
Claude
Project Type
Automation Engineering
Engagement Model
Part-time (20 hrs / week)
Automation Framework
Playwright (TypeScript)
Test Case Management
TestRail — integrated via a custom Claude skill (MCP)
Integrations Under Test
Salesforce, Gmail, Outlook (OWA)
THE CHALLENGE

When login itself is the hardest test.

Automating quality engineering here meant testing an application deeply entangled with Salesforce, Gmail, and Outlook — platforms with strict, automation-resistant security policies that made a conventional automation setup unworkable from the start.

01

Salesforce Auto-Lock

Salesforce locks accounts after repeated or failed login attempts. With multiple parallel test scripts authenticating simultaneously, account lock-outs were constant — halting entire test runs before a single test could execute.

02

Multi-Platform Authentication

The application requires concurrent authentication across Salesforce, Gmail, and Outlook browser extensions. Each platform uses different OAuth flows and session behaviours, making a unified auth strategy extremely complex.

03

6-Hour Execution Time

The initial full-suite run took over 6 hours due to sequential execution and repeated login cycles for every test — far too slow for a continuous delivery model with weekly production releases.

04

Widespread Test Flakiness

Login-related failures and inconsistent browser extension loading caused pervasive test flakiness. Tests failed intermittently without any code change, eroding confidence in the entire automation suite.

WHAT WE DID

A session-level fix, not just more scripts.

The team designed a multi-layered automation strategy that addressed each challenge systematically — combining a shared session architecture, parallelised execution, AI-assisted code development, and robust OAuth handling across all three platforms. Midway through the engagement, the team's AI coding workflow migrated from Cursor AI to Claude, alongside a purpose-built Claude skill that connects directly into the client's TestRail instance.

01

Shared Session Storage

Authentication tokens and cookies are established once and shared across all test files — eliminating the root cause of lock-outs (repeated logins per test) without sacrificing test isolation.

02

Project-Level Cookie Architecture

Native login bugs were fixed and a project-level cookie management system was built, allowing authentication state to persist and be reused across runs — five framework fixes merged to the development branch.

03

Parallelised Test Execution

Project-level parallel execution was enabled for the entire suite. Specs that previously ran sequentially over 6 hours were restructured to run in parallel, cutting total execution time to under 2 hours.

04

2FA & OAuth Automation

Two-factor authentication was automated across all scripts to handle activation flows triggered by automated logins. Email OAuth flows, including the complete Forgot Password journey, were fully automated with lint compliance.

05

AI-Assisted Development with Claude

The team's AI coding workflow migrated from Cursor AI to Claude, now used throughout the automation lifecycle to accelerate code generation, suggest refactors, and fix lint compliance — reducing time-to-automation for each new test case and improving code quality.

06

Production Regression & Smoke Suites

Structured manual production regression was delivered for every weekly release, alongside a dedicated smoke test suite for rapid post-deployment validation.

07

Claude Skill for TestRail-Integrated Test Case Generation

Built a custom Claude skill that helps QE engineers author test cases directly against TestRail. A TestRail MCP integration fetches existing test cases for AI-assisted coverage analysis, then generates additional test cases through a read-only workflow that never modifies TestRail directly.

Results & Impact

What the work delivered.

Salesforce account lock-outs eliminated

the core blocker that previously caused entire test runs to fail was resolved through shared session storage and project-level cookie management.

Full test suite execution reduced from over 6 hours to under 2 hours through parallelisation

a 66%+ improvement enabling rapid CI/CD feedback cycles aligned with weekly production releases.

350+

automated test cases now passing consistently with a near-zero flaky rate, providing a stable regression safety net for every release.

End-to-end multi-platform authentication fully automated

covering two-factor auth, email OAuth, and Forgot Password flows across all environments.

AI coding workflow migrated from Cursor AI to Claude, accelerating automation development velocity and reducing time-to-automation per test case through AI-assisted review and refactoring.

A custom Claude skill built for TestRail-integrated test case generation

using a TestRail MCP integration to fetch existing test cases for AI-assisted coverage analysis, then generating additional test cases through a read-only workflow that never modifies TestRail directly.

A custom QE dashboard delivered early in the engagement, providing real-time visibility into manual vs. automated coverage, pending automation backlog, and non-automatable scenarios.

TOOLS & TECHNOLOGY

The stack.

Automation Framework
Playwright (TypeScript)
AI Development Tool
Claude (migrated from Cursor AI)
Test Case Generation
Custom Claude skill — TestRail MCP integration for AI-assisted test case authoring and coverage analysis
Version Control
GitHub
Project Management
Jira
Platforms Under Test
Salesforce CRM, Gmail (Google Workspace), Outlook / OWA (Microsoft 365)
CI Architecture
Parallel spec execution, project-level cookie sharing, shared session storage
Reporting
Custom QE Dashboard — manual vs. automated coverage, pending backlog, non-automatable items

By solving the authentication problem at the session level and restructuring execution for parallelism, the team transformed an unstable, 6-hour test suite into a fast, reliable automation foundation that confidently supports every weekly production release.