Which automated test cases have failed intermittently more than 15% of the time in the last 30 runs without a corresponding production incident?
Identify flaky tests that erode CI/CD confidence without detecting real bugs to prioritize test suite refactoring and improve release gate reliability
Metrics & KPIs
Required Data
Data Sources
Works with tools like
How Bruin answers this
Bruin AI Data Analyst
Which automated test cases have failed intermittently more than 15% of the time in the last 30 runs without a corresponding production incident?
Bruin connects to your Telemetry and runs the analysis automatically.
It tracks Flakiness rate by test, false failure rate, test suite confidence score and delivers the answer in seconds — in Slack, Discord, Teams, or your browser.
Related use cases
Crash Rate Spike After iOS Update
Did the iOS 17.4 update increase crash rates for devices with less than 4GB RAM compared to our pre-release test matrix?
QAANR Rate by GPU Model
Which specific GPU models are generating ANR events above 0.5% threshold in our newest level pack?
QARegression Detection in Retention After Build 3.2.1
Did build 3.2.1 introduce a regression in D7 retention for players who completed the tutorial?
Bruin for mobile gaming
350+ use cases across every team in your studio — from monetisation to LiveOps, product to engineering. One AI that speaks your data.
Get this answer in seconds
Connect your data, ask the question, get the answer. No SQL needed.