Pass rate0.8pp
92%
avg across 64 suites
Open flakes4
50
score ≥ 55
Cases18
360
in 64 suites
Gap risk high3
21
risk ≥ 55
Failed cases2
5
open failures
Coverage lines1pp
66%
estate avg
Passed vs failed
Northline Test Ops · weekly cases
PassedFailed
Mon Nightly flake spikeWed payments gate raised 85%Thu main run failed 12 casesSat Quarantine 6 e2e cases
Suites by layer
64 suites
26
Unit
16
Integration
15
E2E
7
Contract
Highest flake score
open + quarantined
| Case | Layer | Flake |
|---|---|---|
| POS offline queue flushes after reconnect | E2E | 94 |
| rolls back if POS queue | E2E | 93 |
| holds inventory during checkout race | E2E | 91 |
| sync timeout under warehouse lag | Integration | 84 |
| settle partial capture idempotent | Integration | 81 |
| invalidates on pipeline stage | E2E | 81 |
| caches warm path for pipeline stage | E2E | 79 |
Slowest cases
duration
| Case | Suite | Dur | Status | Flake |
|---|---|---|---|---|
| POS offline queue flushes after reconnect | pos/offline-sync | 1m 28s | Quarantined | 94 |
| handles concurrent invoice | edge/gateway-health | 1m 14s | Flaky | 57 |
| invalidates on deal | payments/checkout | 1m 10s | Passed | 51 |
| rate-limits tax line | auth/core | 1m 06s | Quarantined | 8 |
| rejects invalid webhook | auth/core | 57s | Passed | 48 |
| authz blocks token | pos/offline-sync | 53s | Flaky | 64 |
| persists after hold | payments/checkout | 48s | Flaky | 61 |
| handles concurrent refresh token | auth/core | 48s | Flaky | 62 |
Estate health
pass · coverage
92%
320 runs
Coverage
66%
Open flakes
50
Root-caused alerts
symptom → fix
Do this next
scored actions
- 196Quarantine checkout raceFlake 91 → isolate hold fixture
- 291Cover payments-core settle pathsGap risk 88 · lines 54%
- 384Stabilize POS reconnect suitePass 78% · p95 5m+
- 478Re-run main after hold bisect12 failed on run_4821