epok

Metrics & Infrastructure

Slow Drift

Updated Jul 28, 2026 · 1d ago

The boiling-frog leak: a metric trending steadily the wrong way over hours, too gradual for any spike alarm to catch.

Example alert

checkout heap_used_bytes climbing +6%/hr for 9h straight (likely leak)

Exact wording varies — the detector generates titles from the anomaly it finds. This is representative of what an alert looks like when it fires.

How it works

Applies a Mann-Kendall monotonic-trend test over a long window per metric series, detecting sustained directional drift (a slow memory leak, a filling disk) that never trips a threshold because no single point is anomalous. Direction-aware via metric polarity.

Availability

Runs on these tiers:

TrialTeamGrowthCustom

Want to see this detector firing in the live demo?

Open alerts in the sandbox →

Related detectors

  • Metric Anomaly

    Spikes and dips in any numeric metric — CPU, memory, queue depth, request rate — against that metric's own seasonal baseline.

  • Resource Saturation

    A resource pinned near its limit — CPU, memory, disk, connection pool — long enough to matter, not a momentary touch.

  • Metric Reporting Gap

    A metric series that simply stopped arriving — a dead exporter, a broken scrape, a crashed agent — where the absence is the alert.

  • Infrastructure Metric Rules

    Named-metric guardrails: pods stuck Pending, consumer-group lag, replication lag, restart storms — metrics with a known-bad level.

  • Host Liveness

    Flags a host or node that has stopped reporting, so a silent box surfaces as a warning rather than as missing data.

← All detectors