The Outlier Lab

Rules Engine

The decisioning layer where explicit, human-authored logic turns signals and scores into actions (allow, step-up, hold, review, block), and why governance matters as much as the rules themselves.

What it is

A rules engine is the part of your decisioning stack that a fraud analyst can change without retraining a model. Mature programs still run rules alongside ML. Rules encode policy (eligibility, limits, mandatory holds), respond to emerging attacks within hours, and turn model scores into actions with thresholds that differ by segment.

Rules are also where most programs accumulate their worst technical debt. Hundreds of overlapping, undocumented rules written during past incidents, never retired, interact in ways nobody fully understands. Standing up the engine is straightforward; most of the control comes from governing the rules inside it. See Rule Governance and Change Management.

What it stops (and what it doesn't)

Rules are the right tool for:

  • Policy enforcement: one bonus per person, settled funds only, new-destination holds, regulatory requirements.
  • Fast response: a new attack pattern seen this morning can be blocked this afternoon, while a model change takes weeks.
  • Hard constraints: exposure caps, sanctioned jurisdictions, deny lists (Negative Lists and Deny Lists).
  • Score-to-action mapping: different model thresholds by segment, product, amount or rail.
  • Explainability: every action has a human-readable reason, useful for reviewers, customers, regulators and auditors.

Rules are the wrong tool for:

  • Complex, interacting patterns across many weak signals, which models capture better.
  • Large, adaptive adversaries. Static thresholds get probed and stepped around. When rule hit rates drop suddenly, ask whether the attack stopped or adapted.
  • Long-term primary detection. A rule set that grows without retirement becomes a brittle, unmaintainable model.

Design considerations

Separate rule types. Tag every rule as one of:

  • Policy: must exist regardless of performance (eligibility, compliance).
  • Detection: exists because it catches fraud, and must keep proving it.
  • Tactical: a response to an incident, with a built-in expiry date.
  • Score-mapping: a model threshold or segmentation rule.

Each type gets a different review cadence and retirement standard.

Graduated actions. Good engines return a graduated set of actions: allow, allow-and-monitor, step-up (Risk-Based Authentication and Step-Up), hold (Funds Availability Holds), limit, queue for review (Manual Review Queues), decline, and account restriction. Most value comes from the middle of that range.

Reason codes. Every decision returns machine-readable reason codes that flow to case tools, customer messaging, analytics and model training (Case Management Systems).

Shadow mode. Every new rule runs in shadow, logging what it would have done, before it acts. Measure its hits against later labels. See Fraud Strategy Lifecycle.

Backtesting. Evaluate a rule on historical data only after labels have matured. Otherwise you'll count missed fraud as "good" (Fraud Labeling and Feedback Loops).

Holdouts. For high-volume rules, keep a small random holdout to measure counterfactual fraud: what would have happened without the rule. Without it, a rule that blocks fraud looks identical to a rule that blocks good customers, because you never see outcomes for blocked traffic. See Experimentation and Champion-Challenger.

Feature latency. A rule is only as good as the features available at decision time. Velocity counters (Velocity Signals), entity linkage, list lookups and model scores need to be served within your latency budget (Real-Time Decisioning Architecture, Fraud Data Architecture). Plan for fallback behavior when a feature or vendor times out: fail open or fail closed, chosen per decision point.

Who can change rules. Rule changes move money. Use role-based permissions, peer review for production changes, an audit log, and rollback (Insider Access Controls). An analyst who can add an allowlist rule without review is an insider risk.

Threshold secrecy. Customer-facing messages, error codes and API responses shouldn't reveal which rule fired or how close the customer came to the threshold. Give users a generic message and give staff a detailed reason.

Diagram: Event, Feature and score fetch, Rule evaluation, Action, Allow, Step-up, Hold or limit, Review queue, Decline, Decision log with reason codes, Labels and outcomes, Rule performance review

Implementation path

StageWhat it looks likePrerequisites
CrawlRules in application code or a vendor console; a handful of policy and velocity rules; changes by engineersEvent logging at decision points
WalkDedicated engine (built or bought) with analyst authoring; shadow mode; reason codes; rule inventory with owners and types; monthly performance reviewFeature store or real-time counters; Case Management Systems; label pipeline
RunRules and models orchestrated together; automated backtesting on matured labels; holdouts; auto-expiry of tactical rules; rule-interaction analysis; full change governance with auditMachine Learning Models; Experimentation and Champion-Challenger; Rule Governance and Change Management

Customer friction and trade-offs

Friction comes from the rules themselves. The usual failure is rule accretion: each rule passes review on its own, but the combined false-positive rate climbs until good customers face step-ups and holds everywhere. Track the total insult rate (good customers affected by any rule) by segment, alongside per-rule precision (Friction and Customer Experience Tradeoffs).

Measuring effectiveness

Per rule:

  • Precision on matured labels (confirmed fraud ÷ hits).
  • Incremental catch: fraud caught only by this rule.
  • Good-customer impact: false positives and their friction cost.
  • Dollar-weighted performance: fraud dollars prevented against good dollars impacted.
  • Hit-rate trend: a sudden drop can mean adaptation.

Per rule set:

  • Coverage of known fraud patterns.
  • Rule count and age profile, including the share of rules unreviewed for more than a defined period.
  • Time to deploy a tactical rule during an incident.

See Fraud Metrics and KPIs.

Common failure modes

  • Hundreds of rules with no owner, type, purpose or retirement date.
  • Rules evaluated on immature labels, overstating precision.
  • No holdouts, so the counterfactual is unknown.
  • Tactical incident rules that become permanent.
  • Rules referencing features that changed meaning upstream.
  • Production changes without peer review or audit trail.
  • Fail-open defaults on critical payout decisions when a dependency times out.
  • Threshold details leaking through customer messages or API errors.

Regulatory and policy notes

  • For model risk management, SR 26-2 (Fed, OCC and FDIC, April 17, 2026) superseded SR 11-7 and narrowed the model definition to complex quantitative methods, excluding simple arithmetic and deterministic rule-based processes. Hand-set rules therefore usually sit under rule governance rather than MRM, but rules with statistically calibrated thresholds or rules layered on model scores are a gray area worth documenting, and excluded tools still need controls when they drive material decisions. (Under SR 11-7's broader definition, some institutions had put complex rule sets in the model inventory.) See Model Risk Management and Rule Governance and Change Management.
  • Reason codes support customer explanations, adverse action notices and regulatory inquiries.
  • Rules using location, language or device attributes can create disparate impact. Review them for proxies (Privacy and Data Use in Fraud Prevention).
  • For broker-dealers, FINRA expects reasonably designed supervisory systems, and documented rule logic and change management support this (Broker-Dealer Obligations (FINRA and SEC)).

Mechanisms addressed

Rules touch nearly every mechanism. They're strongest for Card Testing, Credential Stuffing, Business Logic Exploitation, Promo Code Abuse, Sign-Up Bonus Abuse, Instant Funding Abuse (Kiting), Payout Redirection, Account Takeover (ATO), Receipt Fraud (Cashback) and Real-Time Payment Rail Fraud.

Machine Learning Models · Real-Time Transaction Risk Scoring · Velocity and Exposure Limits · Negative Lists and Deny Lists · Manual Review Queues · Case Management Systems · Graph Analytics · Kill Switches and Circuit Breakers · Controls Index

See also Vendor Selection and Evaluation and Open Source Tools for Fraud Teams.

Sources and further reading