Third-Party Research & Methodology Only

This section shares summaries of third-party academic research and descriptions of quantitative models. The content represents the findings of the original researchers, not the opinions or recommendations of Foxholm Financial. Foxholm Financial does not publish hypothetical or backtested performance metrics on its quantitative research pages. All content is restricted to methodology, signal construction, factor logic, and risk architecture. SEC rules require that investment advisers not present misleading performance data, and our methodology-only approach reflects that standard and the firm's fiduciary obligations.

AML Transaction Monitoring

RegTech Rule-Based & ML Risk Scoring Anomaly Detection
Robert Stowe
Robert Stowe, AAMS® Investment Advisor

Anti-money laundering (AML) transaction monitoring uses automated systems to scan financial transactions for patterns that may indicate money laundering, terrorist financing, or other illicit activity. These systems flag suspicious transactions for human review, helping financial institutions meet their legal obligation to detect and report potentially criminal behavior.

Every bank, broker-dealer, and money services business in the United States is required to maintain a transaction monitoring program under the Bank Secrecy Act (BSA). The challenge is scale: a mid-size bank may process millions of transactions daily, and manually reviewing each one is impossible. Transaction monitoring systems solve this by applying rules, statistical models, or machine learning to narrow millions of transactions down to a manageable set of alerts that compliance officers can investigate.

Conceptual Framework

Transaction monitoring sits at the intersection of regulatory compliance and data science. The core problem is a classification task: given a stream of financial transactions, determine which ones are suspicious and which are normal business activity. This is harder than it sounds because illicit transactions are intentionally designed to look like legitimate ones.

Monitoring systems have evolved through three generations. First-generation systems used simple threshold rules (flag any cash deposit over $10,000). Second-generation systems added behavioral profiling (flag transactions that deviate from a customer's historical pattern). Third-generation systems incorporate machine learning to identify complex patterns that static rules miss.

Core Assumptions

All transaction monitoring systems rest on a set of foundational assumptions, each of which introduces risk when violated:

  • Illicit activity leaves detectable traces: The fundamental premise is that money laundering produces transaction patterns that differ from legitimate activity. Sophisticated launderers deliberately structure transactions to mimic normal behavior, which limits how much any automated system can detect.
  • Historical patterns predict future behavior: Behavioral baselines assume that a customer's past activity is a reliable indicator of their normal activity. Legitimate changes in business operations (a company expanding internationally, for example) can trigger false alerts if the baseline does not update.
  • Rules and thresholds remain current: Regulatory thresholds and detection rules must reflect the latest typologies (patterns of criminal behavior). Criminals adapt their methods over time, and static rules eventually become less effective.
  • Data quality is sufficient: Monitoring systems depend on complete, accurate, and timely transaction data. Missing fields, delayed feeds, or inconsistent formatting can cause the system to miss genuine risks or generate noise.

Detection Architecture

A transaction monitoring system processes activity through multiple detection layers. Each layer applies a different analytical technique, and the combination provides broader coverage than any single method alone.

Layer 1
Threshold Rules
Layer 2
Behavioral Profiling
Layer 3
Network Analysis
Layer 4
Alert Scoring
Layer 5
Case Management

Threshold Rules

The simplest detection layer applies fixed rules to individual transactions. The most well-known example is the $10,000 Currency Transaction Report (CTR) threshold mandated by the BSA: any cash transaction at or above $10,000 must be reported to FinCEN (the Financial Crimes Enforcement Network).

Threshold rules also target structuring, sometimes called "smurfing," where a person breaks a large transaction into smaller ones to avoid the reporting threshold. A common structuring rule flags multiple cash deposits just below $10,000 made within a short time window. For example, three deposits of $9,500 within a week to the same account would trigger an alert because the aggregate amount exceeds the threshold and the individual amounts appear deliberately sized to avoid reporting.

Behavioral Profiling

Behavioral profiling compares each transaction against a baseline of what is normal for that customer. The system builds a profile from historical data: average transaction size, typical counterparties, usual geographic footprint, and expected transaction frequency. Activity that deviates significantly from the profile triggers an alert.

This approach catches patterns that fixed rules miss. A $5,000 wire transfer is unremarkable for a wholesale distributor but unusual for a personal checking account that normally sees only payroll deposits and small debit transactions. The same dollar amount produces different risk assessments depending on who is sending it.

Network Analysis

Network analysis examines relationships between accounts, entities, and transactions rather than looking at transactions in isolation. Money laundering often involves chains of transfers across multiple accounts, sometimes through shell companies or intermediaries, to obscure the origin of funds. Network analysis maps these flows and identifies clusters of connected accounts that exhibit suspicious patterns.

Graph-based methods represent accounts as nodes and transactions as edges. Algorithms then search for structures associated with laundering: rapid pass-through accounts (money arrives and leaves quickly), circular flows (money returns to or near its origin after passing through intermediaries), and fan-out patterns (one source distributing to many recipients). These structures are difficult to detect with rules that examine only individual transactions.

Alert Scoring and Prioritization

Raw detection layers produce far more alerts than compliance teams can investigate. A typical monitoring system at a large bank generates thousands of alerts per day, and the vast majority turn out to be false positives (legitimate activity that happened to match a detection pattern). Alert scoring assigns a risk score to each alert so analysts can focus on the highest-risk cases first.

Scoring models combine multiple factors: the severity of the rule that triggered the alert, the customer's overall risk rating, the geographic risk of the counterparty, whether the customer has prior suspicious activity reports (SARs), and how far the transaction deviates from the customer's baseline. Machine learning models can learn from historical analyst decisions (which alerts were escalated vs. closed as false positives) to improve scoring over time.

Risk Architecture

Transaction monitoring systems face a fundamental tension between catching illicit activity (true positives) and avoiding excessive false alerts (false positives). Both types of errors carry significant consequences.

Model Risk

The primary risk is that the monitoring system fails to detect actual money laundering. This can happen because detection rules have not been updated to reflect new laundering techniques, because data quality problems cause transactions to bypass the monitoring engine, or because the alert scoring model systematically suppresses genuine risks.

Regulators evaluate AML programs through examinations and enforcement actions. A system that produces too few alerts may indicate inadequate monitoring, while a system that produces too many may indicate that the institution is not effectively investigating the alerts it generates. Both extremes draw regulatory scrutiny.

Known Limitations

Limitations to Consider

  • False positive burden: Industry-wide, false positive rates for AML alerts often exceed 90%. This means compliance teams spend the vast majority of their time investigating activity that turns out to be legitimate. High false positive rates increase operational costs, slow response times for genuine cases, and contribute to analyst fatigue.
  • Adversarial adaptation: Unlike most statistical modeling problems, the subjects of AML monitoring actively work to evade detection. As detection rules become known, laundering techniques evolve to circumvent them. This creates an ongoing arms race between monitoring systems and financial criminals.
  • Explainability requirements: Regulators and courts require that institutions explain why a transaction was flagged or, critically, why it was not flagged. Complex machine learning models that produce accurate results but cannot explain their reasoning may face regulatory pushback.
  • Cross-institution blindness: Each institution monitors only its own transactions. A laundering scheme that distributes activity across multiple banks may not trigger alerts at any single institution because no individual bank sees the complete picture.
  • Baseline drift: If a customer gradually shifts their behavior over months, the behavioral baseline shifts with it. This allows a slow escalation of suspicious activity to become the "new normal" without ever triggering a deviation alert.

Practical Considerations

Regulatory Landscape

AML transaction monitoring requirements in the United States flow from the Bank Secrecy Act, as amended by the USA PATRIOT Act and the Anti-Money Laundering Act of 2020. FinCEN sets the rules; federal banking regulators and the SEC examine institutions for compliance.

The regulatory framework requires covered institutions to file Currency Transaction Reports (CTRs) for cash transactions over $10,000 and Suspicious Activity Reports (SARs) when they detect activity that may involve money laundering or other financial crimes. The monitoring system is the primary mechanism for identifying SAR-reportable activity.

Tuning and Validation

Detection rules and scoring models require ongoing calibration. Thresholds set too low generate excessive false positives that overwhelm analysts. Thresholds set too high allow suspicious activity to pass undetected. Regulators expect institutions to conduct periodic model validation, including back-testing rules against known cases and above/below-the-line testing (analyzing transactions just above and just below detection thresholds to verify that the thresholds are appropriately set).

Tuning is not a one-time exercise. Changes in customer mix, product offerings, geographic exposure, and criminal typologies all require corresponding adjustments to the monitoring system. Institutions typically review and recalibrate their detection scenarios on an annual cycle, with ad-hoc adjustments when new typologies emerge or regulatory guidance changes.

Machine Learning Applications

Machine learning offers the potential to reduce false positives while maintaining or improving detection rates. Supervised learning models trained on historical analyst decisions can learn which combinations of factors are most predictive of genuinely suspicious activity. Unsupervised methods like clustering and anomaly detection can identify unusual patterns that no pre-defined rule anticipated.

The practical barrier to machine learning adoption in AML is the explainability requirement. A compliance officer filing a SAR must articulate why the activity is suspicious. "The model flagged it" is not a sufficient explanation. This has pushed the industry toward interpretable models (logistic regression, gradient-boosted trees with feature importance) rather than opaque ones (deep neural networks), or toward hybrid architectures where machine learning scores alerts that are then explained by rule-based logic.

Further Reading

Meet with a Fiduciary Advisor

Foxholm Financial is a fee-only registered investment adviser serving Georgia. We bring quantitative rigor to every client engagement. Explore our services or get in touch to discuss how we can help.

Institutional Clients

Are you an institution or FinTech firm? Learn about our Quantitative Consulting Services.

Disclaimer

This content is for educational and informational purposes only and does not constitute an offer to sell or a solicitation of an offer to buy any securities. Nothing herein constitutes investment advice or recommendations tailored to your individual situation. All investments involve risk, including the potential loss of principal. Past performance is no guarantee of future results. Information presented is believed to be factual and up-to-date, but Foxholm Financial does not guarantee its accuracy and it should not be regarded as a complete analysis of the subjects discussed. Before making investment decisions, consult with a qualified financial advisor who can evaluate your specific circumstances.

On This Page