Validation, Methodology & Research
Discipline before signal.
The research protocol that decides what becomes a signal — walk-forward, expanding window, monthly refit, robustness testing, and continuous monitoring.
01
Walk-Forward Testing
Every signal is evaluated under strict walk-forward protocol — no peeking, no in-sample tuning of out-of-sample windows.
02
Expanding-Window Validation
Models are validated across an expanding history so each call is judged against everything previously knowable.
03
Historical Regime Analysis
Behaviour benchmarked across full bull, weakening, correction and recovery cycles since the late-1990s.
04
Monthly Refit Methodology
A controlled, calendared refit cadence — frequent enough to adapt, slow enough to prevent overfitting to recent noise.
05
Signal Robustness Testing
Each signal is stress-tested against parameter perturbation, sub-period sampling and feature ablation before shipping.
06
Drawdown Analysis
Peak-to-trough behaviour studied around every historical trigger — what the call would have caught, missed, and signalled too early.
07
Recovery Cycle Analysis
RRS confirmation behaviour mapped across recoveries — characterizing both true confirmations and quiet false-starts.
08
Multi-Regime Performance Review
Precision, hit-rate and forward-window distributions reported per regime, not just as a single blended number.
09
Research Discipline Framework
Hypothesis → protocol → walk-forward → robustness → review. Every change passes the same gates, in the same order.
10
Adaptive Validation Procedures
When the data-generating process changes, validation windows and refit cadence adapt — explicitly, not silently.
11
Continuous Model Monitoring
Live signals are monitored for pre-trigger drift, conformal-uncertainty widening and out-of-distribution conditions.
12
Structural Research Architecture
A versioned research stack where every signal, refit and decision is logged and reproducible end-to-end.
Important disclosures
All precision, false-positive and forward-window figures are derived from walk-forward validation and describe historical signal behaviour; they do not guarantee future results. RegimeSignal™ is a market intelligence and research product, not investment advice.
Early warning, before consensus.
Get access to the RegimeSignal™ framework — four walk-forward validated signals and Bull / Bear Velocity gauges for the S&P 500.