Real Backtesting vs Fake Backtesting

In this solo presentation, Adrian Reid outlines three progressive tiers of backtesting for traders. The first tier is manual chart‑based testing, where a trader visually marks buy and sell signals on a price chart and records outcomes by hand. The second tier moves to systemized, rule‑based backtesting: trading rules are coded and applied automatically to decades of market data across thousands of instruments, allowing the construction of a simulated portfolio and the measurement of performance metrics, especially drawdowns. Reid stresses that understanding drawdowns is crucial because surviving long‑term trading hinges on staying in the game—avoiding account wipe‑outs. The third, advanced tier combines multiple distinct trading systems into a single portfolio and backtests their interaction, providing insight into diversification benefits and how the systems affect each other’s risk and return. Throughout, the talk emphasizes the necessity of rigorous, data‑driven backtesting to ensure survivability and long‑term success.











