Research basics
How to read a backtest without fooling yourself
Profit factor and win rate are useful clues, not a verdict. Learn which parts of a report deserve your attention.
Start with the test design
Before looking at the equity curve, write down the instrument, timeframe, date range, spread model, commission, swap, execution assumptions, and whether the data includes real ticks. A result without its assumptions cannot be reproduced or fairly compared.
The test should use information that would have been available at the time of each trade. Entries at a future close, accidental look-ahead, or an unrealistically perfect fill can make a strategy look better than it is.
Read beyond the headline metrics
Win rate answers how often trades were profitable. It does not tell you whether the average win is large enough to pay for the average loss and trading costs. Profit factor compares gross profit with gross loss, but it can be distorted by a small number of large trades.
- Expectancy: average amount won or lost per trade after costs.
- Maximum drawdown: the deepest historical decline and how long recovery took.
- Trade count: whether the sample is large enough to mean anything.
- Year-by-year results: whether one market regime did all the work.
Separate development from validation
The period used to create or tune a strategy is in-sample data. A separate out-of-sample period is a more honest check because the rules were not selected against it. Walk-forward testing repeats that idea across several historical windows and shows whether the logic can adapt without being rewritten for every period.
Parameter stability matters too. If only one exact combination works and nearby settings fail, the result may be curve-fit. A robust strategy usually has a sensible region of acceptable settings rather than one magical number.
Use stress tests, then stay humble
Monte Carlo tests can reshuffle trade order, vary execution, or perturb outcomes to show how much the result depends on luck. They do not predict the future, but they can expose a system that only survives in its most favourable sequence.
Even a careful backtest cannot model every future market regime, broker outage, spread event, or implementation mistake. Treat it as evidence for a measured experiment, not a promise of returns.
The honest question is not ‘does the backtest make money?’ It is ‘what evidence would make this result stop being believable?’
Discuss this article
Ask a setup question, share a backtest, or compare notes with other algorithmic traders. Use a display name; your email remains private.
Create an account or sign in above to join the conversation.
Loading discussion…