Your Bot Used To Work. Now It Doesn't. Here's Why.

Your AI trading bot crushed it in backtests. 47% annualized return, 12:1 risk-reward, near-zero drawdown. You deploy it live. Three months later: flat at best, red at worst. The strategy didn't change. Your bot did. This is model decay—and it's why most trained bots fail.

The problem isn't your strategy. It's that your model learned patterns in one market and you're trading it in a different one. Markets shift. Models age. Almost no one retrains.

What Is Model Decay?

Model decay happens when a trained AI model loses predictive power over time. Your bot learned historical patterns—price action, volume, correlations, volatility regimes. Then the market changed. The patterns shifted. Your model is still using yesterday's logic in today's market.

This is different from a bad strategy. A bad strategy is unprofitable by design. A decayed model was profitable in one market regime and stopped working in another. The bot doesn't know it's broken. It keeps trading anyway.

From idea to a system that trades for you1Your strategy2Custom build3Full backtest4Live automationNo code on your end. You get a working system, a backtest report, and ongoing support.
How Alorny turns a trading idea into a live, automated system.

Why Markets Change Faster Than Models Age

Markets are non-stationary. Regime shifts happen constantly. A Fed rate hike changes volatility overnight. A stock split alters liquidity structure. A black swan event rewires correlation matrices. Macro sentiment flips from risk-on to risk-off in hours.

Your model trained on the 2023 bull run doesn't know how to trade 2024 sideways chop. The AI learned patterns in one data distribution and you're deploying it in a completely different one. This is distribution shift—the statistical properties of the market today don't match the training data anymore.

Most traders think their bot "stopped working." Reality: the bot is working exactly as designed. It's designed for a market that no longer exists.

The Hidden Cost: How Decay Destroys Your Edge

A 2% edge in one regime becomes a 2% loss in another. Say your bot was trained to exploit mean reversion in high-volatility environments. It works flawlessly when VIX is elevated. Volatility compresses. The edge reverses. Instead of reverting to the mean, prices keep trending. Your bot is now selling support and buying resistance—exactly backwards.

The decay is invisible to the bot. No error logs. No warnings. It just trades. And loses.

Research in quantitative trading shows models degrade fastest in:

The worst part: decay is gradual at first. A 47% return drops to 30%. Then 15%. Then flat. By the time you notice, you've left 20%+ on the table.

How to Spot Model Decay Before It Costs You

Real-time monitoring is non-negotiable. Track these five metrics:

  1. Win rate — drops below your training-set average? That's the first signal
  2. Profit factor — gross wins divided by gross losses should stay stable; if it tanks, decay is active
  3. Maximum drawdown — trained model had 12% max; now it's 18%? Distribution shift detected
  4. Return per trade — average win size shrinking or average loss size growing? Model is degrading
  5. Out-of-sample vs in-sample performance — a trained model should perform close to backtest (±10%). If live is 30% worse, you're in a regime the model never learned

Set alerts on these thresholds. The moment your win rate dips 3–5% below average, your bot is signaling regime change. Don't ignore it.

The Retraining Imperative: The Only Path Forward

The only answer is periodic retraining on fresh market data. This is not parameter tuning. Tuning optimizes within a regime. Retraining rebuilds the model from scratch on new data to capture the current regime.

Here's the process:

  1. Collect last 3–6 months of live market data
  2. Run a full backtest on fresh data to see how the strategy performed in the latest regime
  3. Retrain the model on this new data (or recalibrate parameters if rule-based)
  4. Validate on out-of-sample data from the most recent market period
  5. Deploy the retrained bot

Without retraining, your edge erodes. With it, you stay ahead of regime shifts. The catch: retraining requires expertise. You need to know which indicators matter, how to avoid overfitting, how to validate without bias, and when the strategy itself (not just the model) is no longer profitable.

Five Mistakes That Accelerate Decay

Mistake 1: Ignoring out-of-sample performance. You backtest on 2 years of data. It's perfect. You test on the most recent 3 months (out-of-sample). It's mediocre. That gap is model decay announcing itself. Traders ignore it and deploy anyway.

Mistake 2: Confusing regime shift with broken strategy. Your bot stops working. You assume the strategy failed. You rebuild from scratch. Wrong. You probably just needed a retrain. You threw away a working strategy because you didn't diagnose the real problem.

Mistake 3: Retraining on biased data. You retrain on cherry-picked periods that show great performance. You overfit. The model works on your biased slice and fails everywhere else. Retraining must be systematic—use all recent data, not just the periods that look good.

Mistake 4: No monitoring infrastructure. You deploy the bot and forget about it. Six months later you check and it's losing money. By then you've left money on the table. Real-time monitoring catches decay while it's happening, not after.

Mistake 5: Retraining too frequently. Retraining every week is overfitting. Retraining every 2 years is under-training. The sweet spot is typically every 3–6 months depending on your strategy's sensitivity to regime shifts.

A coded edge compounds while you sleepTime in market →Consistency
Illustrative: automated rules execute consistently, with no emotion gap.

Here's the Thing: This Requires Real Expertise

Retraining isn't just running your backtest on new data. It requires:

Most traders fail at retraining. They do it ad-hoc, get it wrong, and lose money faster than if they'd left the original bot alone. We've completed 660+ trading EA projects on MQL5. Every single one includes a full backtest report so you can monitor performance and spot decay early. When decay hits, you have the data you need to retrain or rebuild. We deliver a working demo in 45 minutes and full production EA in hours.

The traders who retrain quarterly stay ahead. A fresh model every 90 days keeps pace with market shifts. Most traders never even monitor performance. That's why they lose. You don't have to be most traders.

Key Takeaways: