01Historical test. New observations. Different questions.
A backtest asks what a rule would have done on recorded prices under specified assumptions. Paper trading observes the same rule as new prices arrive. Comparing the two can reveal timing mistakes, unclear rules and operational issues, but both remain simulations.
02Make the AI-generated rule inspectable
Ask for explicit entries, exits, sizing and decision timing. Read the code or the structured rule before starting the experiment. “Buy dips” needs a definition of a dip, an eligible market and a position limit. Keep a version identifier so you know which rule generated each decision.
03A useful review includes the quiet periods
A bot that produces no trades may be behaving correctly. Review whether the market ever satisfied the rule. Track data gaps, duplicate decisions and restarts alongside simulated returns. If you change the strategy, start a new evaluation window rather than blending two versions.