{
  "id": 13419360,
  "title": "Backtesting a Polymarket copy trading bot without fooling yourself",
  "url": "https://urgent.news/2026/10/10/backtesting-a-polymarket-copy-trading-bot-without-fooling-yourself",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-10-10T13:27:40.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/ekocam/backtesting-a-polymarket-copy-trading-bot-without-fooling-yourself-4fec"
  },
  "original_language": "en",
  "account": "Polymarket copy trading bots did not prove profitable across five sports, as shown by a backtest conducted by the author. The core of the test involved replicating a wallet's first $20 purchase in a market at a price between 0.30 and 0.85, paying the sports taker fee, and holding the position until resolution.\n\nTo set up the backtest, the author outlined five steps. First, they defined a copy as a wallet's first $20 purchase in a market at a specific price range. The copy was implemented by buying the same outcome for $10 at the wallet's price plus 1 cent, paying the sports taker fee, and holding the position until the end of the month. The code for this calculation was provided in the source.\n\nSecond, the author selected a specific period for backtesting and measured the performance of wallets during the subsequent month. This was done by ranking wallets based on their copy results from the two months preceding the test month, then copying only in the test month. The selection period was fixed beforehand, and during the running of the test, the test month's data was excluded from the selection.\n\nThird, the author checked whether a wallet's rank in one period carried over to the next month. They ran Spearman correlation tests for MLB, NFL, college football, League of Legends, and Valorant, finding that the correlation coefficients were close to zero in most cases. This suggests that past performance is not a reliable predictor of future performance for individual wallets.\n\nFourth, the author analyzed the baseline performance of wallets before any selection rule was applied. They found that even the largest whale wallets lost 31 to 63 cents per $10 in every test month. This baseline loss was significant, and any selection rule must still perform better than this baseline in order to be considered profitable.\n\nFifth, the author identified a potential trap in how wallet labels are computed. Analytics sites, including the author's own platform, label wallets based on factors like \"smart money\" status, number of resolved markets, win rates, and profit factors. However, these labels are calculated from the wallet's full history, including the months being backtested. This means that wallets deemed \"smart money\" in hindsight may have already lost money in the test month and were not included in the backtest, leading to an inflated performance. The author advises that any feature used to select a wallet must be computable from data strictly before the pick date.\n\nLastly, the author urged readers to ensure the reproducibility of their backtest. They provided a script (copy_backtest.py) that runs the walk-forward backtest on the OrcaLayer API for any league. This script requires a Premium API key, but the author also noted that the free OrcaLayer MCP server can be used to verify the results with a standard API key.\n\nIn conclusion, the backtest results demonstrate that copy trading bots do not consistently generate profits across multiple sports when tested using strict methodologies. The author emphasizes the importance of avoiding common pitfalls in backtesting, such as using future data to compute wallet labels and relying on past performance to predict future results.",
  "summary": "Copy trading is the most common bot idea on Polymarket: find the wallets that win and buy what they buy. We tested it on five sports (MLB, NFL, college football, League of Legends and Valorant) and it did not survive. The full results are on our blog and the data and script are on GitHub . This post is about the backtest itself: how to set it up so it can tell you \"no\", and the one mistake that…",
  "key_points": [
    "Copy trading bots showed no profitability across five sports in backtest.",
    "Backtest methodology involved replicating first $20 purchase at specific price range.",
    "Past performance unreliable predictor of future results for individual wallets."
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}