Scoring a decade of Wall Street and political-risk forecasts: being wrong wasn’t their biggest problem

In a month, Wall Street will release its forecasts for 2027. Before investing, examine the outcomes of last year's predictions. The general consensus was that the Federal Reserve would reduce interest rates, leading to cheaper borrowing. However, this did not happen; borrowing became more expensive instead. If you had waited to purchase a home based on this forecast, your monthly payments would now be $314 higher for a median-priced home.

It's tempting to dismiss this as an unfortunate year when no one keeps score. To evaluate their performance, I graded 135 forecasts over the past decade, published by fifteen institutions such as Morgan Stanley, Citi, Goldman Sachs, Teneo, and the IMF, against a public rubric, with a second researcher scoring each independently.

Only 16% of forecasts identified the event that later impacted markets. Only three identified how the event would affect a portfolio, which is crucial for investors to act upon. Even the yearly S&P 500 target, a number banks typically commit to, performed worse than a coin flip: they predicted gains in 2022 when stocks fell 19%, and were overly pessimistic in 2023 when they rose 24%.

They got it wrong twice, in opposite directions. Every December, financial institutions publish outlooks for the upcoming year to guide investment decisions. These forecasts come without odds, deadlines, or accountability. Last year's forecasts included vague statements like "AI is a risk" and "Trump is a risk." While these may be true, they are not forecasts but rather themes.

People find comfort in something that feels calculable, even if it adds no accuracy. These forecasts can influence your savings, even if you never read them. Pension funds, endowments, and 401(k) plans invest trillions of dollars based on these reports. When consensus leans one way, so does the money. In 2023, most major banks forecasted a recession that never occurred.

A record amount of cash was held in money-market funds while stocks continued to rise. Savers and retirees missed out on those gains. The forecasters never had to answer for their call. The outlook format was developed for a period when political risk was mainly a concern for emerging markets. Now, a tariff announced in Washington and a policy shift in Tokyo have caused markets worldwide to reprice in a single afternoon.

The incentives behind these decisions may also be hidden. A leader might prolong a war that impoverishes his country because ending it threatens his coalition, his liberty, or his fortune. An outlook based on his country's economic interests may overlook what is actually motivating him. You may be wondering about the analyst who got it right.

Consider Jiang Xueqin, a Yale-educated lecturer who gained fame online for predicting the US-Iran war and the closure of the Strait of Hormuz. His call was accurate, but he lacks a denominator to measure his success. Jiang has made hundreds of predictions, most of which are unresolved or incorrect. One hit does not prove his accuracy; it's an anecdote with good presentation.

In finance, investors have paid fund managers for stock-picking skills in the past. However, when a benchmark was introduced, nine out of ten active large-cap funds underperformed the S&P 500 they were paid to beat. Passive funds now hold more US fund assets than active ones, and fees have decreased. The year-ahead outlook has not faced the same scrutiny because nobody has kept track of the score.

Now, somebody has, and anyone can run the same test on next year's forecasts. Keeping score does not require demanding certainty. Before the recent World Cup, Opta's model predicted the four most likely semifinalists: Spain, France, England, and Argentina, all of which made it. The model was based on observable data: player performance and past results.

A missed penalty or a red card could still change the outcome. While a forecast does not have to be accurate every time to be valuable, a useful outlook should tell you which headlines to watch for and how your money should move in response. It should assign a number when the evidence supports it, rather than simply providing a list of risks. The goal is not to predict the exact event but to identify the signal that shifts the odds.