How soaring AI bills are vexing Wall Street Executives
The AI arms race is colliding with bank budgets, as executives try to balance pressure to keep up with competitors.
The rapid adoption of artificial intelligence (AI) by Wall Street executives has led to unexpected financial challenges for many chief financial officers (CFOs). Initially, no technology team was given a blank check to explore AI implementation, but the early enthusiasm for this technology quickly turned into a burden of surprise bills.
Controlling costs associated with AI has now become a top priority in financial institutions, particularly in the banking sector where technology budgets are already stretched thin due to competing demands such as legacy IT modernization and cybersecurity.
One of the most promising areas for AI in banking is agentic AI, which can autonomously tackle complex tasks. However, the unpredictable nature of the computing power required for each task makes it difficult to forecast costs. Bhavi Mehta, a partner at Bain & Co. and its global lead for advanced analytics in financial services, highlighted the lack of understanding among organizational stakeholders about the costs involved in implementing agentic AI.
"I actually don't think anybody in the organization has a good handle on it - if I am going to do XYZ, what is going to be my cost," she said.
As AI systems evolve and become more sophisticated, the variability in the number of tokens required for a given task increases, further complicating cost estimation. This makes it crucial for banks to find ways to manage AI-related expenses while still deriving business value from these advanced technologies.
Written by urgent.news from Japan Times's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
