Tokenomics: Why making AI pay is tricky

The challenge of monetizing AI services stems from the intricate economics surrounding tokens, the fundamental units powering Large Language Models (LLMs) and agentic AI. Although firms like Microsoft, Google, and Anthropic have sunk substantial resources into crafting these models, they seek to recoup their investments by offering premium versions with enhanced functionalities. However, determining an appropriate pricing model for these services proves difficult due to the unpredictable nature of token consumption.

Token consumption, which fluctuates based on subtle variations in prompts, has surged alongside the proliferation of agentic systems. These systems leverage multiple AI agents to make decisions and take actions, further escalating both token use and unpredictability. While the cost per token has declined, the sheer volume of tokens consumed has skyrocketed, with Goldman Sachs predicting a 24-fold increase by 2030.

Companies, including Microsoft and Uber, have grappled with token costs, often exceeding expectations and leading to unexpected expenses. The unpredictability of token expenditure poses significant challenges for businesses, particularly as they experiment with AI internally. Companies are exploring various strategies to manage these costs, such as utilizing personal accounts or carefully refining their prompts. However, these solutions may be short-lived as pressure mounts on AI platforms to demonstrate profitability.

As companies integrate AI into their products, the potential for ballooning AI costs intensifies. Managers must consider not only core software development but also additional tasks such as testing, security, and implementing guardrails. While the value derived from token use may outweigh the costs, companies still need to pass these expenses onto their customers.

Finding an appropriate pricing structure remains a perplexing dilemma, with options ranging from simple price hikes to more complex arrangements like charging for bundles of incidents. Nonetheless, the ever-changing pricing strategies of LLM providers further complicate matters, leaving companies uncertain about how to budget and pass on costs to their customers.