While AI’s promise is boundless, the path from concept to production can often reveal hidden costs and challenges. According to the recent Gartner® article, CFOs Must Overcome 4 Key Stalls to Unlock Enterprise Value AI: “cost overruns, decisions-making risks, loss of trust and rigid stakeholder mindsets all threaten the promised return from accelerating investments in AI.” While aimed predominantly at CFOs, there is a message here - and lessons within the report - for all.
A regular pitfall is the underestimation of expenses associated with ‘productionising’ AI - putting it into action.
Bringing AI from concept to production can raise unforeseen challenges and costs. While developing a small-scale, proof-of-concept AI is manageable, expanding these systems for full business use can become complicated and costly. Traditional financial forecasts frequently overlook the multifaceted expenses associated with full AI integration and maintenance.
A significant yet overlooked cost factor is the transactional nature of AI Agentic frameworks. Many AI Agent vendors and platforms will charge organisations on a ‘transactional plus consumption’ basis. As businesses dive into multi-modal AI deployments, encompassing vision, language and sensor data, these transactional costs can escalate quickly. This is especially true in sectors employing advanced AI features such as real-time image analysis, reasoning or speech.
The initial design of AI can also greatly affect costs. Rushed or poorly planned AI solutions often lead to unexpected expenses. Using models mismatched to use cases, inefficient approaches to training models, inferencing methods, data handling or processing, and excessive consumption costs from poor design can all cause monthly costs to skyrocket. With many organisations still experimenting and building initial versions of AI systems, inadequate model design or improper technology application could result in significant monthly bills if not managed correctly.
The open versus closed model debate also adds layers to cost considerations. Though open-source models offer customisation and cost-effective initiation, they entail ongoing maintenance expenses - costs companies might avoid with proprietary models requiring significant upfront investments. As AI technology develops, companies need to carefully consider these options, possibly using smaller, cost-effective models for specific tasks. It is likely we will see the increased use of Small Language models (SLMs) for certain use cases as costs rise, prompting reconsideration of current frameworks. Gartner® puts it simply: “enterprises experience economies of scale with experimentation and rollout costs, but ongoing costs continue to compound over time.”