Back to blog
Ai News

Finops Practices

6 min read

Cloud bills have gotten weirder. It's not just that infrastructure spend keeps climbing — it's that a growing share of it is now AI and GPU consumption, which behaves nothing like the predictable, provisioned compute FinOps teams built their playbooks around. Traditional cost management assumed you could forecast usage from historical patterns and rightsize accordingly. AI workloads blow that assumption up: a single product launch, a viral feature, or a model upgrade can 3x your inference bill overnight with no warning.

That shift is why FinOps in 2026 looks different from FinOps even two or three years ago. It's no longer a quarterly cost-review ritual owned by a finance team chasing engineering for explanations. It's become a day-to-day operating discipline that spans engineering, finance, and product — and the organizations getting it right are the ones treating it that way.

Why FinOps changed shape

For years, FinOps was mostly about visibility and rightsizing: tag your resources, track spend by team, kill idle instances, buy reserved capacity where it made sense. Useful work, but mechanical. The 2026 shift is about scope. Flexera's State of the Cloud 2026 report puts wasted IaaS and PaaS spend at around 29% — still high, but down after five years of steady decline, which tells you the basics are finally sticking industry-wide. The new frontier is AI consumption: more than half of FinOps practitioners surveyed in the State of FinOps 2025 report now say they incorporate AI usage into their cost practices, and over 60% actively manage SaaS spend as part of the same discipline.

That's a meaningfully bigger remit than "watch the AWS bill." It means FinOps teams are now expected to have opinions on which LLM provider a product team should use for a given feature, how token costs scale with usage, and whether a self-hosted model is cheaper than an API call once you factor in GPU time. This is genuinely hard because AI pricing models are still shifting under everyone's feet — providers change per-token rates, introduce new tiers, and deprecate old ones on their own schedule.

Practices that actually work in 2026

Map cloud budgets to business KPIs, not just team budgets. The old model — "engineering gets $X/month, spend it how you want" — breaks down when a chunk of that spend is highly variable AI inference cost tied directly to usage. The better model ties cost to the business metric it's driving: cost per qualified lead, cost per support ticket resolved, cost per document processed. That reframes a cost conversation as a unit-economics conversation, which is a conversation product and finance teams can actually have together productively.

Fix tagging before anything else. This sounds boring because it is boring, and it's still the single biggest blocker to good FinOps. If you can't attribute spend to a team, environment, or feature, you can't optimize it — you're negotiating blind. Publish an explicit tag policy across every provider you use (cloud, SaaS, AI APIs) and enforce it at resource-creation time rather than trying to backfill it later. Backfilling tags on six months of untagged spend is a special kind of misery.

Treat AI consumption as its own cost category with its own owner. Don't let LLM API spend get buried inside a generic "cloud infrastructure" line item. Track it separately — by model, by endpoint, by feature — because the cost-per-unit economics of AI features are wildly different from traditional compute and need different levers: prompt optimization, caching, model tier selection, batching.

Automate the boring remediation. Idle resource cleanup, unused reserved capacity, oversized instances — this is exactly the kind of repetitive pattern-matching work that machine learning-based FinOps tooling is now handling automatically rather than through manual monthly reviews. If your team is still doing this by hand in 2026, that's hours better spent on the harder unit-economics work above.

Build cross-team accountability, not a finance gatekeeper. The organizations with mature FinOps practices don't have finance approving every deploy. They have engineering teams who see their own cost dashboards in the same place they see their performance dashboards, with alerts that fire when a metric moves in the wrong direction — the same way you'd alert on latency or error rate. Cost becomes an engineering signal, not a monthly surprise from finance.

Forecast in ranges, not points, for anything AI-adjacent. Point forecasts ("we'll spend $40k next month") don't survive contact with variable AI usage. Better to forecast a range with named drivers of the upside and downside — a marketing campaign that could double signups, a feature that could 5x document-processing volume — so finance isn't blindsided when the range's upper bound hits.

The waste is still mostly the boring stuff

It's worth saying plainly: despite all the AI-era complexity, the biggest chunk of that ~29% wasted spend Flexera measured is still unglamorous — idle resources, oversized instances, unused commitments. AI cost management is the new frontier, but it doesn't replace the fundamentals. Teams that skip straight to "let's optimize our LLM token spend" while ignoring the zombie EC2 instances running in a forgotten dev environment are optimizing the wrong thing first.

A reasonable order of operations for a team getting serious about FinOps in 2026: get tagging and attribution right, kill the obvious waste (idle resources, oversized reservations), then build the unit-economics view that ties spend to business outcomes, and only then start optimizing the AI-specific cost levers (model selection, prompt/token efficiency, caching layers). Skipping steps tends to produce dashboards nobody trusts, which is worse than no dashboard at all.

Why this matters beyond the finance team

For smaller companies and teams shipping AI features without a dedicated FinOps function, the same principles apply at a smaller scale. If you're running an AI-powered chatbot, support tool, or document processor on your site, knowing your cost-per-conversation or cost-per-document matters just as much as it does for a large enterprise — it's just tracked in a spreadsheet instead of a dashboard. Tools that let clients bring their own AI API key rather than marking up usage (as opposed to a black-box SaaS subscription) also make this easier to reason about, since the cost visibility lives with whoever's actually calling the API.

FinOps in 2026 isn't a cost-cutting mandate handed down from finance. It's closer to an operating system for how a company thinks about the money it spends turning compute into product value — and as AI becomes a bigger share of that spend, the teams treating it as a shared, continuous discipline rather than a quarterly audit are the ones who won't get blindsided by next month's bill.

Sources: nOps FinOps Best Practices, Flexera FinOps Principles, TechTarget: 3 FinOps Trends 2026

Get new posts as they publish

No spam — just the next post, straight to your inbox.

Keep reading

Discussion