Token costs will become a dominant topic in enterprises going forward with AI. Just got out of a dinner with many Fortune 500 enterprise CIOs and this was the most heated topic.

A mix of strategies are being employed, but basically no one feels like they have the right solution. A mix of: figuring out how to prioritize workloads to different models, giving out access to better or worse agents by user type, setting different spend caps by team, having teams justify AI by their use-case, and some just having unfettered access.

Everyone is trying to figure out a semi/predictable model right now in a world where the underlying tech and cost models are constantly evolving.

likes: 510 | retweets: 37 | replies: 58 | views: 118617