tech
Sam Altman says OpenAI's top token spender uses 100 billion tokens a month
Sam Altman said AI budgeting has recently become a "huge issue" for some companies, something that "never came up" earlier this year.
TL;DR
- OpenAI CEO Sam Altman discussed the company's highest AI token spenders at an enterprise event.
- The current top token spender at OpenAI uses approximately 100 billion tokens per month.
- Altman stated that someone outside of OpenAI spends more than their top internal user, calling it a personal "embarrassment."
- The article notes OpenAI has a culture of high token spending, with employees sometimes sharing their totals on X.
- Some OpenAI employees have reportedly spent significantly more than 100 billion tokens in a month.
- Other companies like Amazon and Uber are tightening their AI token spending, with Uber setting usage caps.
- Altman acknowledged that AI costs have suddenly become a "huge issue" for companies, whereas previously it was not a concern.
- OpenAI is exploring ways to deliver more value for less spend.