OpenAI and Anthropic cut their LLM prices by up to 80% within a few months. Why?
minimaxir · 365 points · 347 comments · il y a 15 heures · Open original
Comments
5 preview comments · loading full thread
Log in to use comments
Log in to h4cker, then connect Hacker News to publish comments.
BUbuckleyourshoeil y a 15 heures
Competition drives prices down. We tried Kimi and GLM models after hitting 'cybersecurity' blocks on OpenAI and Anthropic. We found them to be much cheaper to access and helped us complete our work without 'cybersecurity' refusals blocking us.
33332451bil y a 12 heures
DeepSeek claims $38 of revenue per GPU, per hour for Flash V4. That is $332,880 per GPU, per year. This matches their DeepInfer numbers: 25,600 output tokens/s per GPU sold at $0.60 per million -> $55 minus some other overhead to arrive at $38.
For the bigger Anthropic and OpenAI models (and associated higher prices) there are many unknown factors. But presumably they also work hard on optimizations, and it's not so crazy to think they had or still have a lot of wiggle room to adjust prices.
REredrixil y a 14 heures
This is why Anthropic and OpenAI are pushing for more “regulation”. You can’t show ROI to investors by cutting inference costs.
Regulation might inconvenience them a little, but the upside is huge if it means open models out of China get banned.
CHchakintoshil y a 14 heures
It’s a race to the bottom to see who blinks first and goes bankrupt. It’s not sustainable.
Comments
5 preview comments · loading full threadLog in to h4cker, then connect Hacker News to publish comments.
Competition drives prices down. We tried Kimi and GLM models after hitting 'cybersecurity' blocks on OpenAI and Anthropic. We found them to be much cheaper to access and helped us complete our work without 'cybersecurity' refusals blocking us.
DeepSeek claims $38 of revenue per GPU, per hour for Flash V4. That is $332,880 per GPU, per year. This matches their DeepInfer numbers: 25,600 output tokens/s per GPU sold at $0.60 per million -> $55 minus some other overhead to arrive at $38. For the bigger Anthropic and OpenAI models (and associated higher prices) there are many unknown factors. But presumably they also work hard on optimizations, and it's not so crazy to think they had or still have a lot of wiggle room to adjust prices.
This is why Anthropic and OpenAI are pushing for more “regulation”. You can’t show ROI to investors by cutting inference costs. Regulation might inconvenience them a little, but the upside is huge if it means open models out of China get banned.
It’s a race to the bottom to see who blinks first and goes bankrupt. It’s not sustainable.
Open AI and Anthropic are so GAAP unprofitable.