news.ycombinator.com

Untitled

randusername · 0 points · 0 comments · 19시간 전

Grim prediction: "Quantized models are no longer permitted on the Hugging Face platform. Reduced precision models are a safety hazard and a violation of our TOS. Click here to speak with a sales representative about our many exciting cloud hosting offerings or enterprise GPU packages."

Comments

5 preview comments · loading full thread
afpx18시간 전

This acquisition and the Stripe acquisition of OpenRouter are puzzling. Both HF and OR, from a technological standpoint, don't appear to have much IP that cannot be easily replicated. I wonder how much it's worth to Nvidia just to obtain a list of who's downloading which models and for what purpose. Similarly with the Stripe acquisition of OpenRouter. In the past, it would have been valuable to obtain an audience or market share or even a productive team. However, in this new age of the surveillance state ... telemetry, orchestration, and financial

armcat19시간 전

Don't see this happening. Both Nemo and TensorRT from Nvidia are heavily invested in low precision formats and higher inference throughput as well as low memory use. It's more about what happens in relation to GGUF, MLX and non CUDA-native frameworks/formats.

ericd15시간 전

I really, really doubt that, and I'm a bit surprised (not too surprised, HN has gotten really cynical) that this is the top comment. I think the future nvidia most doesn't want is a small number of closed labs that run away with it, and gain power to steer a large part of the hardware spending towards nvidia's competitors, as leverage in pricing negotiations for big hardware buys. Their ideal would seem to be lots of competition in the model space, driving lots of innovation in lots of areas, at low margins for the model makers, driving use and demand for hardware way up. They want the portion of the economy working on this to go up, and that's not going to happen if there's just a few companies that can afford to build models.

JV0017시간 전

In that case, somebody will open a new platform to upload the quantized models and hf will lose market share

Tenoke19시간 전

Too base cynicism. I'd be willing to bet you my $200 to your $100 that doesn't happen.