M
Ask HN
Ask HN: Why don't GPU/TPU manufacturers commoditize their RAM complement
Wouldn't say nvidia sell more GPU's if RAM prices were lowered? What prevents them from buying up IP / RAM fab labs and commoditizing the blueprints for its manufacture? Perhaps to the public at large, or perhaps just relicensing it for very low prices to entities in friendly nations?
Everything that is currently going on is a result of people who are convinced they know what they are doing. Spoilers: they don't. The sooner the AI bubble bursts, the better.
In terms of data centre gpus, HBM is far from a commodity as only a one or two manufacturers can fabricate the stacks of RAM.

https://newsletter.semianalysis.com/p/scaling-the-memory-wal...

  • Sevii
  • ·
  • 21 hours ago
  • ·
  • [ - ]
RAM is already a commodity.
"commoditize your complement" is an expression, and thus means more than just the individual meanings of the words combined.
This is the reference for anyone interested: https://gwern.net/complement

I think commoditize means "make cheaper, maybe by commoditizing" in this context.

Memory is and was commoditized. It just got more expensive.

  • wmf
  • ·
  • 10 hours ago
  • ·
  • [ - ]
I don't think there are any steps they could take to sustainably reduce DRAM prices.
RAM isn't their business, and that market has lots of ups and downs. What happens to Nvidia's hypothetical RAM investments when the AI rush is over and RAM is cheap and can't compete in that market? They've come to the logical conclusion to let the RAM companies do their thing.
Sure the market will have ups and downs, commoditizing your complement is not an investment in the complement, its an investment in their business to increase sales of their primary market by decreasing costs for their customers.

They can choose how strong they commoditize their complement: perhaps buying up and expanding operations of RAM manufacture (an investment indeed, or a revenue insurance if a GPU competitor springs up), or more expensive buying up IP and licensing IP below market prices to novel RAM factories in friendly nations perhaps with exclusive priority or agreed prices for RAM at specified volumes etc., or even more expensive buying up IP and putting in public domain. The most optimal depth of commoditization would have to be calculated by such a GPU manufacturer.

No commoditizing your complements is buying up your complements, it’s either working with a standards committee together with the also rans to take on the market leader or open sourcing your competitive product to sell more of what you care about.
They spend a billion or twenty persuading everyone that they need more RAM, and software developers bloat their apps until it's true. The market for memory continues to thrive.
[dead]