Meta, the forward march of progress

 Just in case you don’t want to click over to the other sites, Big Zuck update – Open sourcing will continue– Currently training LLama 3– AI + Metaverse– Will have 350,000 H100s and ~600 H100 equivalents of compute 🤯 -Ideal AI formfactor is 🕶️ pic.twitter.com/xJSi7yVzXe — Alex Volkov (Thursd/AI) (@altryne) January 18, 2024 According to
The post Meta, the forward march of progress appeared first on Marginal REVOLUTION. 

Just in case you don’t want to click over to the other sites, Big Zuck update

– Open sourcing will continue
– Currently training LLama 3
– AI + Metaverse
– Will have 350,000 H100s and ~600 H100 equivalents of compute 🤯
-Ideal AI formfactor is 🕶️ pic.twitter.com/xJSi7yVzXe

— Alex Volkov (Thursd/AI) (@altryne) January 18, 2024

According to one estimate, that is about $20 billion spent on GPUs. Which I guess is a lot.

The post Meta, the forward march of progress appeared first on Marginal REVOLUTION.

 Web/Tech