Intellectia News

Meta CEO Mark Zuckerberg laid down the newest marker in generative AI training on Wednesday, saying that the next major release of the company's Llama model is being trained on a cluster of GPUs that's "bigger than anything" else that's been reported. From a report: Llama 4 development is well underway, Zuckerberg told investors and analysts on an earnings call, with an initial launch expected early next year. "We're training the Llama 4 models on a cluster that is bigger than 100,000 H100s, or bigger than anything that I've seen reported for what others are doing," Zuckerberg said, referring to the Nvidia chips popular for training AI systems. "I expect that the smaller Llama 4 models will be ready first." Increasing the scale of AI training with more computing power and data is widely believed to be key to developing significantly more capable AI models. While Meta appears to have the lead now, most of the big players in the field are likely working toward using compute clusters with more than 100,000 advanced chips. In March, Meta and Nvidia shared details about clusters of about 25,000 H100s that were used to develop Llama 3. Read more of this story at Slashdot.

Growing numbers of veteran video game developers are leaving large studios to work on smaller projects, citing bureaucratic burnout and creative constraints at major publishers. Nate Purkeypile, former lead artist on Bethesda's "Starfield," quit in 2021 after facing up to 20 meetings weekly coordinating with a 400-person team across four offices. He has since released "The Axis Unseen," a horror game he developed solo. The trend, reported by Bloomberg, coincides with ballooning development costs in the industry. Sony's "Uncharted 2" cost $20 million in 2009, while 2020's "The Last of Us: Part 2" exceeded $200 million. "Small studios are not burdened by stockholder expectations," Renee Gittins, International Game Developers Association board chair, told the publication. They're "more nimble, [and] able to take greater risks." Recent indie successes like "Balatro" and "Animal Well," created by solo developers, have also demonstrated the commercial viability of smaller productions. Read more of this story at Slashdot.