Meta sets up powerful AI Supercomputer to support Metaverse

Meta claims to launch “the world’s fastest artificial intelligence supercomputer” as part of its plans to build a virtual metaverse. The computer, which is already up and running but is still being built, is called AI Research SuperCluster (RSC) and it’s already listed among the top five fastest supercomputers. The AI supercomputer would become the fastest AI machine in the world when it is expected to be fully built by mid-2022, and can process images and videos up to 20 times faster than the current systems.

Mark Zuckerberg said in a blogpost that the metaverse, a concept that blends the physical and digital world via virtual and augmented reality, will require “enormous” computing power. “The experiences we’re building for the metaverse require enormous compute [sic] power (quintillions of operations/second!) and RSC will enable new AI models that can learn from trillions of examples, understand hundreds of languages, and more,” wrote Zuckerberg in the blogpost.

In 2017, Meta’s Facebook AI Research lab built a supercomputer with 22,000 Nvidia V100 Tensor Core GPUs in a single cluster. Performing 35,000 training jobs a day, it served as the company’s main AI supercomputer. But in 2020, Facebook decided to increase its computing power, building a new supercomputer to handle more advanced AI workloads. The RSC is currently being used to train large models in natural language processing (NLP) and computer vision for research. The company said it hoped to “one day” train models with trillions of parameters and build new AI systems that can power real-time voice translations to large groups of people. Compared to Meta’s previous system, the RSC runs computer vision workflows up to 20 times faster as said earlier; it runs the Nvidia Collective Communication Library (NCCL) more than nine times faster, and trains large scale NLP models three times faster.

Meta said that development of the supercomputer was delayed by remote working and chip and component supply chain constraints, both caused by the Covid-19 pandemic. “We hope RSC will help us build entirely new AI systems that can, for example, power real-time voice translations to large groups of people, each speaking a different language, so they can seamlessly collaborate on a research project or play an AR game together,” Meta said.

Meta researchers also said it will help AI researchers build “new and better” AI models that can learn from “trillions” of examples and work across hundreds of different languages simultaneously and analyze text, images and video together.