Microsoft develops a super computer equipped with 285,000 CPU cores and 10,000 GPUs in cooperation with OpenAI
Microsoft is a non-profit organization that studies AI at the online conference "Build 2020" for developersOpenAIThe new supercomputer service that we built in partnership withMicrosoft AzureAnnounced that it will be provided at. It is said that the built supercomputer has the performance to rank in the top 5 in the world.
Microsoft announces new supercomputer, lays out vision for future AI work-The AI Blog
Microsoft teamed up with OpenAI to build a massive AI supercomputer in Azure | TechCrunch
The supercomputer built by Microsoft in collaboration with OpenAI is specially designed to train OpenAI's AI model. "It's the first step to making the next-generation large-scale AI model and the infrastructure needed to train it available as a platform for other organizations and developers to build," Microsoft said. I will.
This supercomputer has over 285,000 CPU cores and 10,000 GPUs. Furthermore, each GPU server is configured with a high speed network of 400 Gbps and is connected to Microsoft Azure, but it is said to be utilized as a dedicated resource for OpenAI.
In addition, Microsoft is a project that determines the ranking of supercomputers.Top500We take pride in boasting the top five performances based on Microsoft has not disclosed the detailed performance of the super computer, but in order to enter the top 5 in the super computer ranking, the processing capacity is 23,000 T per secondFLOPSMust exceed.
AI, such as image recognition and language translation, has been implemented focusing on a single task, but the trend of future research is to focus on developing a large-scale AI model that can execute multiple tasks simultaneously. It is being done. For example, Microsoft Turing, an AI language model released by Microsoft in 2020, is the world's largest natural language generation AI that learns 17 billion parameters and is a real-time conversation while processing language, grammar, knowledge, concept and context. Manage, manage thousands of sentences, and generate code on GitHub.
by Bob Mical
Kevin Scott, CTO of Microsoft, said, "Natural language processing can do hundreds of exciting things at once, and computer vision can do hundreds of exciting things. When we see a combination of perceptual domains, we will have new applications that we can't even imagine now. ”
“ Every time we learn a lot about the limits of what we need and all the components that make up a supercomputer, OpenAI CEO Sam Altman said, 'If we could design our dream system, What would it look like? ”And Microsoft was finally able to build it.”