Nvidias Selene supercomputer Nvidia
Microsoft and Nvidia, a chipmaker, have developed an artificial intelligence system that mimics human language better than ever before. However, the time and cost involved in creating the neural network have raised questions about whether such AIs are scalable.
Megatron-Turing Natural Language Generation (MTNLG), the new neural network, has 530 billion parameters. This is more than three times the size of OpenAIs GPT-3 neural networks, which was the current state of the art. This was not an easy feat.
