Airicist
16th October 2021, 02:23
Developers:
Microsoft Corporation (https://pr.ai/showthread.php?4302)
Nvidia Corporation (https://pr.ai/showthread.php?t=13678)
Airicist
16th October 2021, 02:26
"Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, the World’s Largest and Most Powerful Generative Language Model (https://developer.nvidia.com/blog/using-deepspeed-and-megatron-to-train-megatron-turing-nlg-530b-the-worlds-largest-and-most-powerful-generative-language-model)"
by Paresh Kharya (https://www.linkedin.com/in/pareshkharya) and Ali Alvi (https://www.linkedin.com/in/alialvi)
October 11, 2021
Airicist
16th October 2021, 02:28
Article "Microsoft and Nvidia team up to train one of the world’s largest language models (https://venturebeat.com/2021/10/11/microsoft-and-nvidia-team-up-to-train-one-of-the-worlds-largest-language-models)"
by Kyle Wiggers (https://www.linkedin.com/in/kyle-lee-wiggers)
October 11, 2021