OpenAI is teaming up with other companies to improve supercomputer networking for AI training.
OpenAI says it partnered with AMD, Broadcom, Intel, Microsoft, and NVIDIA on a protocol called Multipath Reliable Connection, or MRC, which “improves GPU networking performance and resilience in large training clusters.” The full spec is available through the Open Compute Project.