PanaAI has introduced a partnership with Junee Ltd to assemble probably the most highly effective NVIDIA AI supercomputer within the Southern Hemisphere, which is about to be operational in Australia by the primary quarter of 2025.
The brand new mission, known as “PanaAI AUS AISF”, is designed to supply cloud providers to each private and non-private sectors. It goals to facilitate the event of huge foundational fashions for generative AI and help the development of analysis, innovation, and societal purposes.
The PanaAI AUS AISF system plans to utilise as much as 4,088 NVIDIA H200 Tensor Core GPUs interconnected by means of the NVIDIA Quantum-2 InfiniBand platform, addressing the rising computational calls for of AI workloads.
The supercomputer’s projected peak efficiency is roughly 16.4 exaflops in half-precision (FP8), making it doubtlessly the most important AI supercomputing cluster in Australia and the quickest within the Southern Hemisphere.
PanaAI AUS AISF goals to sort out Australia’s wants for vital computing sources to help sophisticated AI duties in varied sectors. The system’s design consists of NVIDIA’s Hopper architecture-based H200 Tensor Core GPUs, which give 1.8 instances extra reminiscence and 1.4 instances increased bandwidth in comparison with their predecessors. This enhanced functionality permits for the administration of bigger mannequin sizes and datasets, with out the necessity for intensive information retrieval from slower storage, nor counting on advanced methods like tensor or pipeline parallelism.
The H200 GPUs ship as much as a forty five% efficiency enchancment over earlier fashions in particular AI workloads, akin to Llama and GPT.
This development helps large-scale synthetic intelligence initiatives whereas emphasising top-tier safety.
The PanaAI AUS AISF will provide accelerated computing cloud providers, providing public cloud entry, AI compute energy leases, and subscriptions geared toward coaching massive language fashions. It’s anticipated to rank among the many high 10 strongest AI supercomputers globally primarily based on the TOP500 rankings as of June 2024. It seeks to advance analysis and innovation throughout sectors like healthcare, vitality improvement, monetary providers, autonomous driving, life sciences, and public providers.
A spokesperson for PanaAI said, “To satisfy the rising demand for generative AI and computing sources, PanaAI is planning to determine a number of world-class, highly effective supercomputing methods to supply unparalleled accelerated providers to customers worldwide. We extremely worth our collaboration with NVIDIA to ship AI cloud providers and quickly prepare massive foundational fashions constructed on ever-expanding datasets of photos, acoustics, and sensor data. We sit up for nearer collaboration to help customers across the globe.”
PanaAI specialises in AI computing providers, notably in GPU capabilities for areas akin to high-performance computing and machine studying. As an NVIDIA NCP associate, PanaAI commits to making sure that innovators and builders have the required computational sources to drive the way forward for AI.
