GTC

NVIDIA Launches Inference Platforms for Large Language Models and Generative AI Workloads

Retrieved on: 
Tuesday, March 21, 2023

Each platform is optimized for in-demand workloads, including AI video, image generation, large language model deployment and recommender inference.

Key Points: 
  • Each platform is optimized for in-demand workloads, including AI video, image generation, large language model deployment and recommender inference.
  • “The rise of generative AI is requiring more powerful inference computing platforms,” said Jensen Huang, founder and CEO of NVIDIA.
  • With NVIDIA AI Enterprise, customers receive NVIDIA Enterprise Support, regular security reviews and API stability for NVIDIA Triton Inference Server, TensorRT and more than 50 pretrained models and frameworks.
  • Hands-on labs for trying the NVIDIA inference platform for generative AI are available immediately at no cost on NVIDIA LaunchPad .

NVIDIA Hopper GPUs Expand Reach as Demand for AI Grows

Retrieved on: 
Tuesday, March 21, 2023

SANTA CLARA, Calif., March 21, 2023 (GLOBE NEWSWIRE) -- GTC —NVIDIA and key partners today announced the availability of new products and services featuring the NVIDIA H100 Tensor Core GPU — the world’s most powerful GPU for AI — to address rapidly growing demand for generative AI training and inference.

Key Points: 
  • NVIDIA founder and CEO Jensen Huang announced during his GTC keynote today that NVIDIA DGX™ H100 AI supercomputers are in full production and will be coming soon to enterprises worldwide.
  • The NVIDIA DGX H100 features eight H100 GPUs connected with NVIDIA NVLink® high-speed interconnects and integrated NVIDIA Quantum InfiniBand and Spectrum™ Ethernet networking.
  • DGX H100 also features the complete NVIDIA AI software stack, enabling enterprises to seamlessly run and manage their AI workloads at scale.
  • This offering includes the latest version of NVIDIA AI Enterprise , announced separately today, as well as NVIDIA Base Command ™, the operating system of the DGX data center, which coordinates AI training and operations across the NVIDIA DGX platform to simplify and streamline AI development.

NVIDIA Unveils Large Language Models and Generative AI Service to Advance Life Sciences R&D

Retrieved on: 
Tuesday, March 21, 2023

Part of NVIDIA AI Foundations , the new BioNeMo™ Cloud service offering — for both AI model training and inference — accelerates the most time-consuming and costly stages of drug discovery.

Key Points: 
  • Part of NVIDIA AI Foundations , the new BioNeMo™ Cloud service offering — for both AI model training and inference — accelerates the most time-consuming and costly stages of drug discovery.
  • “The transformative power of generative AI holds enormous promise for the life science and pharmaceutical industries,” said Kimberly Powell, vice president of healthcare at NVIDIA.
  • Generative AI models can rapidly identify potential drug molecules — in some cases designing compounds or protein-based therapeutics from scratch.
  • The BioNeMo Service makes these generative AI models easily accessible through a browser-based interface for interactive inference and protein structure visualization.

NVIDIA Launches DGX Cloud, Giving Every Enterprise Instant Access to AI Supercomputer From a Browser

Retrieved on: 
Tuesday, March 21, 2023

DGX Cloud provides dedicated clusters of NVIDIA DGX AI supercomputing, paired with NVIDIA AI software.

Key Points: 
  • DGX Cloud provides dedicated clusters of NVIDIA DGX AI supercomputing, paired with NVIDIA AI software.
  • “DGX Cloud gives customers instant access to NVIDIA AI supercomputing in global-scale clouds.”
    NVIDIA is partnering with leading cloud service providers to host DGX Cloud infrastructure, starting with Oracle Cloud Infrastructure (OCI).
  • Amgen is using DGX Cloud with NVIDIA BioNeMo ™ large language model software to accelerate drug discovery, including NVIDIA AI Enterprise software, which includes NVIDIA RAPIDS ™ data science acceleration libraries.
  • DGX Cloud includes NVIDIA AI Enterprise, the software layer of the NVIDIA AI platform, which provides end-to-end AI frameworks and pretrained models to accelerate data science pipelines and streamline the development and deployment of production AI.

NVIDIA and Microsoft to Bring the Industrial Metaverse and AI to Hundreds of Millions of Enterprise Users via Azure Cloud

Retrieved on: 
Tuesday, March 21, 2023

SANTA CLARA, Calif., March 21, 2023 (GLOBE NEWSWIRE) -- GTC -- NVIDIA today announced a collaboration with Microsoft to provide hundreds of millions of Microsoft enterprise users with access to powerful industrial metaverse and AI supercomputing resources via the cloud.

Key Points: 
  • SANTA CLARA, Calif., March 21, 2023 (GLOBE NEWSWIRE) -- GTC -- NVIDIA today announced a collaboration with Microsoft to provide hundreds of millions of Microsoft enterprise users with access to powerful industrial metaverse and AI supercomputing resources via the cloud.
  • Azure provides the cloud infrastructure and capabilities needed to deploy enterprise services at scale, including security, identity and storage.
  • Omniverse Cloud, powered by NVIDIA OVX™ computing systems , will be available on Azure in the second half of the year.
  • DGX Cloud will be available running in Azure beginning next quarter, providing enterprises with dedicated clusters of NVIDIA DGX AI supercomputing and software, rented on a monthly basis.

Oracle Cloud Infrastructure Chooses NVIDIA BlueField Data Center Acceleration Platform

Retrieved on: 
Tuesday, March 21, 2023

BlueField-3 is NVIDIA’s third-generation data processing unit that enables enterprises to build software-defined, hardware-accelerated IT infrastructures from cloud to data center to edge.

Key Points: 
  • BlueField-3 is NVIDIA’s third-generation data processing unit that enables enterprises to build software-defined, hardware-accelerated IT infrastructures from cloud to data center to edge.
  • OCI offers a wide range of cloud infrastructure and platform services to its customers to build and run applications and services in the cloud or on premises.
  • “The age of AI demands cloud data center infrastructures to support extraordinary computing requirements,” said Jensen Huang, founder and CEO of NVIDIA.
  • “NVIDIA BlueField-3 DPUs are a key component of our strategy to provide state-of-the-art, sustainable cloud infrastructure with extreme performance.”
    BlueField-3 Boosts Data Center Performance, Efficiency and Security
    BlueField-3 is the foundation of the data center control plane that delivers cloud and AI services.

NVIDIA, ASML, TSMC and Synopsys Set Foundation for Next-Generation Chip Manufacturing

Retrieved on: 
Tuesday, March 21, 2023

The new NVIDIA cuLitho software library for computational lithography is being integrated by TSMC, the world’s leading foundry, as well as electronic design automation leader Synopsys into their software, manufacturing processes and systems for the latest-generation NVIDIA Hopper™ architecture GPUs.

Key Points: 
  • The new NVIDIA cuLitho software library for computational lithography is being integrated by TSMC, the world’s leading foundry, as well as electronic design automation leader Synopsys into their software, manufacturing processes and systems for the latest-generation NVIDIA Hopper™ architecture GPUs.
  • “The chip industry is the foundation of nearly every other industry in the world,” said Jensen Huang, founder and CEO of NVIDIA.
  • “Our collaboration with NVIDIA on GPUs and cuLitho should result in tremendous benefit to computational lithography, and therefore to semiconductor scaling.
  • “By collaborating with our partner NVIDIA to run Synopsys OPC software on the cuLitho platform, we massively accelerated the performance from weeks to days!

AT&T Supercharges Operations With NVIDIA AI

Retrieved on: 
Tuesday, March 21, 2023

AT&T is the first telecommunications provider to explore the use of a full suite of NVIDIA AI offerings.

Key Points: 
  • AT&T is the first telecommunications provider to explore the use of a full suite of NVIDIA AI offerings.
  • This includes enhancing its data processing using the NVIDIA AI Enterprise software suite, which includes the NVIDIA RAPIDS Accelerator for Apache Spark; enabling real-time vehicle routing and optimization with NVIDIA cuOpt ; adopting digital avatars with NVIDIA Omniverse Avatar Cloud Engine and NVIDIA Tokkio; and utilizing conversational AI with NVIDIA Riva.
  • AT&T first adopted NVIDIA RAPIDS Accelerator for Apache Spark to capitalize on energy-efficient GPUs across its AI and data science pipelines.
  • For conversational AI, the carrier also uses the NVIDIA Riva software development kit and is examining other customer service and operations use cases for digital twins and generative AI.

NVIDIA Announces New System for Accelerated Quantum-Classical Computing

Retrieved on: 
Tuesday, March 21, 2023

The world’s first GPU-accelerated quantum computing system, the NVIDIA DGX Quantum brings together the world’s most powerful accelerated computing platform — enabled by the NVIDIA Grace Hopper Superchip and CUDA Quantum open-source programming model — with the world’s most advanced quantum control platform, OPX, by Quantum Machines .

Key Points: 
  • The world’s first GPU-accelerated quantum computing system, the NVIDIA DGX Quantum brings together the world’s most powerful accelerated computing platform — enabled by the NVIDIA Grace Hopper Superchip and CUDA Quantum open-source programming model — with the world’s most advanced quantum control platform, OPX, by Quantum Machines .
  • The combination allows researchers to build extraordinarily powerful applications that combine quantum computing with state-of-the-art classical computing, enabling calibration, control, quantum error correction and hybrid algorithms.
  • DGX Quantum also equips developers with NVIDIA CUDA Quantum, a powerful unified software stack now available in open source.
  • CUDA Quantum is a hybrid quantum-classical computing platform that enables integration and programming of QPUs, GPUs and CPUs in one system.

Reverse Bayonet Coupling from Amphenol Is Easy to Install in the Field

Retrieved on: 
Thursday, March 16, 2023

ENDICOTT, N.Y., March 16, 2023 /PRNewswire/ -- Amphenol Industrial Operations, a global leader in interconnect systems, now offers a reverse bayonet coupling connector that is easy to install in the field, making maintenance effortless. The GTC-E Series, which is based on Amphenol's GT Reverse Bayonet Coupling Connector Series, is ideal for use in rail and mass transit, heavy equipment, machine tools, and factory automation applications.

Key Points: 
  • The connector's rugged design can withstand the harshest environments while supplying high current power and signal.
  • The GTC-E series includes a quick positive coupling that allows for fast mating and un-mating of connectors, an audible and tactile indication of full coupling for safety, and crimp termination that provides a stronger, more reliable termination method than soldering.
  • The connector features high shock and vibration capabilities making it suitable for high power connections.
  • For higher amperage, lower t-rise, less resistance, and lower mating forces in a smaller footprint, RADSOK socket contacts are available.