Megatron Core

Name: Megatron Core
Brand: NVIDIA

Product

by NVIDIA

Megatron Core is a PyTorch-based open-source library of essential building blocks for highly efficient, large-scale generative AI training. It provides distributed-training capabilities such as model and pipeline parallelism and can be used with NVIDIA NeMo to build, customize, and deploy large language models.

1 episode featuring Megatron Core

All-In with Chamath, Jason, Sacks & Friedberg
Jensen Huang argues AI progress needs guardrails, not a halt
The conversation frames AI leadership as a contest over deployment, infrastructure, and participation as much as model invention.
Sep 14, 2026 · 47 min

1 episode featuring Megatron Core

Jensen Huang argues AI progress needs guardrails, not a halt