Fault Tolerant Llama training (pytorch.org)

Screenshot of pytorch.org: Fault Tolerant Llama training

First screen, captured 1 year ago.

Looks similar

Screenshot of pytorch.org: PyTorch Monarch

PyTorch Monarch (pytorch.org)

360 points by jarbus 1 year ago | 42 comments

PyTorch blog post from Meta introducing Monarch, a framework moving beyond multi-controller SPMD for heterogeneous, asynchronous, fault-tolerant ML workflows.

pytorch monarch distributed-training meta

Screenshot of pytorch.org: Torchcomms: A modern PyTorch communications API

Torchcomms: A modern PyTorch communications API (pytorch.org)

20 points by paladin314159 1 year ago | 2 comments

Screenshot of pytorch.org: PyTorch Native Architecture Optimization: Torchao

PyTorch Native Architecture Optimization: Torchao (pytorch.org)

157 points by jonbaer 2 years ago | 48 comments

Screenshot of docs.pytorch.org: PyTorch: A Reference Language

PyTorch: A Reference Language (docs.pytorch.org)

70 points by matt_d 3 months ago | 7 comments

Screenshot of pytorch.org: Helion: A high-level DSL for performant and portable ML kernels

Helion: A high-level DSL for performant and portable ML kernels (pytorch.org)

143 points by jarbus 11 months ago | 47 comments

Screenshot of semianalysis.com: AMD AI Software Solved – MI300X Pricing, Perf, PyTorch, FlashAttention, Triton

AMD AI Software Solved – MI300X Pricing, Perf, PyTorch, FlashAttention, Triton (semianalysis.com)

32 points by another 3 years ago | 11 comments

Looks similar

PyTorch Monarch(pytorch.org)

Torchcomms: A modern PyTorch communications API(pytorch.org)

PyTorch Native Architecture Optimization: Torchao(pytorch.org)

PyTorch: A Reference Language(docs.pytorch.org)

Helion: A high-level DSL for performant and portable ML kernels(pytorch.org)

AMD AI Software Solved – MI300X Pricing, Perf, PyTorch, FlashAttention, Triton(semianalysis.com)