Accelerating Generative AI with PyTorch II: GPT, Fast(pytorch.org)

285 points by polyrand 2 years ago | 62 comments

Hidet: A Deep Learning Compiler for Efficient Model Serving(pytorch.org)

108 points by ashvardanian 3 years ago | 14 comments

PyTorch: A Reference Language(docs.pytorch.org)

70 points by matt_d 3 months ago | 7 comments

Torchcomms: A modern PyTorch communications API(pytorch.org)

20 points by paladin314159 1 year ago | 2 comments

PyTorch Monarch(pytorch.org)

360 points by jarbus 1 year ago | 42 comments

PyTorch blog post from Meta introducing Monarch, a framework moving beyond multi-controller SPMD for heterogeneous, asynchronous, fault-tolerant ML workflows.

FlexAttention: The Flexibility of PyTorch with the Performance of FlashAttention(pytorch.org)

194 points by limoce 2 years ago | 21 comments