Cutting inference cold starts by 40x with LP, FUSE, C/R, and CUDA-checkpoint (modal.com) | HN Screenshots

YHacker Newsscreenshots

Screenshot of modal.com: Cutting inference cold starts by 40x with LP, FUSE, C/R, and CUDA-checkpoint

First screen, captured 5 months ago.

Looks similar

Screenshot of modal.com: Modal Auto Endpoints: Optimized inference you own

Modal Auto Endpoints: Optimized inference you own (modal.com)

11 points by handfuloflight 4 months ago | 0 comments

Screenshot of modal.com: Boosting multimodal inference performance by >10% with a single Python dict

Boosting multimodal inference performance by >10% with a single Python dict (modal.com)

10 points by jxmorris12 5 months ago | 0 comments

Screenshot of modal.com: We built a cloud GPU notebook that boots in seconds

We built a cloud GPU notebook that boots in seconds (modal.com)

74 points by birdculture 11 months ago | 31 comments

Screenshot of modal.com: Linear Programming for Fun and Profit

Linear Programming for Fun and Profit (modal.com)

34 points by hmac1282 1 year ago | 5 comments

Screenshot of modal.com: Keeping 20k GPUs healthy

Keeping 20k GPUs healthy (modal.com)

109 points by jxmorris12 9 months ago | 48 comments

Screenshot of modal.com: GPU memory snapshots: sub-second startup (2025)

GPU memory snapshots: sub-second startup (2025)(modal.com)

16 points by jxmorris12 9 months ago | 5 comments