Boosting multimodal inference performance by >10% with a single Python dict(modal.com)10 points by jxmorris12 5 months ago | 0 comments
Cutting inference cold starts by 40x with LP, FUSE, C/R, and CUDA-checkpoint(modal.com)78 points by charles_irl 5 months ago | 18 comments
'I paid for the whole GPU, I am going to use the whole GPU'(modal.com)118 points by mooreds 1 year ago | 35 comments
GPU memory snapshots: sub-second startup (2025)(modal.com)16 points by jxmorris12 9 months ago | 5 comments