Compress any LLM 3x in one click,near-lossless,in under 50 MB RAM(neuracryption.com)
22 points by anushka_gandhi | 15 comments
Research page from NeuraCryption presenting SPECTRA, a calibration-free 4-bit LLM compression framework with Triton kernels for running models on 4GB consumer GPUs.