#self-distillation on Hacker News

2 stories tagged self-distillation, newest first.

Screenshot of arxiv.org: UniEvo-VL: Self-Distillation Training for Multimodal Model Self-Improvement

UniEvo-VL: Self-Distillation Training for Multimodal Model Self-Improvement (arxiv.org)

13 points by gmays 19 days ago | 3 comments

arXiv paper introducing UniEvo-VL, an on-policy self-distillation framework where a multimodal model uses its own self-critiques to improve image generation.

multimodal-models self-distillation diffusion-models image-generation

Screenshot of arxiv.org: Embarrassingly simple self-distillation improves code generation

Embarrassingly simple self-distillation improves code generation (arxiv.org)

605 points by Anon84 6 months ago | 182 comments

arXiv paper showing that fine-tuning an LLM on its own sampled code outputs (simple self-distillation) improves code generation, e.g. Qwen3-30B on LiveCodeBench.

self-distillation code-generation llm fine-tuning

#self-distillation on Hacker News

UniEvo-VL: Self-Distillation Training for Multimodal Model Self-Improvement(arxiv.org)

Embarrassingly simple self-distillation improves code generation(arxiv.org)

UniEvo-VL: Self-Distillation Training for Multimodal Model Self-Improvement (arxiv.org)

Embarrassingly simple self-distillation improves code generation (arxiv.org)