Electra: Pre-Training Text Encoders as Discriminators Rather Than Generators (2020) (arxiv.org) | HN Screenshots

YHacker Newsscreenshots

Screenshot of arxiv.org: Electra: Pre-Training Text Encoders as Discriminators Rather Than Generators (2020)

First screen, captured 2 years ago.

Looks similar

Screenshot of arxiv.org: Training LLMs to generate text with citations via fine-grained rewards

Training LLMs to generate text with citations via fine-grained rewards (arxiv.org)

160 points by PaulHoule 2 years ago | 26 comments

Screenshot of arxiv.org: SparseLoCo: Communication-Efficient LLM Training

SparseLoCo: Communication-Efficient LLM Training (arxiv.org)

11 points by synapz_org 1 year ago | 1 comments

Screenshot of arxiv.org: Reinforcement Pre-Training

Reinforcement Pre-Training (arxiv.org)

48 points by frozenseven 1 year ago | 17 comments

Screenshot of arxiv.org: CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs

CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs (arxiv.org)

96 points by matt_d 5 months ago | 12 comments

Screenshot of arxiv.org: Type-constrained code generation with language models

Type-constrained code generation with language models (arxiv.org)

237 points by tough 1 year ago | 109 comments

Screenshot of arxiv.org: Sigmoid Loss for Language Image Pre-Training (2023)

Sigmoid Loss for Language Image Pre-Training (2023)(arxiv.org)

22 points by fzliu 2 years ago | 0 comments