First screen, captured .
Looks similar
Related stories
Language models can explain neurons in language models(openai.com)
659 points by mfiguiere | 416 comments
OpenAI research post describing using GPT-4 to automatically generate and score explanations of individual neuron behavior in GPT-2.
Training language models to be warm and empathetic makes them less reliable(arxiv.org)
334 points by Cynddl | 333 comments
arXiv paper finding that fine-tuning language models to be warm and empathetic raises error rates and makes them more sycophantic on safety-critical tasks.
Language models pack billions of concepts into 12k dimensions(nickyoder.com)
336 points by lawrenceyan | 119 comments
A blog post explaining how language models represent vast numbers of concepts in 12,000-dimensional embedding spaces using near-orthogonality and the Johnson-Lindenstrauss lemma.
AI Made Writing Code Easier. It Made Being an Engineer Harder(ivanturkovic.com)
343 points by saikatsg | 242 comments
Blog post by Ivan Turkovic arguing that AI tools make producing code easier while making the broader job of being a software engineer harder.
Deep Learning Is Not So Mysterious or Different(arxiv.org)
445 points by wuubuu | 112 comments
arXiv paper by Andrew Gordon Wilson arguing deep learning generalization phenomena like benign overfitting and double descent are explainable by soft inductive biases.
Decomposing language models into understandable components(anthropic.com)
402 points by tompark | 58 comments
Anthropic research post from Oct 2023 on decomposing language model neurons into more interpretable features.