Training and aligning LLMs with RLHF and RLHF alternatives(magazine.sebastianraschka.com)

82 points by rasbt 3 years ago | 10 comments

Implementing Weight-Decomposed Low-Rank Adaptation (DoRA) from Scratch(magazine.sebastianraschka.com)

85 points by rasbt 2 years ago | 10 comments

Ten Noteworthy AI Research Papers of 2023(magazine.sebastianraschka.com)

108 points by danboarder 2 years ago | 17 comments

Understanding Reasoning LLMs(magazine.sebastianraschka.com)

442 points by sebg 1 year ago | 163 comments

Sebastian Raschka's Ahead of AI newsletter article explaining the four main approaches to building and refining reasoning LLMs.

Coding Self-Attention, Multi-Head Attention, Cross-Attention, Causal-Attention(magazine.sebastianraschka.com)

102 points by rasbt 2 years ago | 7 comments

AI and Open Source in 2023(magazine.sebastianraschka.com)

107 points by belter 3 years ago | 57 comments