Training rewards look, not usefulness
RLHF raters and reward signals favour surface features like lists, headings and rule-following concision, so models hit the target but miss the point of communicating with an actual reader.
Verifiable rewards compress language
Reinforcement learning on math, code and reasoning with length penalties pushes models toward terse, out-of-distribution constructions that save tokens but hurt human comprehension.
No intent or mental model
AI text lacks an author modelling the reader or the physical world, so it can't separate important from mundane and reads as a steady stream of fake main points.