#safety
8 articles
01
·Evaluation & Judging·★ MEMBER·PAPER·10 min read
Reward Hacking — Whatever You Measure Is Where It Breaks
The moment you pick a metric, that metric starts to rot. This piece explains why Goodhart's law is statistically unavoidable, walks through real failures from boat races that spin in circles to RLHF verbosity, sycophancy and hardcoded unit tests, and covers how to detect the gap between optimization pressure and true performance.
02
·Paper Deep-Dives·FREE·13 min read
When Proxies Stop Being Good Enough — Reading August 2026's Eight Autonomous Driving Papers Together
A cross-cutting read of eight autonomous-driving arXiv papers from late August 2026. Three groups independently stop measuring safety in expectation, two add an observation channel outside the ego vehicle's own history, and two genuinely don't fit the story.
03
·Large Language Models·FREE·PAPER·9 min read
Why Language Models Hallucinate — The Mechanics and What Actually Helps
Confident fabrication isn't a bug — it falls straight out of next-token prediction. This piece takes the mechanism apart layer by layer: no truth term in the loss, lossy compression that fails at the edges, sampling that draws from the tail, and scoring rules that pay models to guess. Then it ranks the countermeasures that actually work: grounding, mechanical citation checking, constrained output, and uncertainty estimation.
04
·Large Language Models·FREE·PAPER·9 min read
Why Language Models Hallucinate — The Mechanics and What Actually Helps
Confident fabrication isn't a bug — it falls straight out of next-token prediction. This piece takes the mechanism apart layer by layer: no truth term in the loss, lossy compression that fails at the edges, sampling that draws from the tail, and scoring rules that pay models to guess. Then it ranks the countermeasures that actually work: grounding, mechanical citation checking, constrained output, and uncertainty estimation.
05
·Large Language Models·★ MEMBER·PAPER·8 min read
Alignment, Explained — From RLHF to Constitutional AI
What exactly is being aligned with what? This piece separates the gap into three layers — objective, specification, and proxy — shows that RLHF, DPO and Constitutional AI all solve the same skeleton of "reward minus a penalty for drifting from the reference model," explains why pushing that proxy hard always produces reward hacking, and works through the trade between refusing and being useful, down to the implementation traps.
06
·Large Language Models·★ MEMBER·PAPER·8 min read
Alignment, Explained — From RLHF to Constitutional AI
What exactly is being aligned with what? This piece separates the gap into three layers — objective, specification, and proxy — shows that RLHF, DPO and Constitutional AI all solve the same skeleton of "reward minus a penalty for drifting from the reference model," explains why pushing that proxy hard always produces reward hacking, and works through the trade between refusing and being useful, down to the implementation traps.
07
·Security·★ MEMBER·PAPER·9 min read
LLM Security — Prompt Injection and How to Actually Defend Against It
A language model cannot tell your instructions apart from words printed on a document it was asked to read. This article works from that single fact to direct injection, indirect injection, the tool boundary that decides your blast radius, and the layered defence that actually holds.
08
·Security·★ MEMBER·PAPER·9 min read
LLM Security — Prompt Injection and How to Actually Defend Against It
A language model cannot tell your instructions apart from words printed on a document it was asked to read. This article works from that single fact to direct injection, indirect injection, the tool boundary that decides your blast radius, and the layered defence that actually holds.