[ Self-Improvement ]

Discover insights, tutorials, and thoughts on technology, homelab, and development.

Dec 18, 2025 5 min read

I Was Wrong About Self-Improving Models: Here's What I Actually Found

A follow-up to my retracted post on self-improving models. The fidelity metric improved 18% but actual performance dropped 11%. Here's what went wrong, what I learned about Goodhart's Law, and why reproducibility filtering might be the answer.

self-improvement machine-learning goodharts-law

Dec 16, 2025 5 min read

Self-Improving AI: Using Inversion Fidelity as a Training Signal

A novel discovery: hidden state inversion quality predicts model capability, enabling self-improving systems without external feedback

ai-training self-improvement transformers

Dec 16, 2025 9 min read

Self-Improving Models Without Labels: What I Just Proved and Why It Matters

A 7B model taught itself to generate better security commands using only its own understanding signals. No human labels, no external reward. Here's how and why it matters.

ai machine-learning self-improvement