Discover insights, tutorials, and thoughts on technology, homelab, and development.
The original observation has grown. Three independent measurement instruments now converge on the same universal structure inside neural networks.
How curiosity, physics, and looking inside neural networks revealed something unexpected about how computation organizes itself
An overview of my ongoing research exploring transformer injectivity, self-improving models, and high-performance AI on an RTX 3090
How periodic sparse attention achieves O(n) complexity while maintaining model quality
A novel discovery: hidden state inversion quality predicts model capability, enabling self-improving systems without external feedback
How I achieved 100% token recovery from Mistral-7B hidden states and what it means for AI security