💬 Reddit 4d ago
Video of how my LLM's decoder blocks changed while training
Developer visualized decoder block activation patterns during LLM training as video, showing how internal representations evolve across training steps. Lossless version and projection data released on Hugging Face with video generation source code. Provides interpretability insight into transformer training dynamics.