I have created a tool to observe what happens inside an LLM. Also allows for the comparison of two quantizations of the same model to see at what point they diverge, token by token | HACKOBAR_
I have created a tool to observe what happens inside an LLM. Also allows for the comparison of two quantizations of the same model to see at what point they diverge, token by token
November 15, 2026
inside-llm is an open-source visualization tool for comparing GGUF model quantizations using llama.cpp. It implements a lockstep mode to track token-by-token divergence and displays logit distributions, entropy, and KL divergence via a browser interface. Users can trace the sampler chain through stages like top-k, top-p, and temperature.