Sustainability Comparison of SLMs vs Quantized LLMs for Edge AI
September 2, 2026
This study compares five BF16 small language models (SLMs) against five quantized LLMs (INT8, NF4, GPTQ, GGUF) using a Holistic Sustainability Score. Results evaluate the trade-offs between accuracy, latency, VRAM, energy consumption, and prompt robustness for edge deployment.
HOW THIS AFFECTS YOU
●
builderUse these sustainability benchmarks to decide between native SLMs and quantized LLMs for your edge hardware targets.
●
researcherThe Holistic Sustainability Score provides a multidimensional framework for evaluating edge-model efficiency.