Towards Resource-Efficient LLMs: End-to-End Energy Accounting of Distillation Pipelines

Comprehensive energy accounting framework for LLM distillation pipelines that measures full end-to-end costs including teacher-side workloads (data generation, logit caching, evaluation), revealing hidden resource consumption beyond model inference.