The SIMPLE law provides a four-parameter analytical model to predict LLM energy consumption by separating prefill, decode, KV-cache, and next-token computation. Tested on H100 GPUs, it achieves an R2 of 0.969, outperforming existing fitted models by 3.1-3.5x.
HOW THIS AFFECTS YOU
●
builderYou can more accurately estimate the operational energy costs of your LLM deployments based on architectural hyperparameters.
●
investorThis offers a standardized way to model and compare the efficiency of different LLM architectures.