●builderThis suggests prioritizing model accuracy and quantization robustness over simple latency metrics when selecting local LLMs.
●researcherYou may find more meaningful evaluation frameworks by focusing on qualitative metrics rather than hardware-centric throughput.