TGL-NSGA-II Framework for Efficient TinyML Architecture Search
September 28, 2026
TGL-NSGA-II optimizes TinyML neural architecture search by using a pretrained teacher to guide low-fidelity fitness approximations. It employs KD-Lite knowledge distillation on stratified samples and fuses scores with a Gaussian-process surrogate to reduce the need for expensive full evaluations.
HOW THIS AFFECTS YOU
●
builderThis offers a method to reduce compute costs during hardware-constrained model searches.
●
researcherYou can use this stratified teacher-guided approach to accelerate evolutionary search in constrained environments.