A weight-delta path audit of MedGemma-4B and HuatuoGPT-o1 reveals that medical specialization is not localized to specific component families. While MLP layers show the strongest broad updates, the movement is not cleanly isolated, complicating the mapping of specific knowledge to model weights.
HOW THIS AFFECTS YOU
●
researcherThis complicates efforts to isolate and verify specific medical knowledge within model parameter updates.
●
healthUnderstanding how medical knowledge is embedded in weights is critical for the safety of specialized clinical models.