Offloading Qwen 2.5 27B Layers to iPhone via USB-C
October 2, 2026
Using a 10 Gb/s USB-C connection, an iPhone 16 Pro Max can act as a secondary GPU to accelerate Qwen 2.5 27B prefilling. By streaming activations between a MacBook and the iPhone's A18 Pro GPU, end-to-end prefill rates for 2,000-token batches increased by 29–44%.
HOW THIS AFFECTS YOU
●
builderYou can extend local inference capacity by utilizing mobile hardware as distributed compute nodes.
●
researcherThis demonstrates practical implementation of split-layer inference across heterogeneous hardware via high-speed interconnects.