RoleQ Achieves Ternary Quantization with Lower Perplexity via Functional Scaling

RoleQ scales Transformer units based on their functional roles—reading from or writing to the residual stream—rather than matrix layout. This method reduces ternary perplexity by up to 50% across models from 0.6B to 14B parameters without requiring search or calibration.