Orthrus Speculative Decoding Fails Exact Trajectory Matching in BF16
September 13, 2026
An analysis of the Orthrus hybrid autoregressive-diffusion architecture reveals that its claim of lossless speculative decoding is inconsistent. Under BF16 precision, exact trajectory matching occurs in only 43-45% of test cases across 1,190 prompts.
HOW THIS AFFECTS YOU
●
builderBe cautious about assuming lossless output when implementing similar speculative decoding methods.