Fast token generation emerges as the key differentiator as heterogeneous inference takes hold