Block length
Must align to the model's 32-token MoE routing blocks.
Stop after a completed block contains EOS. Blocks may converge sooner when stable.
Must align to the model's 32-token MoE routing blocks.
Stop after a completed block contains EOS. Blocks may converge sooner when stable.