Agreed, this observation holds true for both decode and prefill. Thanks for sharing the code