It’s the inter GPU communication. Scatter and Gather have much worse performance on AMD GPUs.