That's expected with any image generating models because they aren't trained with an alpha channel.
It's more pragmatic to pipeline the results to a background removal model.
EDIT: It appears GPT-4o is different as there is a video demo dedicated to transparancy.