Are you on the latest version? I can rearrange them on mine. If click on "manage containers" there is a gray on gray bar on the right. If you hover it, your cursor should change to an arrow to rearrange them.
A non-sanctioned way to mitigate this might be achieved by editing containers.json, but I'm wary of inviting sync shenanigans.