I had the same reaction: why isn't there a "rebase now" button, with a separate "merge" button you can click after CI etc. runs?