There are two great saas solutions for this - mergify.io and mergequeue.com.