I installed https://bahoom.com/hyperswitch to get this behavior (it even has thumbnails of the window), but ideally you would have that option out of the box indeed.