Is a replacement coming? Do you like the company otherwise?
If your only issue is the other guy then in theory this could workout better for you as when the CTO's replacement comes in you all have nearly equal footing.
Who is your boss post his departure the CEO? If so be proactive and set time up with them to ask questions and voice concerns. You could possibly carve yourself a comfort zone.