Is it possible that if they were, they would annihilate each other, so you couldn't live in an area where both are present, and so we are necessarily born in a place where there's much more of only one type? The antimatter might be outside of the observable universe, safely away from interacting with us for the foreseeable future.