Yes, but it might also be the case that we don't observe something outside of it, but rather infer the existence of something outside of it through some other phenomenon (which is much more probable - observing something outside of the visible universe as we know it would violate relativity). In that sense, it would be there, but would never be visible.