Ideally, yes. In practice, most are hosted in a single region but with multiple availability zones (this is called high availability). What you're talking about is fault tolerance (across multiple regions). That's harder to implement and costs more.