What would you have it do? Solving the general dataflow problem so you identify out-of-bounds array accesses at compile-time is impossible (equivalent to the halting problem), so would it really be worth investing in identifying in finding them in simpler cases, particularly since simple cases are much less likely to make it to deployment anyway?
And if you don't find the problem before runtime, what's a better strategy than panicking here?