State university libraries are generally open to any resident of that state, student or not. Private universities might not be.
I mostly remember because of the pain it was to get clearance from security at those unis to be able to get out of the hackathon (at their libraries) and get back in; had to leave ID and take my visitor badge with me.
I'm sure many state unis are open to residents of that state, but I know not all. To be honest, I prefer it to be that way for the same reason "actual" public libraries just aren't conducive for actually studying something that takes a lot concentration.