I think as income has become more concentrated in certain industries it hurts. Even if your agricultural town had very little poor people - if is has virtually no one making about 70k then it is going to be tricky to build and maintain.
They rely on federal loans, indirectly.
ADDED: But, as others have noted, once you drive somewhere at least relatively close to where you're going, at least small to mid-sized campuses and associated towns are generally designed to let you walk to stores/restaurants/etc. fairly easily.
You've also got a town structure which is based on a single identifiable economic centre, which doesn't generally rely on heavy industry or ag within that centre (information, knowledge, and people, as well as the support strucutures for them), and so your principle transportation problem is how to move a fair-to-middlin' mostly younger and healthier population around. Bikes and walking fit this mode well, the small population of elderly and disabled can be accomodated as edge cases.
Keep in mind that in many small college towns, there's still a sizable commuter population. Some of that are students priced out of local housing, though the workforce is a much larger component, and may have commute patterns comparable to that of a large city (driving in from an hour or more away). The centralised nature of employment makes even rural mass transit or commuter shuttles viable.