Go to school for your job, study what you love for a lifetime. Get that degree that will pay the bills, but then once you start work, make it your hobby to study music or 17th century French Lit or whatever.

If you like the group study dynamic, join a book club or audit some classes at the local community college or state school. Most of the higher level lit classes have very few students anyways and they'll welcome another voice in the discussion.

Better yet start a book club, or a lit discussion group. Put that tech degree to work and make an online version of this group. If it gets big try and monetize it!