You don't have to limit your leanring to just your undergraduate coursework.

If you are passionate about something and want to get in depth exposure, there is nothing stopping you from

1) reading up all the books you can get hands on on that subject,

2) develop theories and do all the analysis you can do on that subject,

3) meeting/interacting with as many experts on that subject as possible.

If you love it, go for it.

(but yeah, do graduate, that degree paper can carry a lot of weight, especially in getting the first job)