You might need that GPA to get into a competitive academic program, to secure a research grant, to add another string to your bow when you try to convince an accelerator that you have the smarts to back up your charm and creativity, or simply to get a job at a competitive company.
No one cares about your GPA once you get past that point. That point is not necessarily graduation.
On the flip side: Linus Torvalds inventing Linux, or Guido van Rossum inventing Python has, I'm sure, benefited their own careers. I'm totally down with doing the "crazy, hippie, open-source thing" because it's your passion.
But: I'm guessing that Linus and Guido (and pg and others...) all did very well as undergrads. If you're destined to be an open-source badass (or a startup badass), then 4 years of good grades shouldn't be too painful.
(And, I'll just say it, anecdotally: finishing my physics degree made me into a smarter, better person. At the time, my quantum mechanics classes were the hardest things that I had ever done in my life. And now, my own hobbies are just as hard... and rewarding.)
edit: I'd like to mention that I didn't graduate college until I was 28. I can totally empathize with following an unusual path in life that your family doesn't approve of.
Who knows, maybe the particular college is a bad fit, and there can be a million other problems. But explicitly sacrificing GPA for amorphous contributions to open source is like tithing when you can't feed yourself or your own family.
Maybe my own experience is outdated or not generally applicable, but one's grade in a computer science class is fairly indicative of how well you grasped the material. It is precisely the classes I did well in that I haven't needed to restudy (and vice-versa).
Who knows what will happen to OP over the next 10 years? Who knows what opportunities s/he may be in that would or would not require GPA disclosure? You don't. I don't. But to tell an unknown person who you know only 2-3 sentences about that "noone cares about your GPA" is just irresponsible. Perhaps no one cares about your GPA but those are reasons unique to you or your life.