Don't feel bad about not being able to make small talk, like everything its not for everyone. I can't honestly maintain it either. Social skills are what they seem to be; skills. Like other skills they take time and effort to develop, but if you work and stay committed to them and the people you like it will pay off.
I think finding a casual/social hobby is a good idea (like the other guy said) too. All of my close friendships are based on a common insterest that we can discuss or do together. Taking an interest in people is key too, not to be confused with seeming to take an interest. People appreciate your legitimate appreciation of them, and they know when you've made them a real priority or when you make real sacrofices for them.
Whatever happens don't give up. I've been at the point multiple times when I literally had 1 friend, who wasn't very close to me, and trust me you can always come back if you stay positive and actually like people. Be happy, its worth the effort, and because you CAN do it!