Held on to my last SE until the cracks were too many and I had to put pressure on the cable to get it charging...
Did you try using a safety pin to remove dust from the USB port? Works everytime with a bunch of friends who had an SE but could not charge it properly.
Same, just did this the other week.
Wha! I'll try this in the morning, I've been still using it on the side.