As someone else pointed out, get an outlet tester.[1] They're about $7. You may have an open ground, or reversed hot/neutral. Once you've eliminated that, suspect the power supply.
Make sure you have a UL-listed power supply. If you're getting stray AC voltage on the output side of a UL-listed supply, report it to UL. Here's the form.[2] There's no excuse for that.
[1] https://www.amazon.com/Amprobe-ST-101B-Socket-Tester/dp/B008... [2] http://www.ul.com/customer-resources/market-surveillance-dep...