Does it matter what side the phone is on?

I keep my phone in my right pocket, but my bluetooth headphones have the transmitter on the left side. Even in my suburban backyard (mowing the lawn), they'll occasionally cut out when my body interferes too much. Every now and then, it'll get bad enough that I'll move my phone to my other pocket.