I have found that the literal interpretation of "How are you?" can be countered with a rough summary of your internal emotional/mental machinery by way of an emphatic grunt or groan. "Meh.", "Woo!", "Ugh." are a few good places to start. Get creative, do some homework.
Remember this is a very basic, mammalian level trait. This is after lizard brain stuff, but before primate brain stuff. We don't need a lot of words for this particular relationship transaction. Have fun with it, but don't stress it. The person asking the question is certainly not stressing it.
"Meh", "Ugh", and other actual emotions don't seem to fit my idea of what the other person wants to hear. Those invite conversation, or almost hint at asking for a conversation. I don't think that's what the other person usually wants.
I've taken to mechanically translating "how are you?" into an emotionless "hi".
I agree though, it's all very weird. Americans don't seem to just say "hi" very often.
In California, where I grew up, it's expected to have a small response:
A: "Hey, how are you?"
B: "Good, and you?"
A: "Good, thanks."
But in the Northeast, you'll stress yourself out trying to actually respond. People will throw it out as you're walking by each other, and if you try to squeeze in a "Good, and you?" they'll be taken aback because they're not really expecting to say anything further. And they're not really waiting to hear any actual response like "Meh" or "Woo".
In Boston and New York, I literally translate "How are you" to "Howdy" in my head. That is, "Howdy" was derived from "How do you do?" but obviously you don't respond "Good" to "Howdy". It's just a synonym for "Hi."
A: "Hi, how are you?"
B: "Hi."
I think it's probably meant to imply a kind of warmness to the person it is directed to, kind of like, "nice to see you," or "I wish you well."
No one expects it to lead to extended conversation when it is used nonchalantly like this. And you're right, it is frequently encountered in situations where one or both parties are in motion. Often in a form like:
A: Hi
B: Hi, how are you?
or
A:Hi
B:Hi, how are you?
A:Good, thanks!
or
A:Hi
B:Hi, how are you?
A:smile, nod
or
A:Hi
B:Hi, how are you?
A:Good, and you?
B:Good, thanks.
I think this is fairly common in languages, that words are used in a way that from their literal meanings you wouldn't expect. Idioms of course, but I think in other ways as well.
It reminds me of the Dilbert where he's telling Catbert how he was confronted with passing someone he barely knows for the second time in a hallway, where he already gave the empty "hey how's it going" the first time not long before. Catbert asks what he did, he says he pulled the fire alarm, because he couldn't think of anything else ("I doubt Mrs. Manners will back you up on that one"). I feel that way sometimes too :)
In what universe is a simple greeting cold and smug?
So, this universe.