I grew up in the deepest of the deep South. Never did I ever hear "y'all" refer to a single person. I don't know where this trope originated. "Y'all" is definitely plural.
It's literally a contraction for "you all". That doesn't make sense for talking to one person.