I understand the feeling of bleakness that staring at an EE curriculum can create. I changed my major (the first time) the immediately after meeting with my advisor as a freshman
Undergraduate psychology degrees are perhaps the least marketable degree in existence. They don't qualify a person for anything in psychology beyond what a High School Diploma would. They don't imply an aptitude for business, mastery of science, or the ability to write. The only thing it qualifies a person for is graduate school.
On the other hand, if psychology is what you love, then by all means pursue it. Just realize that it typically requires a Phd to provide therapy as a Psychologist. Socialwork is a related field with better job prospects because a clinical track Master of Social Work allows a person to provide therapy in many states.
I suspect that an EE degree with some additional math electives probably provides most of the job prospects of a straight math degree. Though people will probably be more in awe of a math degree.
Keep in mind that your degree isn't your vocation...after all PG was a philosophy major.