The left wing didn't aimlessly move left away from labor. Biden was dramatically more pro-labor ("New Dealy") than Obama. The right wing lost their fucking minds because we elected a black man. Trump himself is a one-man microcosm of this: loosely Dem-aligned until... Obama.
Spend some time with the GOP base. They're actually broadly racist, ranging from slightly (and ashamedly) to loudly and unabashedly. The left obviously also has various problems with race, so don't take this as some implicit categorical exoneration.