Even the earliest analog sticks like the N64 (Which used LEDs for tracking) didn't suffer from drift — although it did wear out considerably mechanically!
I just bit the bullet and replaced my Joycon's sticks with 3rd party hall-sensing ones, which have worked great so far.