Recently went through the same debacle. Our hope was that we could solely rely on Magic Link instead of email/password ... but it turns out many users don't really understand it [1]. So your options are:
1) Email/Password Sign In
2) Bite the bullet and add Apple / the "full auth stack" (FB/Google/etc.) & deal with account linking issues.