I would say do at least one small project or tutorial without Phoenix but in any case Phoenix is a web framework with routes, controllers, templates etc you won't get lost there.

You'll lose some things (no built-in auth but there's libs) and win some (easy websockets and pub/sub).

Also LiveView is fun.