You can do that. It's your app, your rules. And doing that might be easier than setting up email/password authentication.
That said, whenever I encounter a site or app or service that only supports so-called social login I give it a pass. Mainly because I don't have an account with most (if any) of those kinds of services. I might be a weird outlier, but I'm sure I'm not alone.