I was thinking the same the past few days.

Going with fastapi and sqlalchemy, there is no django admin and no user management out of the box.

But writing serialisers for DRF feels dated.