Immich does exactly this with CLIP models, you can even customise which CLIP model it uses and it does a phenomenally good job, I'd personally say surpassing even Google Photos.
Not hard to set up, using docker compose. Just remember to set up automated backups, since there is no company taking care of that.
you get $5 in credit without entering a CC
"The project is under very active development. Expect bugs and changes. Do not use it as the only way to store your photos and videos!"