I like self hosting random stuff on docker. Ollama has been a great addition. I know it's not, but it feels on par with ChatGPT.

It works perfectly on my 4090, but I've also seen it work perfectly on my friend's M3 laptop. It feels like an excellent alternative for when you don't need the heavy weights, but want something bespoke and private.

I've integrated it with my Obsidian notes for 1) note generation 2) fuzzy search.

I've used it as an assistant for mental health and medical questions.

I'd much rather use it to query things about my music or photos than whatever the big players have planned.