Thank you for this! My desktop GPU has only 8GB VRAM, but my MacBook has plenty of unified RAM.

Thanks, works well but slowly on a Mac Air M3 with 24gb. Will have to try it again after freeing up more ram as it was doing a bit of swapping with Chrome running too.

(later). It did nicely for the default example text but just made weird sounds for a "hello all" prompt. And took longer?!

Thank you for the contribution! We'll be merging PRs and cleaning code up very soon :)

Can confirm, runs straight forward on 15.4.1@M4, THX.