This is specifically why I use LM studio and paid for 128gb on my MacBook.
I kept devstral in memory 15gb~ always since I have so much extra.
I can’t wait for a few years from now where I can have triple the memory bandwidth at this size ram
I kept devstral in memory 15gb~ always since I have so much extra.
I can’t wait for a few years from now where I can have triple the memory bandwidth at this size ram