I built pretty much this exact rig myself, but now it's gathering dust, any other uses for this rather than localLLMS
Am also considering setting up Home Assistant with LLM support again.
Should one get lucky and guess the next valid block, that pays the entire month's electricity — since an electric space heater would already be consuming the exact same amount of kWH as this GPU, there is no "negative cost" to operate.
This machine/GPU used to be my main workhorse, and still has ollama3.2 available — but even with HBM, 8GB of VRAM isn't really relevant in LLM-land.