I hope this amount of effort means multi-GPU support is coming soon (saw you mention “this week” :) ) so we can tune QwQ on a single node!