darkninja··on PyTorch Native Architecture Optimization: TorchaoHi mark, Wanted to know if the float4 training is possible with torchao as we trying to fit a large model on a single GPU for training.
darkninja··on PyTorch Native Architecture Optimization: TorchaoHi mark, Wanted to know if the float4 training is possible with torchao as we trying to fit a large model on a single GPU for training