I don't think they mean the LLM will literally be controlling the pixels, it will just be writing the high level code that eventually controls the pixels.
Seems highly inefficient, but so was every move from assembler -> C -> .NET -> JavaScript -> Electron.