It seems more like a basic instruction set, that will then be translated to something actionable for each different device. Seems like most of the work then will be in developing the drivers for whatever devices you want the LLM to access.
Guess what's really good/quick at translating things?
Also my experience with hardware is that the datasheet is often incomplete or misleading. Most of the time is spend fiddling with the hardware to understand exactly what needs to be done, in what order, and sometimes with what delay between commands, to make the damn thing work reliably in the way you want.