I wasn't even thinking about the key. I was thinking about compromising a device using a targeted tcp hijack. And then using that device to compromise the rest of the network. Long shot tough.
Sure that might be possible, for example to serve some malware to that device. More likely is that a device you allow onto your wifi already have some malware from earlier.