I'm saying it's clearly possible to develop from scratch the framework with which to learn to interpret each individual remote machine's raw data stream.

Your intermediate protocol woes are a red herring.