To further clarify, my intuition (having not read the spec) is that even if a middle-box sent a 103 response and had the client download a JS or CSS file, it won't get used by the client unless it is referenced by the document that is ultimately being loaded.

So yes, the file would get fetched, but no, it can't affect the page being rendered by the browser.