I don't understand the diagram. We have a browser sending a request to the identity provider. Then sometime later, the relying party is responding. How does the response come from a different server than the request went to?
Maybe it would help if each response was correlated to its corresponding request somehow.