I believe you are referring to Wang's Carpets [1], which is part of Diaspora, but also as a short story.

[1] https://timeteam.github.io/fiction/2016/12/21/wangs-carpets....