Thanks for explaining this! I suspected there was some additional context and was digging into it now. Problem is that the memory never seems to be freed, and I could update my issue to show this.
Maintainers have acknowledged problems like this on other issues too.
But I'll nevertheless read more into this!