I am suspecting the problems you have are due to the name of the scene. It appears certain keywords do overrule locally-defined names. Whenever I put an address book entry for a taxi company with the name "taxi" in it, Siri isnt able to call it because it assumes I want to search for a taxi nearby. A similar thing might be going on with "apartment" and homekit. Frankly, a bit cynical, but by now, I am suspecting some intern put a rule in which contains "apartment" and has a very high priority, or somesuch...

Not directly related to Siri, but VoiceOver icon labels are also getting worse and worse over the years. For example, the weather app. In the beginning, when you scrolled with the VoiceOver cursor through the hourly forecast, it would say "Sonnenaufgang" and "Sonnenuntergang" (Sunrise and Sunset) at the appropriate places. Starting with iOS 12 (or was it 13?) the spoken label changed to "Sonne aufwärtspfeil" (sun arrow up). So someone went in there, decided that the nice description from earlier wasn't good enough, and replaced it with a literal description of the icon, ignoring context altogether.