In the US, the official inflation numbers are based on a "basket of goods" meant to be representative of a typical person's spending. Housing currently makes up about a third of the basket, while luxury items are a fairly small percentage. Here's a pretty well-written summary, albeit with numbers from 2022:
https://www.pewresearch.org/short-reads/2022/01/24/as-inflat...
Changes in housing prices have a large effect on the BLS's inflation figures. Downward changes in the price of luxury goods have a small (and bounded) effect. Even if all luxury goods became free, the reduction in inflation wouldn't be all that much.