Higher interest rates and/or regulations against excessive (however that is defined) ownership. Any regulation should focus on the bigger players as a priority.
The person with the second vacation home isn't a priority but the fund with hundreds or thousands (or 10s of thousands as is the case in the US) should be a focus.