I thought it might have been spitfire who commented to that effect. But that was some months ago; I guess I could wade back through history.
I liked Victoria's ambiance when I visited, but the friend I was visiting there (already half a decade ago) commented repeatedly to the effect of it being/becoming a retirement community. With lots of well-off retirees to bid up prices.
Does the island really have enough going on elsewhere to create a general buzz?