I think this is just another point of frustration with trying to define timbre. There's definitely some points directly under control: attack and brightness come to mind. Then there's some that are less directly under control: the room and the instrument itself.

It's no accident that musicians spend a lot of money on instruments -- even electric guitar players -- an instrument that is electronically amplified and often distorted and otherwise augmented -- will have strong feelings about the particular type of guitar they use. Leaving shape-based decisions out of it (and pickups), hollow bodies are going to produce a different sound than solid. Different wood types will produce different tonal characteristics.

So the things that are directly controlled are less like terroir, more like choice of grape used maybe? While the make of the instrument, the shape of the room a recording was made in, these are much more like terroir I think.

But it's probably just not a great metaphor.