I would imagine that anyone who is dedicated enough to violate your person to obtain your master password would also not hesitate to violate your house to obtain your master password (in fact, they may do so first).
And, as I mentioned earlier, we're really quite good at keeping track of wallets and purses in the first case. Losing them is typically (at least in my own experience) a once-in-a-decade event.