That agreed upon ethos usually says when your family is targeted for your actions, those targeting them are not honourable.

They are violent and target innocents, the Yakuza should never be mistaken for honourable.