The UK specifically rules that failing to speak to the police can be held against you. (You still shouldn't speak to the police, even in the UK.)
Every country is somewhat different in its rules for how a suspect can be questioned, what inferences can be drawn, etc. But the advice for everywhere is still the same: shut up.