I've been to conferences in Finland and there's as much smalltalk as there is anywhere else. Going to a conference and everyone just standing there silently would be a waste of everyone's time and money.
Such as at the coffee (fika) break. It might be okay to just be silent. All you are going to talk about is rather obvious in either case.