Whether you think that they should be taken seriously or not is irrelevant; they are citizens with a right to vote so their concerns are valid. Not taking people seriously and not listening to them over uncontrolled immigration is what led to Brexit. It is a serious problem for many people for a variety of reasons.