That might not be an issue on the countryside (everything outside Vienna ;), but it is definitely very impolite to address another adult person with "du" instead of "Sie" if they have not offered you to call them with the informal pronoun. However, that might be different with younger people.