If you ignore accents, some words can be mistaken for other words (with different accents), but if you check the context, the problem quickly go away.
Accents are just useful to help you pronounce correctly words ; they are also a hint about the word's origin (ex: ^ means the words is greek) ; I don't get why it stopped you from learning the language.