There really is no comparison. Udemy is youtube tutorials that you pay for, while coursera are modified versions of actual college/graduate courses from the best universities in the world, and they're free.
Just took Intro to Mathematical Thinking from Stanford on coursera, it was fantastic.