I've been trying and experimenting with Freeswitch for a while now. I first tried it about a year ago and I can say it's come a long way since then, there's been a lot of improvement and everyday new people are coming on board (at least users). The development team is awesome and give great support on the mailing list or through IRC.
At my company we are currently using Asterisk, but are in the process of switching to Freeswitch. Everything seems very well thought out, and in my opinion, it is way simpler than Asterisk. There are many modules for a lot of different functionality, there's support for javascript, lua, perl, java, C, C#, ruby, python, php, a skype gateway, and many more.