Open Source includes BSD style licenses, which allow distribution in binary form only. Free Software doesn't, that's the difference and I think that difference is large enough to make them not synonyms.
http://www.gnu.org/philosophy/categories.html#Non-Copylefted...