It is true that US citizens must file their yearly US tax return, no matter where they live. That is different from the majority of other countries that do not require this from their citizens living abroad.
In practice, double taxation - which your comment seem to imply - is not really an issue. A lot of countries - including France - have mutual agreements with the US that exempt foreign income (up to a certain amount) from being taxed twice.