I think I would not apply at a company where there's no english version available. I don't think i'd be welcome there as a non-Frenchman.
In general, why is there still such a poor internationalization in everything in france? From universities, to jobs in startups (!) etc. I recently tried searching for a master in france and it was super difficult.