I think it makes more sense to have the button match the language of the page content. It would be a bit jarring to see a single Japanese button on an otherwise English page.