You can ask chatGPT about arxiv.org papers if you have the doi and the full title if the paper is from 2021 or earlier
I think the extension is only useful for someone who spends a lot of time doing research on arxiv.org, (and if the quality of the summary is good enough, the jury's still out on that one)