Makes sense. Catholic leaders from dozens of different countries speaking dozens of different languages convene in the Vatican often. The lingua franca of the Vatican is Latin, so, regardless of your mother's tongue, you can use the ATM.
Italian, actually, but Latin remains the official language of the Holy See (Italian being the main working language and French the main diplomatic language, because who needs simple?), to which the State of Vatican City is subordinate, however.