AirTags use CR2032 batteries which are, in fact, lithium batteries.

They are lithium primary cells though, not lithium ion cells, which are usually what is banned.