In the UK, at least, gold coins and gold bars benefit from a special tax status which means that they are exempt from VAT

Certain coins, such as the Gold Sovereign in the UK are classed as legal tender and as such are exempt from capital gains tax