> Possession of rifles and shotguns

This specifically does not mention handguns. Handguns have much narrower exemptions: https://malegislature.gov/Laws/GeneralLaws/PartI/TitleXX/Cha...

IANAL but a starter pistol with no ammo is probably ok, but hey, it is only 2 1/2 years in jail if you are convicted.

(edit - fixed typo)