I looked it up again. All un-crewed free balloons with payloads meeting certain conditions are required to be radar-reflective, and notice to ATC is mandatory; ATC is entitled to position reports if they want them. 14 CFR Part 101 Subpart D.
Any one of the following payload conditions trigger these restrictions:
- more than 4 lbs and more than 3 oz/in² on any side
- more than 6 lbs
- two or more packages totaling more than 12 lbs
- suspended from a rope or other device that requires more than 50 lbs to separate
So you’re right; small payloads don’t require any notice or special equipment.