You're spot on with the gamma producing zones. We don't see any of those, and that's why we don't think any galaxies are made of antimatter.
https://www.scientificamerican.com/article/how-do-we-know-th...
https://www.scientificamerican.com/article/how-do-we-know-th...
To me there are more questions than "does antimatter fall up?" There are 4 interactions to test.