Wouldn't a tower have thicker walls? Medieval towers have walls that are several meters thick
The Trebuchet is plenty old enough, but we don't have evidence of use by Rome.
Oh and this is another thing they brought to bear on cities unwilling to bend to the Roman boot (or Sandal):
https://en.wikipedia.org/wiki/Ballista
and even more here:
On the other hand, Roman architecture was such that they did not need very thick stone walls to support high buildings.