Peak requests per second (and whether a SIP invite or CGI script being run) would be very useful to know.
SIP hasn't gotten much heavier, nor CGI scripts, and tiny distros like OpenWRT can do a lot with little iron.
Heard lots of rough ADSL era VoIP stories, hopefully you weren't struggling with that back then.