angular already ships with external files that extends the core (ie. angular-resource or angular-cookie) so I guess it could be done.
And I'm not sure you need jQuery at all (angular ships with jQLite) so you may be able to use some of the core bootstrap plugins without adding jQuery (untested).
Also with CDN (Google, cdnjs) for common libs, I think it is less an issue today (at least on desktop).