PHP has native way via composer to clean up unneeded google APIs:
https://github.com/googleapis/google-api-php-client#cleaning...
This way.. I can see you having a code dependency that needs Drive, but b/c you've cleaned out everything except YouTube it's going to fail - and that's sort of breaking the way Composer is supposed to work.