Doesn't that mean you need all the app's library dependencies installed into your alternate libdirs that you bind mount over top the "real" libdirs? Not just the ones you want to override?
I feel like for this, LD_LIBRARY_PATH is usually sufficient. Just seems like glibc is the special case.