Sure you can get around that with proper use of Layers.
A couple of weeks ago, I tried to deploy a lambda function that created Azure Subnets in python, and the Azure client was 265GB alone. My layer creation api call failed because of this.
Out of curiosity, why didn't you use an Azure docker image to back your lambda function?