You're using Docker Compose on Mac? I tried when it was still called Fig, and while it was wonderful for simplicity, the filesystem performance for VirtualBox/boot2docker made it brutal to use. My Rails apps in development mode (therefore serving up many individual assets) would take almost a minute to load each page.
Has it gotten better, is there a trick you're using, or am I hitting an edge case you don't have?