I'm sorry, but there are only two things that are new with this mac:
1) its a funny shape 2) it comes with two GPU boards by default.
I'm glad that you are enthused by a new platform, but there is really nothing new. Really. If you want to start writing GPGPU programmes, I congratulate you, its going to keep you busy for a good few months. But you can do that now, without a $10k mac "pro"
Over the next few months, we'll be hearing about how the CPU is dead and that all you need is GPU. However much like the initial flash/iphone argument it over looks the main point. The Mac pro only has one CPU because that's all they could fit in. It wasn't a bold visionary move, it was a compromise because of the form factor. (much like the original iphone, to get the battery life up, they had to use a tiny(by the standard o the time) CPU, which meant no flash)
There is one large elephant in the room when it comes to GPGPU and that is bandwidth. Getting stuff from main memory to GPU memory take a lot of time. Yes PCI3 is wonderfully fast, but compared to RAM<=>CPU its like reading a floppy disk.
That asside, there is really nothing new or special about the macpro. In fact for VFX land, its rather a disappointment. Yes Mari runs really really fast on it. But then its got two large GPUs and a stonking SSD. Everything other programme is going to be CPU constrained(unless they've been pushing stuff to the GPU).
Please excuse my rant, I've been inundated with people wanting new macpros, despite them already having a far more powerful z620 with fusion IO cards and quadro k5000s. cult of the shiny and new I suppose.