Hacker News Reader

have you actually tried writing highly optimizer cuda? its really hard. nothing is "for free". a lot of the caching (not all) has to be hand coded. you can see how much attention to detail scott gray puts into his kernels eg at https://github.com/NervanaSystems/maxas

View on HN

Not that much harder than writing hand optimized assembly.

There are a few more quirks to keep in mind and you need to have the memory lay-out and access patterns down otherwise it will not give you the boost you expect.

In a way I really love CUDA for this reason, it allows me to re-cycle all my old optimization skills and do something useful with them.

Reply on news.ycombinator.com