> We weren’t able to get to the bottom of this because we don’t have the profiling tools necessary to get disassembly from the GPU.
> We weren’t able to get to the bottom of this because we don’t have the profiling tools necessary to get disassembly from the GPU.
I mean OpenVINO's perf is up there on Intel CPUs and it's a great optimising compiler, I've thrown a lot of weird stuff in there and it didn't crap out with complaints about unsupported layers or unsupported combination of layers. It also has an OK batching story (as opposed to TVM last time I checked...) if you're ready to perform some network surgery.
I also feel it's very bad at reporting errors, and stepping through with gdb is one of the worst experiences... BUT but yeah most of the code is available now.
Now if they could stop moving shit around, and renaming stuff, it'd be great. Hoping they settle on 'OneAPI' for some time.
[0]: RDNA2 ISA: https://www.amd.com/content/dam/amd/en/documents/radeon-tech...