They mention that it's super fast without index. Is there a win with index ?
In the future we may add indexes such that looking up a single or small number of rows is as fast as possible (such operations fast now since the GPU scans are so fast, but not as fast as they would be if we had indexes)
Does it accumulate values as it goes? Work on all the values together in memory?
Anyway, it seems like this sort of speed should also allow one to work with larger indices and do the sort of queries that allows.
Yes you could imagine accelerating index lookups with GPUs (I think there's some research papers on this subject already) - maybe a future project for us.