Yes GPUs process a (one) computational task on a vast array of data in parallel. But it cannot process two independent tasks concurrently (except, perhaps, by reducing compute power for each task).