This is not going to perform well with this amount of data. HTTP Response times for queries are likely to timeout. Needs a job-based queue.