What database are you using and did you slowly build it up or what?
The Digikam DB is SQLite on a fast NVMe drive. The photos are on a 4 TB SSD. I have been using Digikam for maybe a decads, so the collection has been growing with me, but no issues so far.