True. But it still wastes your server resources, right? And it's sad that you have to accept that as part of the "cost" of hosting a site ...
Here's a more real-world projection of the cost and server impact - The Bandwidth Cost of AI Crawlers: What Scraping Really Costs Publishers - https://aipaypercrawl.com/articles/ai-crawler-bandwidth-cost