I’ve also done interviews that were brief 30-60 minute casual discussions followed by an offer during the hiring craziness that happened in a few years in the past. Anecdotally, coworkers at those companies were a completely random range from smart and kind down to the meanest, most clueless people I ever worked with. They had high turnover both because they were always firing bad hires (hire fast only works if you also fire fast) and people were burning out from the perpetual stream of bad hires being randomly injected into the company after they talked their way through the short interview.
Looking back, the interview processes that took the longest were certainly not perfect, but the companies that had them were much better about maintaining a coherent culture and high bar for the coworkers I would get. Every new hire felt like someone amazing who I was happy to be working with.
Everyone has different priorities, but looking back I think the relatively small amount of time I invested into long interview processes (relative to the 2000 hours I work every year) was time well spent.