What we advocate for is making the technical assessment component relatively quick and painless, but using the work sample as a basis for assessing the other sorts of skills and intangibles that you mentioned. You can use your in-person time with candidates not to discuss their technical work, but to add requirements, talk through how they might build an additional feature, and generally assesses how well they communicate and solve problems beyond writing code.