A 404 should not be shown on a valid path with an empty result. That’s exactly what 204 is meant for.
Moreover, a 404 in many REST clients will bubble up an error in the application code because it thinks there’s something wrong (you’re trying to reach something in the wrong place). That’s not the case for an empty result, any more than an empty list is an error.