Just to clarify, do you mean a few videos or many videos? Thanks
The opposite of "quite a few" would be "quite few".
EDIT: on reading some of the linked sources I realise I was wrong about this.
I take it you don't speak English yourself? You can apply "quite" to any adjective, including "few".
I think the idiom "quite a few" is arguably worse to use in a diverse audience since it means the opposite of "a few" and is one of the only times "quite a" is used to negate the meaning of what follows.
It's not like either phrase is wanting for totally unambiguous synonyms.
Thanks!
(EDIT: TIL from the sibling comments that it always means "super many, lol" which surprised me) (I'm not a native English speaker)