> To use SQL, even an in memory one, in such use case is not going to work.

Have an index on the score and select with ORDER BY ... LIMIT?