In other words, you probably never saw improvement past few threads, because your sequential code was slow.