I have a Nexus 5X that was 2 years old late last year. At that time I git it's last major OS upgrade. (It will continue to get security updates for another year or so.) This is as good as it gets in the Android world.
It was hobbled at the outset with 2GB RAM. At introduction performance was adequate. It has degraded since then. There are times when I exit an app and it takes several seconds before the home screen is populated. Navigation normally runs in the background but if I open a different app, it may get bumped and disappears from notifications. I listen to podcasts frequently and its background process (the part that keeps audio going if I open other apps) gets bumped.
These are not related to processor horsepower but I believe are symptoms of insufficient RAM. It could also result from additional installed applications, but I have uninstalled more than I have added and it seems not to improve.
Maybe it's time to look at third party ROMs.