What I see as someone who grew up in a very working class family surrounded by those on benefits:
I see the janitor who busts their ass day in and day out to provide for their families totally lost in these conversations. They are expected to take money out of their check - doing a very difficult, thankless, and not all that well paying job - to even today help pay for a whole lot of people who are incredibly more privileged. I know quite a number of people who have college degrees but experienced "failure to launch" who see themselves as too good to go work in a kitchen, as a janitor, or what have you - but are quite happy to accept various form of public benefits due to their part time cushy employment.
I cannot square that circle. Having someone work themselves to a bone with no real hopes of retirement, so you can have other people live a much easier life than they are.
If you ask those taking said benefits who are working part time in a arts field or whatever, they will of course state that they are not the problem and "rich people" should pay more in taxes so the janitor also doesn't have to work. But now who is cleaning toilets or taking out trash? At some point the work has to be done and you run out of rich people to tax for wealth redistribution.
Considering how widespread this "condition" seems to be in my human experience, I cannot see a widescale implementation of "to each of their abilities, to each their need" ever working out simply due to how selfish humans appear to be. I love the idea - and I have often dream of starting my own commune of sorts of well-curated individuals who all have roles to play, but I just can't see it working out either in reality or in scale. The only reason such a limited scale commune might work is that you could rule with an iron fist and vote people off the island who start to take advantage of others and no longer pull their own weight.
I am quite convinced that if you implemented UBI or other means for the average person to never work you'd simply get a whole lot of people doing effectively nothing, if not outright destructive (for society) things with their time.