Batteries are recyclable and a bunch of companies are already doing it, for example: https://li-cycle.com/press-releases/li-cycle-reports-full-ye.... As demand for battery materials grows I think recycling will become more profitable and widespread.

Solar panels are also largely recyclable, especially since most of the panel is metal and glass (which we've been recycling for millennia): https://www.epa.gov/hw/solar-panel-recycling. I don't know as much about recycling the actual useful part of the panel, and I'm sure it depends on the type, but there are companies doing this as well: https://www.solarcycle.us/.

However efficient the recycling is, it can't possibly be worse than what we do with used oil, gas, and coal (set it on fire immediately and then pretend it magically disappeared).