At least in nyc alkaline batteries do go in the normal trash.

https://www.nyc.gov/assets/dsny/site/services/harmful-produc...