Ice cubes always taste funny if used without good ice forms, absorbing the fridge odors. Use the ones with silicone cover. Not a hint of the freezer in the made ice.
I got these mostly because space is a luxury in our freezer (very tiny) and wanted to vertically stack them. I love them. It's such a weird thing to throw praise on, but I've literally told friends to get the silicon cover ice trays and never look back.
The cover is silicon, but the tray is regular plastic?