You can create the holder from any biodegradable materials, leather or cardboard etc. No need to use "non-recyclable plastic".
You can go to your local artisan and ask them to craft it from any material you choose. It's not a complicated form to create a slot for.