Genes are a unit of selection, but even before culture it was the environment which drives evolution, genes just store information. To me the idea that genes drive anything sounds like saying that my hard disk controls my word processor. Despite software being instantiated in hardware, or culture being in some sense instantiated in genes, it's still the software or the culture that is the unit of control and it reconfigures its substrate.
Seems perfectly possible that humans at some point replace genes altogether through some method of engineering and then it should be obvious that they weren't really doing anything.