Not just zero physical evidence - zero evidence _at all_. Afaik it doesn't appear until Plato uses it, and he claims that its thousands of years old or something like that. That should reasonably have traces in other accounts through the years.
I did hear a fairly credible theory that it is just an allegory invented by Plato, but influenced by various other myths and political centers (such as king Minos rule on Crete).