Alternativa Platform has a cool 3D engine, Flash 10 powered: http://alternativaplatform.com/en/

But without GPU acceleration, Flash is rather limited for 3D transforms/rendering. Unity 3D and O3D are better choices for complex in-browser 3D experience, but require their respective plug-in installation.