I went with Orange Pi 3. I would need measure exactly, but with U-Boot compiled without unnecessary things (USB etc.) it starts loading kernel pretty much immediately. In total boot to my graphical application which uses KMS/OpenGL was something around 2 seconds.