Adding to 1.: This came out of MatrixNet research, which was state-of-the-art (and well-guarded) for years.