Symbols are in the same class as uppercase letters in the Neo layout. They are easily accessible by pressing the caps lock key.

Hover your mouse over "Ebene 3" here: http://neo-layout.org/