I'm glad to see that you use PyQt for the GUI. Have you examined PySide as well? It's mostly drop-in compatible with PyQt and has a much better license in my opinion.
100ms isn't much, indeed. A more complicated GUI program will likely render that trivial.