I would love to use and contribute to any such project in Python or Java.

Feature wise, I would say should start with everything we have in Huginn.