I am working on a conversational voice assistant for a specific topic. I want integrate it into an Android app, thus Snips is perfect! However, due to its limited capabilities regarding conversations I would like to combine it with the NLU and dialogue capabilities of RASA instead and only use the ASR features.
Since the database backend is likely also in the cloud it is fine to query a remote server for chatbot interactions after the speech has been transcribed.
I figured out that I apparently can deactivate the snips-nlu daemon and just subscribe to ASR related messages on the Hermes bus protocol with a Hermes client. In this way, it should be easy to access the transcription and then forward it to a RASA backend in the cloud.
Though, here comes the hitch: the documentation says on Android only Dialogue API is implemented as yet and no further messaging regarding ASR or other Hermes-alike functionality is available!?
So, my questions are:
- Can I use MQTT (Hermes) on Android with Snips, instead?
- Or can I still use the Snips lib for my suggested app in some way or another in order to catch ASR transcription and forward it to my own backend (like RASA NLU and dialogue control)?
Thank you very much for your help in advance!