Platform Update 1.3.0 (0.64.0) - 02/10/2019
Please update your assistant once your platform is updated. The assistant NLU model needs an update to be compatible with this version.
Added
- snips-asr, snips-nlu:
- snips-audio-server:
- Add support for audio streaming (
hermes/audioServer/<site_id>/playBytesStreaming/<chunk_number>/<is_last_chunk>
). Allows to use on the fly speech synthesis to improve assistant responsiveness. doc - Add
portaudio_capture
andportaudio_playback
on linux to use portaudio audio interface.
- Add support for audio streaming (
- snips-dialogue
- Experimental support for site groups and hotword coalescing, see the new options
--site-group
--sites-in-same-group-default
and--hotword-coalescing-duration
. doc
- Experimental support for site groups and hotword coalescing, see the new options
- snips-hotword:
- Trying to load an unsupported model version will raise a dedicated error message.
- snips-injection, all-sdk:
- Add hermes route
hermes/injection/onInjectionComplete
. Once the injection has completed, the platform wait for the ASR and NLU to reload and then publish an injection complete message. doc - Add hermes route to reset injection. This feature allows to clean all previously injected artefacts. doc
- Add
--g2p-model
option to provide a path to a g2p model (--g2p-models
is now deprecated).
- Add hermes route
- snips-nlu, hermes-protocol:
- Add
alternatives
intent field to the intent dialogue message for disambiguation. doc
- Add
- snips-watch:
- Display components readyness. (asr, dialogue, nlu, tts, audio-server and hotword).
- Display some components errors in snips-watch.
-
audio_playback
anddump_audio
are now compatible with audio TCP streams: bind a TCP address to a site using theaudio
option.
Improved
- snips-asr:
- A warmup decoding is now performed when loading the model which removes the latency on the first decoding.
- Change the cache logic. When the size exceeds a threshold, it remains constant. Thus, reduce the memory consumption.
- Make model loading and usage thread safe. Allows the platform to handle more satellites requests in parallel.
- snips-audio-server:
- Change the default frontend used for audio playback and capture from PortAudio to ALSA to mitigate issue #148 (linux only).
- snips-dialogue:
- The component responsible of a dialog session timeout is specified in the timeout log instead of
The session was ended because one of the component didn't respond in a timely manner
.
- The component responsible of a dialog session timeout is specified in the timeout log instead of
- snips-injection:
- Load g2p resource from assistant by default.
- Injection service stop if the g2p resources cannot be found.
- snips-megazord:
- Made
g2p_dir
attribute optional when enabling injection. Which allow user to overwrite it instead of forcing to set a path.
- Made
- snips-nlu:
- Memory usage is dramatically reduced.
- Improve builtin entity parsing in ES, EN, FR, JA, PT.
- Accept ambiguous results from DeterministicIntentParser when confidence score is above 0.5.
- snips-pegasus:
- Remove package dependency to `snips-platform-common.
Fixed
- snips-asr:
- Fix memory leak.
- Fix race condition type crash at startup on ubuntu 18.04 and Debian Buster. #156.
- snips-injection:
- Fix ASR Injection crashes when trying to inject a value containing the symbol
#0
. - Fix memory leaks.
- Fix crash when injecting a value containing
#0
.
- Fix ASR Injection crashes when trying to inject a value containing the symbol
- snips-megazord:
- Fix race conditions in exit by waiting the asr to stop completely before ending the function call.
- snips-pegasus:
- Fix broken route
pegasus/assistant/infos
. - Fix broken route
pegasus/actions/config
not having the correct skill_dir key in the swagger documentation. - Fix
snips-skill-server
action configuration command that was called with the wrong flags order. - Fix
snips-skill-server
action returning an error 500 instead of 200 when an internal error occurs. - Fix route
/pegasus/actions/config
not having the correct skill_dir key in the swagger interface.
- Fix broken route
- android-sdk:
- Fix OpenSLES audio backend related crashes when streaming is not used.
Known issues
- snips-asr-google: [Won’t fix] snips-asr-google does not work anymore (crashes, hangs). #90
- snips-audio-server: Plop / Click artefact when playing sound. #198
- snips-injection: Injection fails when JSON contains an empty value. #192
- snips-watch: --no-color flag seems to have no effects. #197
[EDIT]
For the ones having audio issues, especially using the embedded sound card on your raspberry pi check this issue