Study Reveals Challenges in Encoding Lexical Tone in Discrete Speech Units
Researchers found that discrete speech units (DSUs) struggle to reliably encode suprasegmental information like lexical tone. This poses challenges for tasks where prosody is crucial, such as text-to-speech and multimodal dialogue systems.