ENDE
AEVORIANA

When speech recognition first needs to get to know your voice

AI ยท Feature

Speech recognition is not equally accessible to everyone. People whose speech differs from that of those frequently represented in training data experience additional errors and communication barriers. Personalised approaches such as Project Relate investigate how individual speech patterns can be better accommodated. User autonomy, opportunities to make corrections and a realistic assessment of the remaining limitations are crucial.

Average accuracy can exclude people

A speech recognition system learns from examples which acoustic patterns belong to which words. If certain ways of speaking are under-represented in those examples, recognition may be poorer for those people. Google describes Project Relate as an approach for people with non-standard speech, in which personal recordings are used to adapt a speech model. The functions described include converting spoken language into text and playing back recognised statements in a synthetic voice. The research interest therefore lies not merely in a higher average recognition rate. It is about making communication easier for people who are less well understood by conventional systems. Whether this succeeds must be assessed for individual users, rather than drawing conclusions about all ways of speaking from a general quality score.

Personalisation requires effort and trust

Personal adaptation requires suitable speech samples. This can take time and energy, especially when recording speech is tiring. At the same time, voice recordings contain personal information and must be handled with appropriate care. Good design explains clearly what recordings are used for, who can access them and what options exist for deleting them. Control over recognised statements is also central: a misunderstood order is annoying, while an incorrectly conveyed important wish can be considerably more distressing. Users should therefore be able to check, correct or withhold outputs. The original project description provides a specific development approach, but no proof that every person or every language benefits equally. Results from a particular language and usage context must not be applied to other situations without examination.

Success means less effort spent communicating

When evaluating such aids, the people affected should help determine the criteria. A lower word error rate is relevant, but does not capture the full benefit. The time needed for corrections, reliability with personal names and whether conversations allow greater autonomy also count. A system can be technically more accurate yet still be too slow or cumbersome for spontaneous situations. Tests in different environments and with realistic background noise therefore make sense. Alternative ways of interacting are also needed when speech is not working well at a particular moment. The aim should not be to adapt people to a supposedly normal way of speaking. Helpful AI instead adapts to its users and leaves them to decide when and how it is used.

Sources & further reading

Written in our own words with AI assistance, based on the sources listed above. The text distinguishes research findings, technical prototypes and established knowledge. This feature is not a breaking-news report.

Keep exploring

All features on AI