Fake-Waking Voice Assistant

In a joint project with a research team from China’s Zhejiang University in Hangzhou, researchers from the System Security Lab, led by Prof. Dr. Ahmad-Reza Sadeghi at TU Darmstadt, have systematically investigated the so-called “fake wake phenomenon”. This phenomenon causes common voice assistants to recognize a differing word as their own “wake word” and start listening to commands.

The international researcher team has discovered new insights and valuable finding that manufacturers of voice assistant can utilize to enhance the security of their voice assistants as well as the privacy of users. The team investigated the eight most popular English and Chinese voice assistants regarding the fake wake phenomenon.

Voice assistants typically actively listen to the environment for their native “wake words” such as “Alexa,” “OK Google” or their brand names, to get activated. The fake wake phenomenon appears when the voice assistant detects false wake-up words, so-called “fuzzy words” from, e.g., through conversations or TV shows running in background. These incorrectly recognized words can be used by attackers to activate voice assistants without the user’s awareness.

Automatic generation of false wake-up words

For the first time, the team led by Prof. Wenyuan Xu, Dr. Yanjiao Chen and Prof. Ahmad-Reza Sadeghi has succeeded in automatically and systematically generating their own false wake words instead of screening audio material. The generation of these fuzzy words started with a known initial word such as “Alexa”. The researchers neither had access to the model that recognizes the wake-up words nor to the vocabulary on which the voice assistant is based. In this context, they also investigated the root causes for the acceptance of incorrect wake-up words.

First, they identified the features that most frequently contributed to the acceptance of fuzzy words. The determining factors focused only on a small phonetic section of the word. However, the voice investigated assistants were also able to activate false words that differed significantly from the real wake-up words, whereby, surrounding noises, the volume of the words and the gender of the speaker hardly played a role.

Using genetic algorithms and machine learning, more than 960 custom fuzzy words in English and Chinese could be generated, which activated the “wake-up word detector” of the voice assistants. On the one hand, this shows the severity of the fake wake phenomenon, and on the other hand, it provides a deeper understanding of it.

The impact of fake wake phenomenon can be significantly reduced by retraining the wake word detector of the voice assistant with the generated fuzzy words. This allows the voice assistant to more accurately distinguish between fake and real wake-up words. Voice Assistant manufacturers can highly benefit from the results of this research and re-train the existing models to make them more accurate and less vulnerable to fake wake attacks, and thus increase the security of own products and improve user’s privacy.

Source: Technical University of Darmstadt

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Next Post

Ocean Literacy in Practice: participation in the Bizerte Forum and in the Let’s Make the Mediterranean Blue events

Fri Oct 1 , 2021
The end of September coincides with a bevy of ocean literacy events given the prominence that this thematic has recently gained on the international agenda. Ocean literacy is defined by UNESCO/IOC as “an understanding of the ocean’s influence on you and your influence on the ocean” and it revolves around seven cardinal […]

European Higher Education Organization is a public organization carrying out academic, educational and information activities on higher education in Europe.

The EHEO general plan stresses that:

  • Higher education systems require adequate funding and, as an investment in economic growth, public spending in higher education should be protected.
  • The challenges faced by higher education require more flexible governance and funding systems, which balance greater autonomy for education institutions with accountability to stakeholders.

Thus, EHEO plans:

  • improve academic and scientific interaction of universities;
  • protect the interests of universities;
  • interact more closely with public authorities of European countries;
  • popularize European higher education in the world;
  • develop academic mobility;
  • seek funding for European universities.