ReactNative_WakeWordDetection

Create any wake word, deploy on any device and operating system.

Objective-C

ReactNative KeywordsDetection by Davoice

Welcome to Davoice WakeWord / Keywords Detection – Wake words and keyword detection solution designed by DaVoice.io.

About this project

This is a “wake word” package for React Native. A wake word is a keyword that activates your device, like “Hey Siri” or “OK Google”. “Wake Word” is also known as “keyword detection”, “Phrase Recognition”, “Phrase Spotting”, “Voice triggered”, “hotword”, “trigger word”

It also provide Speech to Intent. Speech to Intent refers to the ability to recognize a spoken word or phrase
and directly associate it with a specific action or operation within an application. Unlike a “wake word”, which typically serves to activate or wake up the application,
Speech to Intent goes further by enabling complex interactions and functionalities based on the recognized intent behind the speech.

For example, a wake word like “Hey App” might activate the application, while Speech
to Intent could process a phrase like “Play my favorite song” or “Order a coffee” to
execute corresponding tasks within the app.
Speech to Intent is often triggered after a wake word activates the app, making it a key
component of more advanced voice-controlled applications. This layered approach allows for
seamless and intuitive voice-driven user experiences.

Latest news

New npm install: Now you can integrate Davoice without any additional integrations by using “npm install react-native-wakeword” make sure you install version >= 1.0.25. Wake word npm package:: https://www.npmjs.com/package/react-native-wakeword
New Car Parking Example: Checkout our new Voice Activated Car Parking example, with voice control both in Foreground and Background: example_car_parking/.

Features

Easy to deploy with React Native: Check out our example: “rn_example/DetectingKeyWords.js”. With a few simple lines of code, you have your own keyword detecting enabled app.
Cross-Platform Support: Integrate Davoice KeywordsDetection into React-Native Framework. Both iOS and Android are supported.
Low Latency: Experience near-instantaneous keyword detection.
High Accuracy: We have succesfully reached over 99% accurary for all our models. Here is on of our customer’s benchmarks:
Real-World Benchmarks: At DaVoice, we believe in real benchmarks done by customers on actual use cases rather than static tests. We actively encourage our customers to share their real-world experiences and results.

🟢🟢 Customer Benchmarks 🟢🟢

Customer Benchmark Ⅰ:

Provided by Tyler Troy, CTO & Co-Founder of LookDeep Health

Tyler Troy conducted an independent benchmark at LookDeep Health to select a “phrase detection” vendor.

RESULTS BELOW:

🔵 Crucial Criteria Ⅰ - False Positives

This is THE most crucial criteria, in hospital settings, false alerts are unacceptable—they waste valuable time and can compromise patient care.
✅ DaVoice: “ZERO FALSE POSITIVES” within a month duration of testing.
In contrast, Picovoice triggered several false alerts during testing, making it unsuitable for critical environments like hospitals.
OpenWakeWord was not tested for false positives because its true positive rate was too low.

🔵 Criteria II - True Positive

Table 1: A comparison of model performance on custom keywords

MODEL         DETECTION RATE
===========================
DaVoice                    0.992481 ✅
Porcupine (Picovoice)      0.924812
OpenWakeWords              0.686567

Read Tyler Troy, CTO & Co-Founder of LookDeep, Reddit post:
Bulletproof Wakeword/Keyword Spotting

Customer Benchmark II - customer preferred to remain anonymous

Benchmark on “Python wake word”, vs top competitors:

Benmark used recordings with 1326 TP files.
Second best was on of the industry top players who detected 1160 TP
Third detected TP 831 out of 1326

Table 1: A comparison of model performance on custom keywords

MODEL         DETECTION RATE
===========================
DaVoice        0.992458
Top Player     0.874811
Third          0.626697

Platforms and Supported Languages

React-Native Android: React Native Wrapper for Android.
React-Native iOS: React Native Wrapper for iOS.

Wake word generator

Create your “custom wake word”"

In order to generate your custom wake word you will need to:

Create wake word mode:
Contact us at [email protected] with a list of your desired “custom wake words”.

We will send you corresponding models typically your wake word phrase .onnx for example:

A wake word *“hey sky” will correspond to hey_sky.onnx.
Add wake words to Android:
Simply copy the new onnx files to:

android/app/src/main/assets/*.onnx
Add Wake word to IOS
Copy new models somewhere under ios/YourProjectName.

You can create a folder ios/YourProjectName/models/ and copy there there.

Now add each onnx file to xcode making sure you opt-in “copy if needed”.
In React/JS code add the new onnx files to your configuration

Change:

    // Create an array of instance configurations

    const instanceConfigs:instanceConfig[] = [
  
      { id: 'need_help_now', modelName: 'need_help_now.onnx', threshold: 0.9999, bufferCnt: 3 , sticky: false },
  
    ];
  
    To:
  
    // Create an array of instance configurations
  
    const instanceConfigs:instanceConfig[] = [
  
      { id: 'my_wake_word', modelName: 'my_wake_word.onnx', threshold: 0.9999, bufferCnt: 3 , sticky: false },
  
    ];
  
    For example if your generated custom wake word" is "hey sky":
  
    // Create an array of instance configurations
  
    const instanceConfigs:instanceConfig[] = [
  
      { id: 'hey sky', modelName: 'hey_sky.onnx', threshold: 0.9999, bufferCnt: 3 , sticky: false },
  
    ];

Last step - Rebuild your project

Contact

For any questions, requirements, or more support for React-Native, please contact us at [email protected].

Installation and Usage

Simply using npm install - package

npm install react-native-wakeword

Wake word npm package From :: https://www.npmjs.com/package/react-native-wakeword

On Android:

Please add the following to android/build.gradle


allprojects {

    repositories {
    
        // react-native-wakeword added
	
	    maven { url "${project(":react-native-wakeword").projectDir}/libs" }
     
        maven { url("${project(':react-native-wakeword').projectDir}/libs") } 
	
        maven {
	
            url("${project(':react-native-wakeword').projectDir}/libs")
	    
        }
	
        // End react-native-wakeword added
	
        ... your other lines...

See example_npm for a specific example of using the code.

Demo Instructions

To run the demo:

Clone the repository:

 git clone https://github.com/frymanofer/ReactNative_WakeWordDetection

npm install

Run ‘npm install’

Navigate to the example directory:
```
cd example_npm
```
For Android:
```
npx react-native run-android
```
Depending on your system, you may be required to press “a” for Android.

Note: If you don’t have an Android environment setup (Gradle, Android device or Emulator, Java, etc.) and need help, please contact us at [email protected].
For iOS:
```
npx react-native run-ios
```
Depending on your system, you may be required to press “i” for iOS.

You may need to:

cd ios && pod cache clean --all && pod deintegrate && pod install --repo-update

Than open Xcode and run in Xcode
Note: If you don’t have an iOS environment setup (Xcode, CocoaPods, iOS device or Emulator, etc.) and need help, please contact us at [email protected].

Screenshots from the demo App

Make sure you allow Audio Permission
The app need to ask Audio permission, make sure you allow it as it is necessary for wake word detection.
If You are using Android Emulator - make sure you enable Microphone as below:
The settings screen showing virtual microphone configuration in the Android emulator.
Listening for Wake Word:
The app is actively listening for the wake word “Need Help Now.”
Wake Word Detected:
The app has detected the wake word “Need Help Now.”

Usage Example

For simple installation go to example_npm and build the react native example based on package.json

For example working in the background on both IOS and Android go to example or example_car_parking and build the react native app based on package.json

Below is an example, however. the best thing is to look at the update code in one of the example folders

Here is “wake word” detection example using npm install react-native-wakeword:

//import useModel from react-native-wakeword;
import useModel from 'react-native-wakeword';

// Declare your wake word models:
// Using the below interface:
interface instanceConfig {
  id: string;
  modelName: string;
  threshold: number;
  bufferCnt: number;
  sticky: boolean;
}
// Create an array of instance configurations or "wake words"
const instanceConfigs:instanceConfig[] = [
  { id: 'need_help_now', modelName: 'need_help_now.onnx', threshold: 0.9999, bufferCnt: 3 , sticky: false },
  { id: 'default', modelName: "", threshold: 0.9999, bufferCnt: 2 , sticky: false }
];

function App(): React.JSX.Element {
   // ....
    // your code ....
    // Load the wake word functionality:
   const { stopListening, loadModel, setKeywordDetectionLicense} = useModel();
   //...

   // Declare your wake word callback:
    const keywordCallback = async (keywordIndex: any) => {
    //...

    const initializeKeywordDetection = async () => {
      try {
        // Wait for audio permission to be granted
        // Call your audio permission function await AudioPermissionComponent();
	// Setup the license
	await setKeywordDetectionLicense(
          "MTczNDIxMzYwMDAwMA==-tNV5HJ3NTRQCs5IpOe0imza+2PgPCJLRdzBJmMoJvok=");
        // Load the models - also starts listening.  
        await loadModel(instanceConfigs, keywordCallback);
      } catch (error) {
        console.error('Error during keyword detection initialization:', error);
      }
    };
    // Call initialization
    initializeKeywordDetection();  // Call the async function inside useEffect

Below is a simple JavaScript code showing how to use Davoice KeywordsDetection:

// Import the main class
import KeyWordRNBridge from 'react-native-davoice-keywordsdetection';

// Setup your callback on keyword / wakeword detected
const onKeyWordDetected = async (keywordIndex) => {
  // Do whatever you need on callback
  // Stop searching for Keywords if it makes sense - KeyWordRNBridge.stopKeyWord();
};

// Setup and activate keywords detection
try {
  let modelParams = {
    modelName: "my_key_word.onnx", // replace with your model
    threshold: 0.9999, // false positive sensitivity
    falsePositiveChecks: 2 // How many checks for false positives
  };

  // Initialize the detection
  const result = await KeyWordRNBridge.initKeywordDetection(
    modelParams.modelName, 
    modelParams.threshold, 
    modelParams.falsePositiveChecks
  );

  await KeyWordRNBridge.setKeywordDetectionLicense(
          "MTcyODkzOTYwMDAwMA==-XPLwWg6m4aFC9YMJZu0d0rKIh2AsExYixyeCpiVQmpE="); // Set a valid license!!!!

  // Setup the callback
  KeyWordRNBridge.onKeywordDetectionEvent((event) => {
    onKeyWordDetected(event);
  });

  // Now we are set - you can start listening and detect key words
  KeyWordRNBridge.startKeywordDetection();
} catch (e) {
  console.log("ERROR loadDavoice", e);
}

Benchmark.

Our customers have benchmarked our technology against leading solutions, including Picovoice Porcupine, Snowboy, Pocketsphinx, Sensory, and others.
In several tests, our performance was comparable to Picovoice Porcupine, occasionally surpassing it, however both technologies consistently outperformed all others in specific benchmarks.
For detailed references or specific benchmark results, please contact us at [email protected].

Activating Microphone while the app operates in the background or during shutdown/closure.

This example in the Git repository enables Android functionality in both the foreground and background, and iOS functionality in the foreground. However, we have developed an advanced SDK that allows the microphone to be activated from a complete shutdown state on Android and from the background state on iOS. If you require this capability for your app, please reach out to us at [email protected].

Example for iOS Background State

The example below, built in React Native, demonstrates this approach. The function backgroundMicEmptyListener() creates a minimal listener with negligible CPU impact, only processing the function call and return.

Apple restricts background microphone access for privacy and battery efficiency. However, certain applications, such as security apps, car controlling apps, apps for the blind or visually impaired may require this functionality.

Below is an example for one of the workarounds we have done in order to activate microphone with an empty listener. This approach avoids unnecessary battery usage until real audio capture is needed, at which point you can swap the placeholder listener with the actual microphone callback.

const handleAppStateChange = (nextAppState) => {
  console.log("handleAppStateChange(): ", nextAppState);
  
  if (nextAppState === 'background') {
    console.log("nextAppState === 'background'");
    BackgroundJob.start(backgroundMicEmptyListener, backgroundOptions)
      .then(() => {
        console.log('Background job started successfully');
      })
      .catch((err) => {
        console.error('Error starting background job:', err);
      });
  }
}

Key words

DaVoice.io Voice commands / Wake words / Voice to Intent / keyword detection npm for Android and IOS.
“Wake word detection github”
“Wake Word”
“keyword detection”
“Phrase Recognition”
“Phrase Spotting”
“Voice triggered”
“hotword”
“trigger word”
“react-native wake word”,
“Wake word detection github”,
“Wake word generator”,
“Custom wake word”,
“voice commands”,
“wake word”,
“wakeword”,
“wake words”,
“keyword detection”,
“keyword spotting”,
“speech to intent”,
“voice to intent”,
“phrase spotting”,
“react native wake word”,
“Davoice.io wake word”,
“Davoice wake word”,
“Davoice react native wake word”,
“Davoice react-native wake word”,
“wake”,
“word”,
“Voice Commands Recognition”,
“lightweight Voice Commands Recognition”,
“customized lightweight Voice Commands Recognition”,
“rn wake word”