Google Git
Sign in
android / platform / tools / test / openhst / refs/tags/android-12.0.0_r20
tag2202623da1ff0c9872c627552fafc477f9bd62d6
taggerThe Android Open Source Project <initial-contribution@android.com>Tue Dec 14 06:59:34 2021 -0800
objectf7b2e0c6e7d321e3d859f4de6dff13ad13df7c11 
Android 12.0.0 release 20
commitf7b2e0c6e7d321e3d859f4de6dff13ad13df7c11[log] [tgz]
authorXin Li <delphij@google.com>Sat Feb 20 15:21:55 2021 +0000
committerAutomerger Merge Worker <android-build-automerger-merge-worker@system.gserviceaccount.com>Sat Feb 20 15:21:55 2021 +0000
treefe60ed2f76b9fafd353203be1470ee1461931cb5
parent98fd771f5484ce3476919587295da89bc0abe7d4 [diff]
parent0ea8647337c74058e16ce33785a77e0c602c6942 [diff]
[automerger skipped] Mark ab/7061308 as merged in stage. am: 42d4f7f02d -s ours am: 0ea8647337 -s ours

am skip reason: Change-Id I95a79fb0e8b9b1288c9cbc16342c0848c832be35 with SHA-1 a701b9ae97 is in history

Original change: undetermined

MUST ONLY BE SUBMITTED BY AUTOMERGER

Change-Id: Iec44e5216b8614709b4cc4d4b8cf4d4999aa7b49
tree: fe60ed2f76b9fafd353203be1470ee1461931cb5
  1. docs/
  2. resources/
  3. LICENSE
  4. Makefile
  5. OWNERS
  6. README.md
  7. requirements.txt
  8. start_venv.sh
  9. stress_test.proto
  10. stress_test.py
  11. stress_test_common.py
README.md

OpenHST : Open sourced Hotword Stress Test tool

Hotword stress test tool is a python script to measure the Google Hotword performance on Android devices with simple test set up. The goal of OpenHST is making Google Hotword Stress Test tool as an open source project so that Android Partners can easily adapt on their development.

Overview

Hotsord Stress Test concept diagram

Prerequsite

Before setting up your HST test environment, please make sure to meet following preconditions.

  • DSP hotword capability on test device (android handset)
  • ADB connection between the test server and android handset
  • Internet connection on android handset
  • No screen lock setting on android handset
  • Install Homebrew (Mac)
  • Install pyenv for Linux and Mac.
  • Install GNU make(3.81 above) on test machine (Linux, Mac, Windows)

Test environment setup

Please follow below steps to set up HST on your test machine and make sure that no error popped up during the installation.

Linux & Mac

  1. pyenv install 3.6.8
  2. pyenv shell 3.6.8
  3. make start
  4. chmod +x ./start_venv.sh
  5. source env/bin/activate
  6. ./start_venv.sh
  7. make proto-compile

Windows

  1. install python3.7.5
  2. make start
  3. .\env\Scripts\activate
  4. pip3 install -r requirements.txt
  5. Download protoc.ext (3.11.4 version) from github
  6. Decompress protoc-3.11.4-win64.zip and copy bin/protoc.exe to env/ folder
  7. Decompress protoc-3.11.4-win64.zip and copy include/* under env/include folder
  8. make proto-compile

Voice model training

Before conducting stress test, voice model should be trained with the recorded tts sound.

  1. Please follow the guide in “Train voice model” chapter in OEM Hotword Stress Test with OpenHST

Stress Test

Please refer to the guide in “Run Stress Test” chapter in OEM Hotword Stress Test with OpenHST and run the hotword stress test.

  1. python stress_test.py --test_name dsp_trigger_and_screen_off --num_iterations 3000 --output_root test_out
  2. Over 95% pass ratio from 3000 test cycle would be fair enough to declare that the device passed the hotowrd stress test

Contacts

Join our mailing list for discussions and announcements.