DIY Alexa: Create Your Own Voice Assistant with ESP32 & TensorFlow Lite!
140.7 هزار بار بازدید -
4 سال پیش
-
We've been building towards this
We've been building towards this project in the previous set of videos. And we're now ready to build our very own DIY Alexa!
All the code for this project is on GitHub - https://github.com/atomic14/diy-alexa
What are we building - 1:15
Wake Word Detection - 2:27
Command Recognition - 11:47
Digging into the code - 16:30
What's life all about Marvin? - 21:52
To detect the wake words we stream audio from either an I2S microphone or from the ADC. The wake word detector looks at a 1-second window of audio. The spectrogram of the audio is calculated and fed into a TensorFlow Lite model.
Once we detect the wake word we stream the audio up to wit.ai to recognise the user's intent.
It works surprisingly well for such a small model, there are improvements that could be made with more training data.
I'll leave the access token for wit.ai live for as long as I can, but at some point, you will need to generate your own wit.ai application.
Let me know how you get on in the comments!
Related Videos:
Audio Input
ICS-43434 A replacement for the old I...
ESP32 Audio Input Showdown: INMP441 v...
ESP32 Audio Input Using I2S and Inter...
Audio Output
ESP32 Audio Output with I2S DMA and t...
And TensorFlow Lite for machine learning
TensorFlow Lite With Platform.io and ...
Components you could use:
MAX98357 - https://amzn.to/3cg88Z5
TinyPico - https://amzn.to/3vVoONp
INMP441 I2S Microphone: https://amzn.to/3cicuiv
ICS-43434 I2S Microphone: https://www.tindie.com/products/21519/
ESP32 Dev board: https://amzn.to/3gb6fyc
Analogue Audio Amplifier: https://amzn.to/3pxkEJr
Speakers: https://amzn.to/3pjWFgq
---
Want to help support the channel? I'm accepting coffee on https://ko-fi.com/atomic14
All the code for this project is on GitHub - https://github.com/atomic14/diy-alexa
What are we building - 1:15
Wake Word Detection - 2:27
Command Recognition - 11:47
Digging into the code - 16:30
What's life all about Marvin? - 21:52
To detect the wake words we stream audio from either an I2S microphone or from the ADC. The wake word detector looks at a 1-second window of audio. The spectrogram of the audio is calculated and fed into a TensorFlow Lite model.
Once we detect the wake word we stream the audio up to wit.ai to recognise the user's intent.
It works surprisingly well for such a small model, there are improvements that could be made with more training data.
I'll leave the access token for wit.ai live for as long as I can, but at some point, you will need to generate your own wit.ai application.
Let me know how you get on in the comments!
Related Videos:
Audio Input
ICS-43434 A replacement for the old I...
ESP32 Audio Input Showdown: INMP441 v...
ESP32 Audio Input Using I2S and Inter...
Audio Output
ESP32 Audio Output with I2S DMA and t...
And TensorFlow Lite for machine learning
TensorFlow Lite With Platform.io and ...
Components you could use:
MAX98357 - https://amzn.to/3cg88Z5
TinyPico - https://amzn.to/3vVoONp
INMP441 I2S Microphone: https://amzn.to/3cicuiv
ICS-43434 I2S Microphone: https://www.tindie.com/products/21519/
ESP32 Dev board: https://amzn.to/3gb6fyc
Analogue Audio Amplifier: https://amzn.to/3pxkEJr
Speakers: https://amzn.to/3pjWFgq
---
Want to help support the channel? I'm accepting coffee on https://ko-fi.com/atomic14
4 سال پیش
در تاریخ 1399/07/13 منتشر شده
است.
140,711
بـار بازدید شده