This device detects different household sounds through tinyML
Arduino Team — July 14th, 2022
For people who suffer from hearing loss or other auditory issues, maintaining situational awareness can be vital for keeping safe and autonomous. This problem is what inspired the team of Lucia Camacho Tiemblo, Spiros Kotsikos, and Maria Alifieri to create a small device that can alert users to certain household sounds on their phone.
The team decided to incorporate embedded machine learning in order to recognize ambient sounds, so they opted for an Arduino Nano 33 BLE Sense. After recording many samples of various events, such as a conversation, knocking on the door, the TV, a doorbell, and silence, they fed them into a tinyML model with the help of Edge Impulse’s Studio. The resulting model was able to successfully differentiate between events around 90% of the time.
Beyond merely outputting the recognized audio to a serial monitor, the team’s firmware also allows for the results to be sent over Bluetooth® Low Energy where a connected smartphone can read the data and display it. The mobile app contains three simple buttons for accessing a list of sounds, certain settings, and a submenu for managing the connection with the Arduino.
We care about the privacy and personal data of our users.
To continue, please give us your consent:
Please confirm that you have read the privacy policy
Thank you for subscribing!
Curious to learn more?
Are you also a teacher, student, or professional that loves using Arduino in your day-to-day activities?
Then keep up-to-date with either our STEM or Professional monthly newsletters.
Arduino weekly newsletter (already subscribed)
Educators can benefit from the ever growing tech that shapes our environment through fun cool projects.
Why not awe your boss with highly innovative ways to help keep your enterprise connected at no extra cost?
Arduino Survey
We'd like to get to know you little better.
Please help us improve by answering this super short optional survey.