Respeaker Core v2 DOA, Echo Cancel, and Pixel ring without AVS

info about ReSpeaker series products

Moderators: lily.li, violet, seth.welday

Post Reply
jjohnston7
Pre-kindergarten
Pre-kindergarten
Posts: 6
Joined: Fri Aug 10, 2018 9:17 pm

Respeaker Core v2 DOA, Echo Cancel, and Pixel ring without AVS

Post by jjohnston7 » Thu Aug 23, 2018 11:59 pm

I will be running my own voice recognition program on this respeaker. I imaged my SD card to respeaker-debian-9-lxqt-sd. and installed my voice recognition program. I say the wake word, it answers, seems to work well.

However, I want to make sure all the benefits of the board are being used. I want to make sure its doing the below

Beam forming
Detection of Arrival
Noise suppression
Echo cancelation
auto gain control

I do not care about wake word, because that is programmed into my voice assistant.

I also would like the LED ring to show the direction of arrival. The only info I have seen has described how to make all this work with Amazon voice services. How can I get all of this to work without.

Does the BF, DOA, NS, EC, AGC all automatically work regardless of what you are running on it for the voice assistant, or how do I achieve my goal? I'm very new, and have no idea where to start.

bill.yu
Junior-7
Junior-7
Posts: 735
Joined: Mon Apr 02, 2018 11:05 am

Re: Respeaker Core v2 DOA, Echo Cancel, and Pixel ring without AVS

Post by bill.yu » Fri Aug 24, 2018 4:54 pm

Hi there,

A. For pixel ring, please refer to https://github.com/respeaker/pixel_ring

B. For DOA,
1. Python : please refer to https://github.com/voice-engine/voice-e ... aker_v2.py
2. C++: please refer to http://respeaker.io/librespeaker_doc/cl ... sNode.html

C. ReSpeakerd: Audio front-end processing algorithms including AEC, Beamforming, NS and KWS
1. http://respeaker.io/librespeaker_doc/
2. https://github.com/respeaker/respeakerd

you can install respeakerd to process the audio no matter what voice assistant you use. thanks.

Bill

jjohnston7
Pre-kindergarten
Pre-kindergarten
Posts: 6
Joined: Fri Aug 10, 2018 9:17 pm

Re: Respeaker Core v2 DOA, Echo Cancel, and Pixel ring without AVS

Post by jjohnston7 » Fri Aug 31, 2018 2:51 am

I was looking through those links.

I installed pixel ring, but when I get to the line "python examples", I get an error importError: no module named gpiozero

for DOA, I see in the files that it is detecting a wake word of Alexa. My setup the voice assistant has its own wake word. I want to avoid having to say alexa, wakeword 2, command... is there a way around that?

I will try and read through that other documentation again, most of it doesn't make any sense to me. lol, I'm very much a noob.

jjohnston7
Pre-kindergarten
Pre-kindergarten
Posts: 6
Joined: Fri Aug 10, 2018 9:17 pm

Re: Respeaker Core v2 DOA, Echo Cancel, and Pixel ring without AVS

Post by jjohnston7 » Fri Aug 31, 2018 5:10 am

Ok, I went through the turtorial listed here http://wiki.seeedstudio.com/ReSpeaker_C ... e-solution

And got everything installed correctly. I'm now on Part 3. Compile and Run AVS C++ SDK. Do I skip this part since I'm not linking to AVS? and do I need to do anything specific to make sure my AI is listening POST processing, or is that all done automatically since everything is installed??

seeed techsupport team
Staff
Staff
Posts: 44
Joined: Mon Mar 19, 2018 11:40 am

Re: Respeaker Core v2 DOA, Echo Cancel, and Pixel ring without AVS

Post by seeed techsupport team » Fri Aug 31, 2018 9:42 am

jjohnston7 wrote:
Fri Aug 31, 2018 2:51 am
I was looking through those links.

I installed pixel ring, but when I get to the line "python examples", I get an error importError: no module named gpiozero

- So you choose the wrong python script, the correct one is respeaker_v2_pixel_ring.py. you choose the respeaker_4mic_array.py, which is for raspberry 4 mic hat.

--------------------------------------------------------------------------------------------------------------------
respeaker@v2:~/pixel_ring/examples$ ls
echo_pattern.py respeaker_v2_pixel_ring.py
respeaker_4mic_array.py usb_mic_array.py
respeaker@v2:~/pixel_ring/examples$ python respeaker_4mic_array.py
Traceback (most recent call last):
File "respeaker_4mic_array.py", line 10, in <module>
from gpiozero import LED
ImportError: No module named gpiozero
respeaker@v2:~/pixel_ring/examples$ python respeaker_v2_pixel_ring.py
--------------------------------------------------------------------------------------------------------------------

for DOA, I see in the files that it is detecting a wake word of Alexa. My setup the voice assistant has its own wake word. I want to avoid having to say alexa, wakeword 2, command... is there a way around that?

- The Keyword spotting is using snowboy, you can config the wakeup word from https://github.com/voice-engine/voice-e ... snowboy.py


I will try and read through that other documentation again, most of it doesn't make any sense to me. lol, I'm very much a noob.

seeed techsupport team
Staff
Staff
Posts: 44
Joined: Mon Mar 19, 2018 11:40 am

Re: Respeaker Core v2 DOA, Echo Cancel, and Pixel ring without AVS

Post by seeed techsupport team » Fri Aug 31, 2018 9:52 am

jjohnston7 wrote:
Fri Aug 31, 2018 5:10 am
Ok, I went through the turtorial listed here http://wiki.seeedstudio.com/ReSpeaker_C ... e-solution

And got everything installed correctly. I'm now on Part 3. Compile and Run AVS C++ SDK. Do I skip this part since I'm not linking to AVS? and do I need to do anything specific to make sure my AI is listening POST processing, or is that all done automatically since everything is installed??
No, you do not need to install avs, for the respeakerd audio processing, Please refer to https://github.com/respeaker/respeakerd ... _MANUAL.md. thanks.

Post Reply