Grove AI HAT for Edge Computing

[baqwas]

Just placed my pre-order! I have two very basic inquiries:

• Is there any published documentation to prepare in advance of the June arrival of the device?

• Is there a list of supported cameras?

Thanks.

[bill.yu]

Hi there,

1. We are still working on the software, If we get it done and will come out the wiki page.

2. For the Camera, it supports the Sipeed 2.4inch QVGA LCD and DVP camera. we will release the kit with a camera and an LCD next week. thanks.

[drabanus]

Is it possible to upload a generative adversarial network (GAN) model, trained on a custom image set, and have video/audio data be processed in real time? I would like to start with video data of 720p, audio 44kHz, for a total of voice alteration, face detection, object recognition and finally image cropping. Does the SDK allow the use of custom-programmed models?

Another application I would like to ponder is semantic segmentation (i.e. separation of a live video scene into objects, foreground, background etc).

How does the compute power of the Sipeed MAix compare to other deep learning hardware like GPUs? Do you have a benchmark comparison like with an NVIDIA gaming GPU?

[jellyfish]

Just placed my pre-order! I have two very basic inquiries:

• Is there any published documentation to prepare in advance of the June arrival of the device?

• Is there a list of supported cameras?

Thanks.

Hi there,
The wiki page is available now:
http://wiki.seeedstudio.com/Grove_AI_HA ... _Computing

As for the camera, you can use ov2640 and ov5640:
http://seeedstudio.com/OV2640-Fisheye-C ... -4048.html

Have a nice day.

[baozhu.zuo]

Is it possible to upload a generative adversarial network (GAN) model, trained on a custom image set, and have video/audio data be processed in real time? I would like to start with video data of 720p, audio 44kHz, for a total of voice alteration, face detection, object recognition and finally image cropping. Does the SDK allow the use of custom-programmed models?

Another application I would like to ponder is semantic segmentation (i.e. separation of a live video scene into objects, foreground, background etc).

How does the compute power of the Sipeed MAix compare to other deep learning hardware like GPUs? Do you have a benchmark comparison like with an NVIDIA gaming GPU?

Yes, allow the use of custom-programmed models.

Kendryte K210 only have 0.3 TOPS compute power. There's only so much you can do.

[baqwas]

Hello jellyfish,

Hi there,
The wiki page is available now:
http://wiki.seeedstudio.com/Grove_AI_HA ... _Computing

The narration in the note you mention is for Arduino based solutions. I was seeking Raspberry Pi based solutions since the HAT is mounted on a Raspberry Pi. Otherwise, wouldn't it be better to leverage the Maixduino for the Arduino style examples.

I understand that Raspberry Pi Raspbian supports Arduino IDE but what about Python (and rich set of libraries for AI/ML) for the AI HAT? Do we need to install the toolchain along the lines of the Maixduino with some different binaries? Is there some guidance for this type of exercise?

Kind regards.

[bill.yu]

Hi there~

You can refer to https://project.seeedstudio.com/SeeedSt ... -pi-3e100f thanks.

[tristan.mumford]

Hello jellyfish,

I understand that Raspberry Pi Raspbian supports Arduino IDE but what about Python (and rich set of libraries for AI/ML) for the AI HAT? Do we need to install the toolchain along the lines of the Maixduino with some different binaries? Is there some guidance for this type of exercise?

I wish you luck. I have been trying since I received my Grove AI HAT to do anything with it. So far, this is what I have learned:

* It is possible to build the Kendryte toolchain on the Jetson Nano.

*It is not possible to build the Kendryte toolchain on the Raspberry Pi 3. It causes a segfault in gcc during build.

*The link for the board for Arduino doesn't seem to support armhf or aarch64... or something.

*Attempting to use the Arduino board definition leads to Arduino reporting that the kendryte gcc isn't there (which I have, at least on my Jetson), or kflash isn't available on my OS, which I have also installed. Both the kendryte toolchain and kflash are readily available on my system.

*It's impossible to build ArduinoCore-k210 from GitHub. The instructions are flawed, and CMake collapses in a heap anyway.

*The kendryte sdk also doesn't seem to be usable.

Not only do I have the Grove AI HAT, I also have a camera and a TFT for it on the way. I really hope it becomes possible to use the tools on an ARM platform in the near future as that is pretty much all I use these days.

In answer to the Arduino question, yes, the Arduino IDE runs on the RPi3.

[baqwas]

Thanks again for your feedback. I too have learnt the hard way and can understand your predicament.

After reading the Wiki I thought it would be flawless and so patiently spun my wheels trying to improve my self-documentation so that I could blog about it. I was about to place orders for the camera and TFT display but since I have a Maixduino I said to myself that I should do work systematically and not simply splash even nominal sums (camera, TFT) around.

If I had read your note earlier I could have saved myself some time and gone back to work on the Maixduino for now till things are fixed for the AI HAT.

Please do post advice in the future if you get things working. I am not an expert at your level so I need advice as much as I can soak. Many, many thanks for the details.

Kind regards.

[baqwas]

Hello bill.yu,

Tried to follow the instructions you provided at https://project.seeedstudio.com/SeeedSt ... -pi-3e100f

No luck! The install did not do anything and here the output for the second variation you suggested:

Code: Select all

$ sudo ./face-detected.sh
Segmentation fault
$ 

Anything else that I could be checking or testing or installing? I would like to put the AI HAT to some use.

Kind regards.