Grove AI HAT for Edge Computing

Grove is a modulated, ready-to-use tool set.
Much like Lego, it takes a building block approach to assembling electronics.

Moderators: lily.li, violet, jeremy882, crail.lyu969

baqwas
Pre-kindergarten
Pre-kindergarten
Posts: 31
Joined: Tue Dec 29, 2015 4:28 am

Grove AI HAT for Edge Computing

Post by baqwas » Fri May 10, 2019 1:30 am

Just placed my pre-order! I have two very basic inquiries:
  • Is there any published documentation to prepare in advance of the June arrival of the device?
  • Is there a list of supported cameras?
Thanks.

bill.yu
Elementary-5
Elementary-5
Posts: 597
Joined: Mon Apr 02, 2018 11:05 am

Re: Grove AI HAT for Edge Computing

Post by bill.yu » Fri May 10, 2019 10:31 am

Hi there,

1. We are still working on the software, If we get it done and will come out the wiki page.

2. For the Camera, it supports the Sipeed 2.4inch QVGA LCD and DVP camera. we will release the kit with a camera and an LCD next week. thanks.

drabanus
Pre-kindergarten
Pre-kindergarten
Posts: 1
Joined: Wed May 29, 2019 3:24 pm

Re: Grove AI HAT for Edge Computing

Post by drabanus » Wed Jun 05, 2019 12:33 am

Is it possible to upload a generative adversarial network (GAN) model, trained on a custom image set, and have video/audio data be processed in real time? I would like to start with video data of 720p, audio 44kHz, for a total of voice alteration, face detection, object recognition and finally image cropping. Does the SDK allow the use of custom-programmed models?

Another application I would like to ponder is semantic segmentation (i.e. separation of a live video scene into objects, foreground, background etc).

How does the compute power of the Sipeed MAix compare to other deep learning hardware like GPUs? Do you have a benchmark comparison like with an NVIDIA gaming GPU?

User avatar
jellyfish
Pre-kindergarten
Pre-kindergarten
Posts: 29
Joined: Fri Nov 09, 2012 9:31 am

Re: Grove AI HAT for Edge Computing

Post by jellyfish » Wed Jun 05, 2019 5:45 pm

baqwas wrote:
Fri May 10, 2019 1:30 am
Just placed my pre-order! I have two very basic inquiries:
  • Is there any published documentation to prepare in advance of the June arrival of the device?
  • Is there a list of supported cameras?
Thanks.
Hi there,
The wiki page is available now:
http://wiki.seeedstudio.com/Grove_AI_HA ... _Computing

As for the camera, you can use ov2640 and ov5640:
http://seeedstudio.com/OV2640-Fisheye-C ... -4048.html

Have a nice day.
---------------
Best Regards
Jelly

Seeed Techsupport Team

baozhu.zuo
Pre-kindergarten
Pre-kindergarten
Posts: 6
Joined: Fri May 04, 2018 8:59 am

Re: Grove AI HAT for Edge Computing

Post by baozhu.zuo » Wed Jun 05, 2019 5:54 pm

drabanus wrote:
Wed Jun 05, 2019 12:33 am
Is it possible to upload a generative adversarial network (GAN) model, trained on a custom image set, and have video/audio data be processed in real time? I would like to start with video data of 720p, audio 44kHz, for a total of voice alteration, face detection, object recognition and finally image cropping. Does the SDK allow the use of custom-programmed models?

Another application I would like to ponder is semantic segmentation (i.e. separation of a live video scene into objects, foreground, background etc).

How does the compute power of the Sipeed MAix compare to other deep learning hardware like GPUs? Do you have a benchmark comparison like with an NVIDIA gaming GPU?
Yes, allow the use of custom-programmed models.

Kendryte K210 only have 0.3 TOPS compute power. There's only so much you can do.

baqwas
Pre-kindergarten
Pre-kindergarten
Posts: 31
Joined: Tue Dec 29, 2015 4:28 am

Re: Grove AI HAT for Edge Computing

Post by baqwas » Thu Jul 11, 2019 11:26 am

Hello jellyfish,
Hi there,
The wiki page is available now:
http://wiki.seeedstudio.com/Grove_AI_HA ... _Computing
The narration in the note you mention is for Arduino based solutions. I was seeking Raspberry Pi based solutions since the HAT is mounted on a Raspberry Pi. Otherwise, wouldn't it be better to leverage the Maixduino for the Arduino style examples.

I understand that Raspberry Pi Raspbian supports Arduino IDE but what about Python (and rich set of libraries for AI/ML) for the AI HAT? Do we need to install the toolchain along the lines of the Maixduino with some different binaries? Is there some guidance for this type of exercise?

Kind regards.

bill.yu
Elementary-5
Elementary-5
Posts: 597
Joined: Mon Apr 02, 2018 11:05 am

Re: Grove AI HAT for Edge Computing

Post by bill.yu » Thu Jul 11, 2019 11:32 am


tristan.mumford
Pre-kindergarten
Pre-kindergarten
Posts: 5
Joined: Mon Apr 15, 2019 6:49 pm

Re: Grove AI HAT for Edge Computing

Post by tristan.mumford » Thu Jul 11, 2019 1:59 pm

baqwas wrote:
Thu Jul 11, 2019 11:26 am
Hello jellyfish,

I understand that Raspberry Pi Raspbian supports Arduino IDE but what about Python (and rich set of libraries for AI/ML) for the AI HAT? Do we need to install the toolchain along the lines of the Maixduino with some different binaries? Is there some guidance for this type of exercise?
I wish you luck. I have been trying since I received my Grove AI HAT to do anything with it. So far, this is what I have learned:

* It is possible to build the Kendryte toolchain on the Jetson Nano.

*It is not possible to build the Kendryte toolchain on the Raspberry Pi 3. It causes a segfault in gcc during build.

*The link for the board for Arduino doesn't seem to support armhf or aarch64... or something.

*Attempting to use the Arduino board definition leads to Arduino reporting that the kendryte gcc isn't there (which I have, at least on my Jetson), or kflash isn't available on my OS, which I have also installed. Both the kendryte toolchain and kflash are readily available on my system.

*It's impossible to build ArduinoCore-k210 from GitHub. The instructions are flawed, and CMake collapses in a heap anyway.

*The kendryte sdk also doesn't seem to be usable.

Not only do I have the Grove AI HAT, I also have a camera and a TFT for it on the way. I really hope it becomes possible to use the tools on an ARM platform in the near future as that is pretty much all I use these days.

In answer to the Arduino question, yes, the Arduino IDE runs on the RPi3.

baqwas
Pre-kindergarten
Pre-kindergarten
Posts: 31
Joined: Tue Dec 29, 2015 4:28 am

Re: Grove AI HAT for Edge Computing

Post by baqwas » Fri Jul 12, 2019 11:22 am

Thanks again for your feedback. I too have learnt the hard way and can understand your predicament.

After reading the Wiki I thought it would be flawless and so patiently spun my wheels trying to improve my self-documentation so that I could blog about it. :D I was about to place orders for the camera and TFT display but since I have a Maixduino I said to myself that I should do work systematically and not simply splash even nominal sums (camera, TFT) around.

If I had read your note earlier I could have saved myself some time and gone back to work on the Maixduino for now till things are fixed for the AI HAT.

Please do post advice in the future if you get things working. I am not an expert at your level so I need advice as much as I can soak. Many, many thanks for the details.

Kind regards.

baqwas
Pre-kindergarten
Pre-kindergarten
Posts: 31
Joined: Tue Dec 29, 2015 4:28 am

Re: Grove AI HAT for Edge Computing

Post by baqwas » Fri Jul 12, 2019 12:05 pm

Hello bill.yu,

Tried to follow the instructions you provided at https://project.seeedstudio.com/SeeedSt ... -pi-3e100f

No luck! The install did not do anything and here the output for the second variation you suggested:

Code: Select all

$ sudo ./face-detected.sh
Segmentation fault
$ 
Anything else that I could be checking or testing or installing? I would like to put the AI HAT to some use. :D

Kind regards.

Post Reply