this post was submitted on 08 Nov 2023
1 points (100.0% liked)

Machine Learning

1 readers
1 users here now

Community Rules:

founded 11 months ago
MODERATORS
 

If you or anyone you know works on computer vision models deployed on the edge, would love to understand what type of hardware do you deploy to.

Trying to understand the various options that exist when it comes to deploying computer vision models on devices. Some boards that I am aware of are:

NVIDIA Jetson series
Qualcomm 605 SOC
Raspberry Pi
BeagleBoard
Arducam Pico4ML

But wondering what is the industry standard for applications such as manufacturing robots, drones, autonomous robots that use lidar

top 12 comments
sorted by: hot top controversial new old
[–] sshh12@alien.top 1 points 10 months ago

Can't speak for industry standards, but a little bit ago I worked on aerial object recognition and we used YOLO + NVIDA Jetson. Jetson seemed like the best GPU accelerated hardware that was light enough to mount to a smallish drone.

[–] nins_@alien.top 1 points 10 months ago

Jetson family.

[–] Tiny_Arugula_5648@alien.top 1 points 10 months ago

You should also check out the Coral TPU boards, they are more efficient for models.

[–] btcmx@alien.top 1 points 10 months ago

For CV, Jetson family! The following source has a high level overview of challenges and solutions when deploying NVIDIA TAO on Jetson devices.

[–] CheeseDon@alien.top 1 points 10 months ago
[–] 3DHydroPrints@alien.top 1 points 10 months ago

In the company I work, we have a couple of Jetsons laying around for development

[–] FrereKhan@alien.top 1 points 10 months ago

Speck from SynSense

[–] Erosis@alien.top 1 points 10 months ago

No one has mentioned this yet, but ESP32-S and -H are convenient low power platforms.

[–] VAL9THOU@alien.top 1 points 10 months ago

Normally Jetson Xavier NX and I believe Mobilenet, but I'm not involved with our edge CV models

[–] fakefakedroon@alien.top 1 points 10 months ago (1 children)

we recently switched from Jetson Xavier to Jetson Orin boxes.

And we have a suite of algos. Yolov5 for bboxes, SoloV2 for masks, and Efficientnet for classification. We also use them for image capturing but that's a bit overkill. They have a full web app stack with db etc and our product's UI running on them + the inference engine. So pretty capable little boxes.

[–] acertainmoment@alien.top 1 points 10 months ago

this is very informative. is there any incentive for you guys to try out new architectures? yolov5 and solov2 are already 4+ years old.

[–] Complex-Indication@alien.top 1 points 10 months ago

You can deploy computer vision model pretty much on anything, depending on your requirements (model size/inference time).

I see you put some wildly different boards there (pico4ml is Cortex M0 based and is extremely low power, but really can only run tiny models all the way to Jetson series, which are GPU enabled MPU-based boards). That probably means you have no clear idea on what models you are going to be running - and that really should be a starting point.

But since you mentioned "manufacturing robots, drones, autonomous robots"", then I can tell you that Pico4ML and likely Raspberry Pi are out of question. Jetson Nano is getting EoLd and Nvidia is moving to Orin - that one is very capable, but also very expensive and power-hungry.

To see some other options, there is a nice list here https://docs.edgeimpulse.com/docs/development-platforms/fully-supported-development-boards (Disclaimer: I work for EI - but you don't have to use them).

Also, I have a YT channel on Edge ML and Robotics https://www.youtube.com/c/hardwareai