fbpx

Spatial AI Track

Develop a high-quality depth estimation project using OpenCV AI Kit with Depth Pro (OAK-D-Pro) Spatial AI Camera designed and developed by Luxonis.

Organiser:
OpenCV Foundation

Introduction

Depth estimation is traditionally done using a pair of cameras called a stereo pair. 

Depth Estimation algorithms using Neural Networks have made enormous strides recently. Some algorithms estimate depth using a single image (monocular depth), others use neural networks to improve the depth estimated using a stereo pair, and some improve the depth estimation for RGBD cameras.

This track aims to develop a high-quality depth estimation project using OpenCV AI Kit with Depth Pro (OAK-D-Pro) Spatial AI Camera. This camera was designed and developed by our partner Luxonis.

OAK-D-Pro uses the stereo pair for depth estimation, although independent researchers have also used all three cameras to improve results. The goal is to use neural networks to improve depth estimation on this device by combining traditional computer vision techniques and modern Deep Learning approaches. You can use one, two, or all three cameras on OAK-D-Pro. 

OAK-D-Pro uses the well-documented Python API called Depth-AI API. Participants can also ask questions on the Luxonis Discord Channel.  

OAK-D-Pro consists of a stereo pair and an RGB camera. In addition, it has an Intel Myriad X processor capable of 4 TOPS processing power (1.4 TOPS for AI). OAK-D-Pro can be thought of as an RGBD camera with a powerful neural processor that can be used to improve depth estimates.

Two-Stage Track

This competition track will consist of two stages - Prelims & Finals.

Prelims

Participants can enter the Prelims Stage of the competition by submitting a proposal with the following details by 23:59:59 September 19th 2022 UTC-8 1. Team
  • Team Name: Make it fun.
  • Team members: Names and brief bios of up to 4 team members. Showing your work with a link to GitHub is also recommended.
2. Proposal:
  • Details: Provide details of what algorithms you are planning you use. You may submit multiple ideas that you are planning to try.
  • Background: Demonstrating good knowledge of existing research in the area will improve your chances. So provide copious references.

Finals

Twenty-five teams will be selected for the Finals based on the strength of your proposal. Each team will receive one OAK-D-Pro within 15 days of announcement.

We will release a list of scenarios on which we will test the algorithm.

The teams must submit their final results by 23:59:59 December 18th 2022 UTC-8. The final submission will consist of -

1. Working code: 80% of the credit will be awarded for the working code and/or model with instructions on how to run it on an OAK-D-Pro.  
  • Code running at 15 fps or faster will be judged only on quality.
  • There will be a penalty for code running slower than 15 fps. This means that slower code needs to produce very good results to win.
2. Video submission: The remaining 20% of the credit will be for a video (~5 mins) explaining the algorithm and showing a demo.

Prizes

Prelims

The top 25 teams selected for
the finals will receive an OAK-D-Pro.

Finals

The top three winning teams
will receive $5k, $3k, and $2k
cash awards, respectively.

OAK-D-Pro Specs

This track is based around improving depth estimation for OAK-D-Pro

Relevant Specifications

Feature
Color camera
Stereo pair
Sensor
IMX378
OV9282
DFOV / HFOV / VFOV
81° / 69° / 55°
81° / 72° / 49°
Resolution
12MP (4032x3040)
1MP (1280x800)
Focus
Auto-Focus: 8cm - ∞
Fixed-Focus: 19.6cm - ∞
Max Framerate
60 FPS
120 FPS
F-number
2.0
2.2
Lens size
1/2.3 inch
1/4 inch
Laser dot projector projects many small dots in front of the device, which helps with disparity matching, especially for low-visual-interest surfaces (blank surfaces with little to no texture), such as a wall or floor. The technique we use is called ASV – conventional active stereo vision – as stereo matching is performed on the device the same way as on OAK-D (passive stereo).

Join the waitlist to receive a 10% discount

Courses are (a little) oversubscribed and we apologize for your enrollment delay. As an apology, you will receive a 10% discount on all waitlist course purchases. Current wait time will be sent to you in the confirmation email. Thank you!