OAK-D

OAK-D

{{{name2}}}

{{{name3}}}

{{{name4}}}

{{{name5}}}

Primary Attribute Category: {{{userDefinedInfo}}}: {{{userdefinedvalue}}} Brand:

Website International: OAK-D; OAK-D-PoE Chinese: 官方中文站点

Onboard Interfaces

Related Products

Overview

Onboard Intel® Movidius™ Myriad™ X vision processor, OAK-D is an AI vision intelligent kit designed and produced by the OpenCV team. Although it is tiny, it integrates a 4K RGB binocular depth camera, IMU and a high-performance AI processing chip to realize the binocular depth visual computing and neural network reasoning. The inertial navigation sensor is integrated into a single camera, allowing users to obtain binocular vision measurement positioning, AI neural network acceleration, and 4K H.265 30-frame real-time streaming with a low power consumption of 2.5W. It meets the needs of users in intelligent driving, intelligent transportation, intelligent security, robots, teaching competitions, etc.
OAK-D-PoE is based on the OAK-D with a PoE power supply circuit that allows a single Cat5e (or higher) Ethernet cable (up to 100 meters (328 feet))to power and provides a 1,000 Mbps (1 Gbps) full-duplex connection to devices. With the IP67 protection grade shell, it is suitable for users to use in environments that have requirements.
OAK-D-Lite is the most cost-effective product in the OAK USB series. Except for no IMU, the performance is comparable to OAK-D, but the price is lower. It combines depth perception, object detection (neural reasoning), and object tracking, and helps you achieve these functions with a simple and easy-to-use Python API. This OAK-D-Lite includes three onboard cameras (one 4K/30fps RGB camera, two monochrome binocular cameras) and a USB3.0 Type-C interface, you can use it on an ordinary computer, Raspberry Pi, or other popular embedded host to access the OAK through the USB interface.
OAK-D-Pro is an upgraded version of the OAK-D with structured light ranging, featuring an IR laser dot matrix emitter (active depth vision), and IR illuminated LEDs (for "night vision"). It is also smaller, lighter, and more precise than the OAK-D. With built-in high-performance Myriad X VPU, it adopts the active binocular vision technology and structured light, which improves the positioning accuracy to the sub-millimeter level, meeting the needs of close-range high-precision positioning and identification, such as automatic welding robots, the positioning, identification, and calibration of surface defects of parts, etc. and enhancing the robot's perception capabilities.

Features

• Depth measuring range: 0.2 ~ 35m
• Depth camera: Global shutter 120fps / 3MP 200fps
• RGB camera: 12MP 60fps / 13MP 60fps
• AI chip: Intel Myriad X 4TOPS computing performance
• Video plug flow: 4K 30 fps H.265 plug flow
• Interface: USB3.0 Type-C (OAK-D/OAK-D-Lite/OAK-D-Pro) / PoE (OAK-D-PoE)
• Expansion interfaces: GPIO, SPI, UART
• NN platform support: all platforms
• Average power consumption: 2.5W ~ 5W
• Development language: Python, C++
• Eclosure: Aluminum enclosure

Camera Specifications

OAK-D/OAK-D-PoE

Camera	Color camera	Monochrome camera
Shutter	Rolling	Global
Sensor	IMX378	OV9282
Max framerate	60fps	120fps
H.265 framerate	30fps	/
Resolution	12MP (4056 × 3040 px/ 1.55um)	1MP (1280 × 800 px/3um)
FoV	81° DFoV – 68.8° HFoV	81° DFoV – 71.8° HFoV
Lens size	1/2.3 Inch	1/2.3 Inch
Focus	8cm – ∞ (AutoFocus)	19.6cm – ∞ (FixedFocus)
D-number	2.0	2.0

OAK-D-Lite

Camera	Color camera	Monochrome camera
Shutter	Rolling	Global
Sensor	IMX214	OV7215
Max framerate	60fps	200fps
H.265 framerate	30fps	/
Resolution	13MP (4208 × 3120 px)	0.3MP (640 × 480 px)
FoV	81.3° DFoV	85.6° DFoV
Lens size	1/2.3 Inch	1/2.3 Inch
Focus	8cm – ∞ (AutoFocus)	6.5cm – ∞ (FixedFocus)
D-number	2.2	2.2

OAK-D-Pro

Camera	Color Camera	Monochrome camera
Shutter	Rolling	Global
Sensor	IMX378	OV9282
Max framerate	60fps	120fps
H.265 framerate	30fps	/
Resolution	12MP (4032 × 3040px)	1MP (1280 × 4800px)
FoV	81°DFoV / 69°HFoV / 55°VFoV	81°DFoV / 72°HFoV / 49°VFoV
Lens Size	1/2.3 Inch	1/4 Inch
Focus range	8cm – ∞ (AutoFocus)	19.6cm – ∞ (FixedFocus)
D-number	2.0	2.2
Emitter Specifications
Launcher	Specification
Transmitter model	Belago1.1 Dot-Pattern
Number of dots	4700
HFOI*50%	78±7%
VFOI*50%	61°±7%
VSCEL wavelength	940nm
Operating temperature	10°C ~ 60°C
Storage temperature	0°C ~ 80°C
Laser Safety Standards	EN/IEC 60825-1 3rd Edition (2014) Class 1 Laser Products

Supported NN

Caffe*

• AlexNet
• CaffeNet
• GoogleNet (Inception) v1, v2, v4
• VGG family (VGG16, VGG19)
• SqueezeNet v1.0, v1.1
• ResNet v1 family (18***, 50, 101, 152)
• MobileNet (mobilenet-v1-1.0-224, mobilenet-v2)
• Inception ResNet v2
• DenseNet family (121,161,169,201)
• SSD-300, SSD-512, SSD-MobileNet, SSD-GoogleNet, SSD-SqueezeNet

TensorFlow*

• AlexNet
• Inception v1, v2, v3, v4
• Inception ResNet v2
• MobileNet v1, v2
• ResNet v1 family (50, 101, 152)
• ResNet v2 family (50, 101, 152)
• SqueezeNet v1.0, v1.1
• VGG family (VGG16, VGG19)
• Yolo family (yolo-v2, yolo-v3, tiny-yolo-v1, tiny-yolo-v2, tiny-yolo-v3)
• faster_rcnn_inception_v2, faster_rcnn_resnet101
• ssd_mobilenet_v1
• DeepLab-v3+

MXNet*

• AlexNet and CaffeNet
• DenseNet family (121,161,169,201)
• SqueezeNet v1.1
• MobileNet v1, v2
• NiN
• ResNet v1 (101, 152)
• ResNet v2 (101)
• SqueezeNet v1.1
• VGG family (VGG16, VGG19)
• SSD-Inception-v3, SSD-MobileNet, SSD-ResNet-50, SSD-300

Hardware Connection

OAK-D

• Connect the power supply to the OAK-D's power connector.
• Use a Type-C cable to connect OAK-D to the USB3.0 port of a computer or other hosts.

OAK-D-PoE

• To use OAK-D-PoE, you need to use a switch or router that complies with the 802.3af POE power supply standard.
• Remove the plastic waterproof casing and connect the matching network cable to the switch. OAK-D-PoE needs to be connected to the Internet for normal use.
• Note that OAK-D-PoE needs to be connected to the same LAN as the host computer, otherwise the program cannot identify the device.

OAK-D-Lite

• Use a Type-C cable to connect OAK-D to the USB3.0 port of a computer or other hosts.

OAK-D-Pro

• Connect the Y-Adapter to the OAK-D-Pro.
• Use two Type-C cables to connect the Y-type connector, on the other side, connect a UB cable to the USB3,0 interface of other hosts, and connect the other one to the 5V/2A power supply.

Windows

• Unzip the downloaded zip.
• Double click the "exe" file.
• Follow the prompts to install the OAKEnvironment software.
  • It is recommended to change the installation directory to another location.
• Check to add environment variables.
• Click "Install" and wait for the installation to complete.
• After the installation is complete, a shortcut will be added to the desktop. Double-click to run the "depthai-demo.py" program directly.

Linux

If you use ubuntu system, you can take the following steps:

• Install depthai

git clone https://gitee.com/oakchina/depthai.git

• Install depthai-python

git clone https://gitee.com/oakchina/depthai-python.git

• Install depthai-experiments

git clone https://gitee.com/oakchina/depthai-experiments.git

• OAK device used for the first time requires the rule configuration.

echo 'SUBSYSTEM=="usb", ATTRS{idVendor}=="03e7", MODE="0666"' | sudo tee /etc/udev/rules.d/80-movidius.rules
sudo udevadm control --reload-rules && sudo udevadm trigger

• Install dependency library

python3 -m pip install -r depthai/requirements.txt -i https://pypi.tuna.tsinghua.edu.cn/simple

• Program test

python3 depthai/depthai_demo.py

Raspberry Pi

• At the beginning, we provided a Raspberry Pi image with a configured environment, and users can directly download and burn it.
• Download the tools

• Open the software and choose the downloaded oak image (note: unzip .img file) and the programmed it to the SD card.

• Enable the Raspberry Pi and run the following demo:

cd depthai
python3 depthai_demo.py

Ubuntu

• Install depthai

git clone https://gitee.com/oakchina/depthai.git

• Install dependent libraries

cd depthai
python3 install_requirements.py

• Run the program

python3 depthai-demo.py

Note: If opencv reports an error and displays an illegal command after installation, please run the command to add the environment and test again.

echo "export OPENBLAS_CORETYPE=ARMV8" >> ~/.bashrc
source ~/.bashrc

Jetson Platform

Note: Do not directly run the dependency scripts in the depthai package on the jetson platform, or OpenCV coverage that will cause other programs to fail to work properly.

• Please program the system first according to the Jetson platform, and configure it completely and normally.
• (Optional) If there is a problem with the subsequent configuration, you can update the package. Please do not do the second update for the first configuration.

sudo apt update && sudo apt upgrade
sudo reboot

• S set SWAP

# Disable ZRAM:
sudo systemctl disable nvzramconfig
# Create 4GB swap file
sudo fallocate -l 4G /mnt/4GB.swap
sudo chmod 600 /mnt/4GB.swap
sudo mkswap /mnt/4GB.swap

• Install pip3.

sudo -H apt install -y python3-pip

• Install and configure the virtual environment.

sudo -H pip3 install virtualenv virtualenvwrapper

• Add the setting to bash script.

sudo vi ~/.bashrc

# Add the following to the open document
export WORKON_HOME=$HOME/.virtualenvs
export VIRTUALENVWRAPPER_PYTHON=/usr/bin/python3
source /usr/local/bin/virtualenvwrapper.sh

• Reload the script and wear the virtual environment depthAI:

source ~/.bashrc
mkvirtualenv depthAI -p python3

• Install depthai, note that the installation needs to be done in a virtual environment, please enter the virtual environment first.

#download and install the dependencies script
sudo wget -qO- http://docs.luxonis.com/_static/install_dependencies.sh | bash

#clone depthai respository
git clone https://github.com/luxonis/depthai-python.git
cd depthai-python

• Add environment configuration:

echo "export OPENBLAS_CORETYPE=ARMV8" >> ~/.bashrc

• Go to the example folder and run the script to install the dependency library:

cd examples/
sudo python install_requirements.py

• Run the test script.

sudo python rgb_preview.py

• OAK-D-PoE 3D Drawing
• OAK-D-PoE Schematic
• OAK-D 3D Drawing
• OAK-D Schematic
• Official documents
• Hardware resources
• Resources

Support

If you require technical support, please go to the Support page and open a ticket.