Difference between revisions of "Jetson/Cameras"

From eLinux.org
Jump to: navigation, search
(Disabling USB auto-suspend: Shown how to disable USB auto-suspend on bootup)
(Camera Drivers)
(133 intermediate revisions by 18 users not shown)
Line 1: Line 1:
== Camera interfaces on [[Jetson TK1]] ==
+
== Camera interfaces on Jetson Platform ==
The [[Jetson TK1]] board provides several different interfaces that allow camera input:
+
The Jetson boards provide several different interfaces that allow camera input:
 
* USB 3.0 port (supports many USB 2.0 or USB 3.0 webcams). Additional USB 3.0 ports can be added through mini-PCIe, eg: [http://www.newegg.com/Product/Product.aspx?Item=N82E16833106190 mini-PCIe] (untested).
 
* USB 3.0 port (supports many USB 2.0 or USB 3.0 webcams). Additional USB 3.0 ports can be added through mini-PCIe, eg: [http://www.newegg.com/Product/Product.aspx?Item=N82E16833106190 mini-PCIe] (untested).
* USB 2.0 port (through a [http://www.amazon.com/USB-Micro-Female-Male-Adaptor/dp/B0023FTRUO micro-B to female USB-A adapter], that is sometimes included with [[Jetson TK1]]).
+
* USB 2.0 port (through a [http://www.amazon.com/USB-Micro-Female-Male-Adaptor/dp/B0023FTRUO micro-B to female USB-A adapter], that is sometimes included with Jetson).
 
* Gigabit Ethernet port. Additional Gigabit or Dual-Gigabit Ethernet ports can be added through mini-PCIE, eg: [http://www.globalamericaninc.com/peripherals/pci-express-mini-cards.html mini-PCIe] (untested).
 
* Gigabit Ethernet port. Additional Gigabit or Dual-Gigabit Ethernet ports can be added through mini-PCIE, eg: [http://www.globalamericaninc.com/peripherals/pci-express-mini-cards.html mini-PCIe] (untested).
* CSI-2 MIPI dual camera ports (one 4-lane camera port and one 1-lane camera port) through the GPIO expansion port.
+
* MIPI CSI-2 camera ports (up to 12 lanes at 2.5Gbps each)
 
* Firewire (available through mini-PCIe), eg: [http://www.globalamericaninc.com/peripherals/pci-express-mini-cards.html mini-PCIe] (untested).
 
* Firewire (available through mini-PCIe), eg: [http://www.globalamericaninc.com/peripherals/pci-express-mini-cards.html mini-PCIe] (untested).
 
* Analog video capture cards, available through mini-PCIe (eg: [http://www.globalamericaninc.com/peripherals/pci-express-mini-cards.html mini-PCIe] (untested)), USB 3.0 (eg: [http://www.newegg.com/Product/Product.aspx?Item=N82E16815100171 USB 3.0] (untested)), or USB 2.0 (eg: [http://www.amazon.com/Pinnacle-210100387-Tuner-Capture-Device/dp/B00028CAJ4 USB 2.0] (untested)).
 
* Analog video capture cards, available through mini-PCIe (eg: [http://www.globalamericaninc.com/peripherals/pci-express-mini-cards.html mini-PCIe] (untested)), USB 3.0 (eg: [http://www.newegg.com/Product/Product.aspx?Item=N82E16815100171 USB 3.0] (untested)), or USB 2.0 (eg: [http://www.amazon.com/Pinnacle-210100387-Tuner-Capture-Device/dp/B00028CAJ4 USB 2.0] (untested)).
  
 +
It is also possible to use [[#Multiple_cameras|Multiple]] cameras, [[#Stereo_cameras|Stereo]] cameras, or [[#Specialized_camera_sensors|Specialized camera sensors]] as discussed further below.
 +
 +
Many of these cameras can be accessed by following the [[#Camera_access|Camera access]] section, also further bellow.
  
 
= Interface details =
 
= Interface details =
 +
  
 
== USB 2.0 ==
 
== USB 2.0 ==
Line 19: Line 23:
 
Some USB devices & cameras have problems on Jetson TK1 due to automatic suspending of inactive USB ports in L4T 19.2 OS to save power. So you might need to disable USB auto-suspend mode. This will disable it temporarily until you reboot:
 
Some USB devices & cameras have problems on Jetson TK1 due to automatic suspending of inactive USB ports in L4T 19.2 OS to save power. So you might need to disable USB auto-suspend mode. This will disable it temporarily until you reboot:
 
  sudo bash -c 'echo -1 > /sys/module/usbcore/parameters/autosuspend'
 
  sudo bash -c 'echo -1 > /sys/module/usbcore/parameters/autosuspend'
To automatically disable USB auto-suspend on bootup, you can put it into your "/etc/rc.local" bootup script. For example, run:
+
To automatically disable USB auto-suspend on bootup, follow the instructions to [[Jetson/Jetson_TK1_Power#How_to_run_a_command_with_root_privileges_temporarily_or_on_every_bootup|Run a command automatically on bootup]].
sudo nano /etc/rc.local
+
 
Then add this to the bottom of the file but before the "exit" line:
+
Or edit kernel parameters in <code>/boot/extlinux/extlinux.conf</code> to add <code>usbcore.autosuspend=-1</code>. (usbcore is built in the kernel so modprobe method would not work.)
# Disable USB auto-suspend, since it disconnects some devices such as webcams on Jetson TK1.
 
echo -1 > /sys/module/usbcore/parameters/autosuspend
 
After saving the file (by hitting Ctrl+X then Y then Enter), reboot:
 
sudo reboot
 
  
 
=== USB 2.0 webcams known to be working ===
 
=== USB 2.0 webcams known to be working ===
Line 31: Line 31:
 
* [http://www.newegg.com/Product/Product.aspx?Item=N82E16826623075 Gearhead WC4500AFW]
 
* [http://www.newegg.com/Product/Product.aspx?Item=N82E16826623075 Gearhead WC4500AFW]
 
* [http://www.logitech.com/en-us/support/webcam-c210?bit=64&osid=14&crid=405 Logitech C210]
 
* [http://www.logitech.com/en-us/support/webcam-c210?bit=64&osid=14&crid=405 Logitech C210]
 +
* [http://support.logitech.com/en_us/product/hd-webcam-c615 Logitech C615]
 
* [http://www.logitech.com/en-us/product/hd-pro-webcam-c920 Logitech C920]
 
* [http://www.logitech.com/en-us/product/hd-pro-webcam-c920 Logitech C920]
 
* [http://www.rocketfishproducts.com/products/computer-accessories/RF-HDWEB10.html Rocketfish HD Webcam Pro]
 
* [http://www.rocketfishproducts.com/products/computer-accessories/RF-HDWEB10.html Rocketfish HD Webcam Pro]
 
* [http://us.creative.com/p/web-cameras/live-cam-chat-hd Creative Live! Cam Chat VF0700]
 
* [http://us.creative.com/p/web-cameras/live-cam-chat-hd Creative Live! Cam Chat VF0700]
 
* [http://www.jaycar.com.au/productView.asp?ID=QC3205 Generic "Full HD 1080p" webcams using the Realtek chipset]
 
* [http://www.jaycar.com.au/productView.asp?ID=QC3205 Generic "Full HD 1080p" webcams using the Realtek chipset]
 +
* [http://www.microsoft.com/hardware/it-it/p/lifecam-hd-3000 Microsoft LifeCam HD-3000]
 +
* [http://www.microsoft.com/hardware/en-us/p/lifecam-studio Microsoft LifeCam Studio]
 +
* [https://www.e-consystems.com/5mp-usb-cameraboard.asp e-CAM51_USB - 5MP USB Board Camera (OEM)]
 +
* [https://en.wikipedia.org/wiki/PlayStation_Eye Sony PlayStation Eye (PS3 Eye)] (can give very fast framerates, but some [https://devtalk.nvidia.com/default/topic/766276/embedded-systems/guide-playstation-eye-on-jetson-tk1/ extra steps] are required).
  
 
=== USB 2.0 webcams with known problems ===
 
=== USB 2.0 webcams with known problems ===
* [http://www.microsoft.com/hardware/en-us/d/lifecam-hd-5000 Microsoft Lifecam HD-5000] does not work. NVIDIA is investigating some Microsoft Lifecam models soon.
+
* [http://www.microsoft.com/hardware/en-us/d/lifecam-hd-5000 Microsoft LifeCam HD-5000] does not work. Please use a different model such as [http://www.amazon.com/Microsoft-T3H-00001-LifeCam-HD-3000/dp/B004ETQHDM LifeCam HD-3000] instead.
  
 +
Note: If a webcam or video capture card is supported by UVC or Video4Linux (see [http://www.linuxtv.org/wiki/index.php/Video_via_USB examples]) then it will probably work the same on [[Jetson TK1]] as on a desktop, but there is a possibility that it requires the firmware to be copied to your "/lib/firmware" folder or potentially even compiling & flashing your own custom Linux kernel with appropriate drivers enabled.
  
 
== USB 3.0 ==
 
== USB 3.0 ==
USB 3.0 (5 Gbps) has enough bandwidth to allow sending uncompressed 1080p video streams. But USB 3.0 hasn't reached the mass consumer market like USB 2.0 has, so USB 3.0 cameras are still limited to expensive professional-grade cameras. eg: [http://ww2.ptgrey.com/USB3/Flea3 1080p 120fps] (untested) or [http://www.e-consystems.com/8MP-USB3-Autofocus-Camera.asp 1080p 30fps] (untested).
+
USB 3.0 (5 Gbps "SuperSpeed") on the full-sized USB port (J1C2 connector) has enough bandwidth to allow sending uncompressed 1080p video streams. But USB 3.0 hasn't reached the mass consumer market like USB 2.0 has, so USB 3.0 cameras are mostly still limited to expensive professional-grade cameras. eg: [http://ww2.ptgrey.com/USB3/Flea3 PointGrey Flea3 1080p @ 60 FPS] (working!) or [https://www.e-consystems.com/UltraHD-USB-Camera.asp e-Con See3CAM_CU130 1080p @ 60 FPS] (working!) or [http://www.ximea.com/en/products/usb3-vision-cameras-xiq-line/mq003cg-cm Ximea MQ003CG-CM 480p @ 500 FPS] (not tested).
  
=== Enabling support for USB 3.0 ===
+
=== Enabling support for USB 3.0 on the full-sized USB port ===
Note that early versions of [[Jetson TK1]] don't come with USB 3.0 support enabled, and thus you might need to enable USB 3.0 support and re-flash your whole L4T system. According to the [https://developer.nvidia.com/sites/default/files/akamai/mobile/files/L4T/Tegra_Linux_Driver_Package_Release_Notes_R19.2.pdf L4T R19.2 Release Notes], you should modify the odmdata settings in "jetson-tk1.conf" to enable USB 3.0:
+
Note that early versions of [[Tegra/Downstream_SW/Linux4Tegra|Linux4Tegra]] didn't come with USB 3.0 support enabled, and thus you might need to enable USB 3.0 support and re-flash your whole L4T system. According to the [https://developer.nvidia.com/sites/default/files/akamai/mobile/files/L4T/Tegra_Linux_Driver_Package_Release_Notes_R19.2.pdf L4T R19.2 Release Notes], you should modify the odmdata settings (in "pm375_release_armhf/Linux_for_Tegra/jetson-tk1.conf") to enable USB 3.0:
  # USB 2.0 operation on USB2 port(J1C2 connector)/for use as root device use ODMDATA=0x6009C000;
+
  # Use ODMDATA=0x6009C000 for USB 2.0 operation or for use as a root device.
  # USB 3.0 operation on USB2 port(J1C2 connector) use ODMDATA=0x6209C000, requires firmware load from userspace or initial ramdisk
+
  # Use ODMDATA=0x6209C000 for USB 3.0 operation. Requires firmware loaded from userspace or initial ramdisk.
 
  ODMDATA=0x6209C000;
 
  ODMDATA=0x6209C000;
 
Then flash your L4T system and reboot.
 
Then flash your L4T system and reboot.
  
 +
Enabling USB 3.0 support on [https://developer.nvidia.com/linux-tegra-rel-21 L4T 21.2] is easier. You only have to change one parameter in:
 +
/boot/extlinux/extlinux.conf
 +
Change
 +
usb_port_owner_info=0
 +
to
 +
usb_port_owner_info=2
 +
and reboot.
 +
 +
=== USB 3.0 webcams known to be working ===
 +
 +
{| class="wikitable"
 +
! Supplier
 +
! Product
 +
! Image Sensor
 +
! Sensor Type
 +
! Output Format
 +
! Max Resolution
 +
! Frame Rate
 +
! Supported Jetson Platform
 +
|-
 +
| rowspan="6" | e-con Systems
 +
| rowspan="6" | See3CAM_CU130
 +
| rowspan="6" | AR1820
 +
| rowspan="6" | Rolling shutter
 +
| rowspan="2" | YUYV
 +
| 4224x3156
 +
| 4
 +
| TK1
 +
|-
 +
| 640x480
 +
| 60
 +
| TK1
 +
|-
 +
| rowspan="4" | MJPEG
 +
| 1920x1080
 +
| 30
 +
| TK1
 +
|-
 +
| 4224x3156
 +
| 5
 +
| TK1
 +
|-
 +
| 640x480
 +
| 60
 +
| TK1
 +
|-
 +
| 1280x720
 +
| 60
 +
| TK1
 +
|-
 +
| rowspan="9" | e-con Systems
 +
| rowspan="9" | See3CAM_130
 +
| rowspan="9" | AR1335
 +
| rowspan="9" | Rolling shutter
 +
| rowspan="6" | UYVY
 +
| 640x480
 +
| 60
 +
| TK1,TX1
 +
|-
 +
| 1280x720
 +
| 29
 +
| TK1,TX1
 +
|-
 +
| 1920x1080
 +
| 29
 +
| TK1,TX1
 +
|-
 +
| 3840x2160
 +
| 7
 +
| TK1,TX1
 +
|-
 +
| 4096x2160
 +
| 7
 +
| TK1,TX1
 +
|-
 +
| 4208x3120
 +
| 4
 +
| TK1,TX1
 +
|-
 +
| rowspan="3" | MJPEG
 +
| 640x480
 +
| 40
 +
| TK1,TX1
 +
|-
 +
| 1280x720
 +
| 35
 +
| TK1,TX1
 +
|-
 +
| 1920x1080
 +
| 15
 +
| TK1,TX1
 +
|-
 +
| rowspan="4" | e-con Systems
 +
| rowspan="4" | See3CAM_CU30
 +
| rowspan="4" | AR0330
 +
| rowspan="4" | Rolling shutter
 +
| rowspan="2" | MJPEG
 +
| 1280x720
 +
| 42
 +
| TK1,TX1
 +
|-
 +
| 1920x1080
 +
| 20
 +
| TK1,TX1
 +
|-
 +
| rowspan="2" | UYVY
 +
| 1280x720
 +
| 30
 +
| TK1,TX1
 +
|-
 +
| 1920x1080
 +
| 13
 +
| TK1,TX1
 +
|-
 +
| rowspan="4" | e-con Systems
 +
| rowspan="4" | See3CAM_30
 +
| rowspan="4" | AR0330
 +
| rowspan="4" | Rolling shutter
 +
| rowspan="2" | MJPEG
 +
| 1280x720
 +
| 42
 +
| TK1,TX1
 +
|-
 +
| 1920x1080
 +
| 20
 +
| TK1,TX1
 +
|-
 +
| rowspan="2" | UYVY
 +
| 1280x720
 +
| 30
 +
| TK1,TX1
 +
|-
 +
| 1920x1080
 +
| 13
 +
| TK1,TX1
 +
|-
 +
| rowspan="8" | e-con Systems
 +
| rowspan="8" | See3CAM_CU50
 +
| rowspan="8" | OV5640
 +
| rowspan="8" | Rolling shutter
 +
| rowspan="4" | YUYV
 +
| 2592x1944
 +
| 8
 +
| TK1
 +
|-
 +
| 1920x1080
 +
| 30
 +
| TK1
 +
|-
 +
| 1280x720
 +
| 30
 +
| TK1
 +
|-
 +
| 640x480
 +
| 30
 +
| TK1
 +
|-
 +
| rowspan="4" | MJPEG
 +
| 2592x1944
 +
| 15
 +
| TK1
 +
|-
 +
| 1920x1080
 +
| 30
 +
| TK1
 +
|-
 +
| 1280x720
 +
| 60
 +
| TK1
 +
|-
 +
| 640x480
 +
| 60
 +
| TK1
 +
|-
 +
| rowspan="5" | e-con Systems
 +
| rowspan="5" | See3CAM_12CUNIR
 +
| rowspan="5" | AR0130
 +
| rowspan="5" | Rolling shutter
 +
| rowspan="5" | Y16
 +
| 1280x960
 +
| 40
 +
| TK1
 +
|-
 +
| 1280x720
 +
| 55
 +
| TK1
 +
|-
 +
| 640x480
 +
| 45
 +
| TK1
 +
|-
 +
|
 +
|
 +
| TK1
 +
|-
 +
| 640x480
 +
| 60
 +
| TK1
 +
|-
 +
| rowspan="4" | e-con Systems
 +
| rowspan="4" | See3CAM_11CUG
 +
| rowspan="4" | AR0134
 +
| rowspan="4" | Global shutter
 +
| rowspan="4" | YUYV
 +
| 1280x960
 +
| 20
 +
| TK1
 +
|-
 +
| 1280x720
 +
| 30
 +
| TK1
 +
|-
 +
| 640x480
 +
| 30
 +
| TK1
 +
|-
 +
| 640x480
 +
| 60
 +
| TK1
 +
|-
 +
| rowspan="3" | e-con Systems
 +
| rowspan="3" | See3CAM_10CUG_C
 +
| rowspan="3" | AR0134
 +
| rowspan="3" | Global shutter
 +
| rowspan="3" | BA8
 +
| 1280x960
 +
| 45
 +
| TK1
 +
|-
 +
| 1280x720
 +
| 60
 +
| TK1
 +
|-
 +
| 640x480
 +
| 45
 +
| TK1
 +
|-
 +
| rowspan="3" | e-con Systems
 +
| rowspan="3" | See3CAM_10CUG_M
 +
| rowspan="3" | AR0134
 +
| rowspan="3" | Global shutter
 +
| rowspan="3" | GREY
 +
| 1280x960
 +
| 45
 +
| TK1
 +
|-
 +
| 1280x720
 +
| 60
 +
| TK1
 +
|-
 +
| 640x480
 +
| 45
 +
| TK1
 +
|-
 +
| rowspan="3" | e-con Systems
 +
| rowspan="3" | See3CAM_80
 +
| rowspan="3" | OV8825
 +
| rowspan="3" | Rolling shutter
 +
| rowspan="3" | YUYV
 +
| 1920x1080
 +
| 30
 +
| TK1
 +
|-
 +
| 1280x720
 +
| 30
 +
| TK1
 +
|-
 +
| 640x480
 +
| 30
 +
| TK1
 +
|-
 +
| rowspan="9" | e-con Systems
 +
| rowspan="9" | See3CAM_CU135
 +
| rowspan="9" | AR1335
 +
| rowspan="9" | Rolling shutter
 +
| rowspan="6" | UYVY
 +
| 640x480
 +
| 118
 +
| TK1,TX1,TX2
 +
|-
 +
| 1280x720
 +
| 29
 +
| TK1,TX1,TX2
 +
|-
 +
| 1920x1080
 +
| 29
 +
| TK1,TX1,TX2
 +
|-
 +
| 3840x2160
 +
| 6
 +
| TK1,TX1,TX2
 +
|-
 +
| 4096x2160
 +
| 6
 +
| TK1,TX1,TX2
 +
|-
 +
| 4208x3120
 +
| 3
 +
| TK1,TX1,TX2
 +
|-
 +
| rowspan="3" | MJPEG
 +
| 640x480
 +
| 100, 119, 119
 +
| TK1,TX1,TX2
 +
|-
 +
| 1280x720
 +
| 38,  46, 59
 +
| TK1,TX1,TX2
 +
|-
 +
| 1920x1080
 +
| 18, 21, 36
 +
| TK1,TX1,TX2
 +
|-
 +
| rowspan="4" | e-con Systems
 +
| rowspan="4" | See3CAM_81
 +
| rowspan="4" | OV8865
 +
| rowspan="4" | Rolling shutter
 +
| rowspan="4" | YUYV
 +
| 640x480
 +
| 30
 +
| TK1,TX1
 +
|-
 +
| 1280x720
 +
| 30
 +
| TK1,TX1
 +
|-
 +
| 1920x1080
 +
| 12
 +
| TK1,TX1
 +
|-
 +
| 3264x2448
 +
| 5
 +
| TK1,TX1
 +
|-
 +
| rowspan="3" | e-con Systems
 +
| rowspan="3" | See3CAM_Stereo (Tara)
 +
| rowspan="3" | MT9V024
 +
| rowspan="3" | Global shutter
 +
| rowspan="3" | Y16(8 Bits per Sensor)
 +
| 752x480
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| 640x480
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| 320x240
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-U3-03S2C-CS
 +
| Sony ICX424
 +
| Global shutter
 +
| Color
 +
| 648 x 488
 +
| 84
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-U3-03S2M-CS
 +
| Sony ICX424
 +
| Global shutter
 +
| Mono
 +
| 648 x 488
 +
| 84
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-U3-05S2C-CS
 +
| Sony ICX693
 +
| Global shutter
 +
| Color
 +
| 808 x 608
 +
| 50
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-U3-05S2M-CS
 +
| Sony ICX693
 +
| Global shutter
 +
| Mono
 +
| 808 x 608
 +
| 50
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-U3-13S2C-CS
 +
| Sony ICX445
 +
| Global shutter
 +
| Color
 +
| 1288 x 964
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-U3-13S2M-CS
 +
| Sony ICX445
 +
| Global shutter
 +
| Mono
 +
| 1288 x 964
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-U3-20S4C-CS
 +
| Sony ICX274
 +
| Global shutter
 +
| Color
 +
| 1624 x 1224
 +
| 15
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-U3-20S4M-CS
 +
| Sony ICX274
 +
| Global shutter
 +
| Mono
 +
| 1624 x 1224
 +
| 15
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-U3-23S6C-C
 +
| Sony IMX249
 +
| Global shutter
 +
| Color
 +
| 1920 x 1200
 +
| 41
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-U3-23S6M-C
 +
| Sony IMX249
 +
| Global shutter
 +
| Mono
 +
| 1920 x 1200
 +
| 41
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-U3-50H5C-C
 +
| Sharp RJ32S3AA0DT
 +
| Global shutter
 +
| Color
 +
| 2448 x 2048
 +
| 7.5
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-U3-50H5M-C
 +
| Sharp RJ32S4AA0DT
 +
| Global shutter
 +
| Mono
 +
| 2448 x 2048
 +
| 7.5
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-04S2C-CS
 +
| Sony IMX287
 +
| Global shutter
 +
| Color
 +
| 720 x 540
 +
| 522
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-04S2M-CS
 +
| Sony IMX287
 +
| Global shutter
 +
| Mono
 +
| 720 x 540
 +
| 522
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-123S6C-C
 +
| Sony IMX253
 +
| Global shutter
 +
| Color
 +
| 4096 x 3000
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-123S6M-C
 +
| Sony IMX253
 +
| Global shutter
 +
| Mono
 +
| 4096 x 3000
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-13Y3C-C
 +
| ON Semi PYTHON 1300
 +
| Global shutter
 +
| Color
 +
| 1280 x 1024
 +
| 170
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-13Y3M-C
 +
| ON Semi PYTHON 1300
 +
| Global shutter
 +
| Mono
 +
| 1280 x 1024
 +
| 170
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-16S2C-CS
 +
| Sony IMX273
 +
| Global shutter
 +
| Color
 +
| 1440 x 1080
 +
| 226
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-16S2M-CS
 +
| Sony IMX273
 +
| Global shutter
 +
| Mono
 +
| 1440 x 1080
 +
| 226
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-200S6C-C
 +
| Sony IMX183
 +
| Rolling shutter with global reset
 +
| Color
 +
| 5472 x 3648
 +
| 18
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-200S6M-C
 +
| Sony IMX183
 +
| Rolling shutter with global reset
 +
| Mono
 +
| 5472 x 3648
 +
| 18
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-32S4C-C
 +
| Sony IMX252
 +
| Global shutter
 +
| Color
 +
| 2048 x 1536
 +
| 118
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-32S4M-C
 +
| Sony IMX252
 +
| Global shutter
 +
| Mono
 +
| 2048 x 1536
 +
| 118
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-51S5C-C
 +
| Sony IMX250
 +
| Global shutter
 +
| Color
 +
| 2448 x 2048
 +
| 75
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-51S5M-C
 +
| Sony IMX250
 +
| Global shutter
 +
| Mono
 +
| 2448 x 2048
 +
| 75
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-89S6C-C
 +
| Sony IMX255
 +
| Global shutter
 +
| Color
 +
| 4096 x 2160
 +
| 42
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-U3-89S6M-C
 +
| Sony IMX255
 +
| Global shutter
 +
| Mono
 +
| 4096 x 2160
 +
| 42
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-13S2C-CS
 +
| Sony ICX445
 +
| Global shutter
 +
| Color
 +
| 1288 x 964
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-13S2C-CS-BD
 +
| Sony ICX445
 +
| Global shutter
 +
| Color
 +
| 1288 x 964
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-13S2M-CS
 +
| Sony ICX445
 +
| Global shutter
 +
| Mono
 +
| 1288 x 964
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-13S2M-CS-BD
 +
| Sony ICX445
 +
| Global shutter
 +
| Mono
 +
| 1288 x 964
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-13Y3C-CS
 +
| ON Semi PYTHON 1300
 +
| Global shutter
 +
| Color
 +
| 1280 x 1024
 +
| 149
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-13Y3C-S-BD
 +
| ON Semi PYTHON 1300
 +
| Global shutter
 +
| Color
 +
| 1280 x 1024
 +
| 149
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-13Y3M-CS
 +
| ON Semi PYTHON 1300
 +
| Global shutter
 +
| Mono
 +
| 1280 x 1024
 +
| 149
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-13Y3M-S-BD
 +
| ON Semi PYTHON 1300
 +
| Global shutter
 +
| Mono
 +
| 1280 x 1024
 +
| 149
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-28S4C-CS
 +
| Sony ICX818
 +
| Global shutter
 +
| Color
 +
| 1928 x 1448
 +
| 13
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-28S4M-CS
 +
| Sony ICX818
 +
| Global shutter
 +
| Mono
 +
| 1928 x 1448
 +
| 13
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-31S4C-CS
 +
| Sony IMX265
 +
| Global shutter
 +
| Color
 +
| 2048 x 1536
 +
| 55
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-31S4M-CS
 +
| Sony IMX265
 +
| Global shutter
 +
| Mono
 +
| 2048 x 1536
 +
| 55
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-50S5C-CS
 +
| Sony IMX264
 +
| Global shutter
 +
| Color
 +
| 2448 x 2048
 +
| 35
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| CM3-U3-50S5M-CS
 +
| Sony IMX264
 +
| Global shutter
 +
| Mono
 +
| 2448 x 2048
 +
| 35
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| FL3-U3-120S3C-C
 +
| Sony IMX172
 +
| Rolling shutter with global reset
 +
| Color
 +
| 4000 x 3000
 +
| 15
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| FL3-U3-13E4C-C
 +
| e2v EV76C560
 +
| Global shutter
 +
| Color
 +
| 1280 x 1024
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| FL3-U3-13E4M-C
 +
| e2v EV76C560
 +
| Global shutter
 +
| Mono
 +
| 1280 x 1024
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| FL3-U3-13S2C-CS
 +
| Sony IMX035
 +
| Rolling shutter
 +
| Color
 +
| 1328 x 1048
 +
| 120
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| FL3-U3-13S2M-CS
 +
| Sony IMX035
 +
| Rolling shutter
 +
| Mono
 +
| 1328 x 1048
 +
| 120
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| FL3-U3-13Y3M-C
 +
| ON Semi VITA 1300
 +
| Global shutter
 +
| Mono
 +
| 1280 x 1024
 +
| 150
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| FL3-U3-20E4C-C
 +
| e2v EV76C5706F
 +
| Global shutter
 +
| Color
 +
| 1600 x 1200
 +
| 59
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| FL3-U3-20E4M-C
 +
| e2v EV76C5706F
 +
| Global shutter
 +
| Mono
 +
| 1600 x 1200
 +
| 59
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| FL3-U3-32S2C-CS
 +
| Sony IMX036
 +
| Rolling shutter with global reset
 +
| Color
 +
| 2080 x 1552
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| FL3-U3-32S2M-CS
 +
| Sony IMX036
 +
| Rolling shutter with global reset
 +
| Mono
 +
| 2080 x 1552
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-120S6C-C
 +
| Sony ICX834
 +
| Global shutter
 +
| Color
 +
| 4240 x 2824
 +
| 7
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-120S6M-C
 +
| Sony ICX834
 +
| Global shutter
 +
| Mono
 +
| 4240 x 2824
 +
| 7
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-123S6C-C
 +
| Sony IMX253
 +
| Global shutter
 +
| Color
 +
| 4096 x 3000
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-123S6M-C
 +
| Sony IMX253
 +
| Global shutter
 +
| Mono
 +
| 4096 x 3000
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-14S5C-C
 +
| Sony ICX285
 +
| Global shutter
 +
| Color
 +
| 1384 x 1036
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-14S5M-C
 +
| Sony ICX285
 +
| Global shutter
 +
| Mono
 +
| 1384 x 1036
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-15S5C-C
 +
| Sony ICX825
 +
| Global shutter
 +
| Color
 +
| 1384 x 1032
 +
| 45
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-15S5M-C
 +
| Sony ICX825
 +
| Global shutter
 +
| Mono
 +
| 1384 x 1032
 +
| 45
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-23S6C-C
 +
| Sony IMX174
 +
| Global shutter
 +
| Color
 +
| 1920 x 1200
 +
| 163
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-23S6M-C
 +
| Sony IMX174
 +
| Global shutter
 +
| Mono
 +
| 1920 x 1200
 +
| 163
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-28S4C-C
 +
| Sony ICX687
 +
| Global shutter
 +
| Color
 +
| 1928 x 1448
 +
| 26
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-28S4M-C
 +
| Sony ICX687
 +
| Global shutter
 +
| Mono
 +
| 1928 x 1448
 +
| 26
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-28S5C-C
 +
| Sony ICX674
 +
| Global shutter
 +
| Color
 +
| 1920 x 1440
 +
| 26
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-28S5M-C
 +
| Sony ICX674
 +
| Global shutter
 +
| Mono
 +
| 1920 x 1440
 +
| 26
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-32S4C-C
 +
| Sony IMX252
 +
| Global shutter
 +
| Color
 +
| 2048 x 1536
 +
| 121
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-32S4M-C
 +
| Sony IMX252
 +
| Global shutter
 +
| Mono
 +
| 2048 x 1536
 +
| 121
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-41C6C-C
 +
| CMOSIS CMV4000-3E5
 +
| Global shutter
 +
| Color
 +
| 2048 x 2048
 +
| 90
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-41C6M-C
 +
| CMOSIS CMV4000-3E5
 +
| Global shutter
 +
| Mono
 +
| 2048 x 2048
 +
| 90
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-41C6NIR-C
 +
| CMOSIS CMV4000-3E12
 +
| Global shutter
 +
| Mono
 +
| 2048 x 2048
 +
| 90
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-41S4C-C
 +
| Sony ICX808
 +
| Global shutter
 +
| Color
 +
| 2016 x 2016
 +
| 18
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-41S4M-C
 +
| Sony ICX808
 +
| Global shutter
 +
| Mono
 +
| 2016 x 2016
 +
| 18
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-50S5C-C
 +
| Sony ICX625
 +
| Global shutter
 +
| Color
 +
| 2448 x 2048
 +
| 15
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-50S5M-C
 +
| Sony ICX625
 +
| Global shutter
 +
| Mono
 +
| 2448 x 2048
 +
| 15
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-51S5C-C
 +
| Sony IMX250
 +
| Global shutter
 +
| Color
 +
| 2448 x 2048
 +
| 75
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-51S5M-C
 +
| Sony IMX250
 +
| Global shutter
 +
| Mono
 +
| 2448 x 2048
 +
| 75
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-60QS6C-C
 +
| Sony ICX694
 +
| Global shutter
 +
| Color
 +
| 2736 x 2192
 +
| 25
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-60QS6M-C
 +
| Sony ICX694
 +
| Global shutter
 +
| Mono
 +
| 2736 x 2192
 +
| 25
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-60S6C-C
 +
| Sony ICX694
 +
| Global shutter
 +
| Color
 +
| 2736 x 2192
 +
| 13
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-60S6M-C
 +
| Sony ICX694
 +
| Global shutter
 +
| Mono
 +
| 2736 x 2192
 +
| 13
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-89S6C-C
 +
| Sony IMX255
 +
| Global shutter
 +
| Color
 +
| 4096 x 2160
 +
| 43
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-89S6M-C
 +
| Sony IMX255
 +
| Global shutter
 +
| Mono
 +
| 4096 x 2160
 +
| 43
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-91S6C-C
 +
| Sony ICX814
 +
| Global shutter
 +
| Color
 +
| 3376 x 2704
 +
| 9
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-U3-91S6M-C
 +
| Sony ICX814
 +
| Global shutter
 +
| Mono
 +
| 3376 x 2704
 +
| 9
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-AR023ZWDR
 +
| AR023Z + AP0202
 +
| Rolling shutter
 +
| YUV
 +
| 2MP-1920x1080
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-AR1335ICP3
 +
| AR1335 + ICP3
 +
| Rolling shutter
 +
| YUV
 +
| 13MP-4208x3120
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-C570X
 +
| C570
 +
| Global shutter
 +
| RAW (RGB/Mono)
 +
| 2MP-1600x1200
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-C661X
 +
| C661
 +
| Global shutter
 +
| RAW (RGB/Mono)
 +
| 1.3MP-1280x1024
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-IMX225C
 +
| IMX225
 +
| Rolling shutter
 +
| RAW (RGB)
 +
| 1.27MP-1312x992
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-IMX226C
 +
| IMX226
 +
| Rolling shutter
 +
| RAW (RGB)
 +
| 12MP-4000x3000
 +
| 10
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-ISX017
 +
| ISX017
 +
| Rolling shutter
 +
| YUV
 +
| 1MP-1280x720
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-M021X
 +
| MT9M021
 +
| Global shutter
 +
| RAW (RGB/Mono)
 +
| 1.2MP-1280x960
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-M034WDR
 +
| MT9M034 + AP0100
 +
| Rolling shutter
 +
| YUV
 +
| 1.2MP-1280x960
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-OV10635
 +
| OV10635
 +
| Rolling shutter
 +
| YUV
 +
| 1MP-1280x800
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-OV10640-490
 +
| OV10640 + OV490
 +
| Rolling shutter
 +
| YUV
 +
| 1.3MP-1280x1080
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-OV10640C
 +
| OV10640
 +
| Rolling shutter
 +
| RAW (RGB)
 +
| 1MP-1280x720
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-P031X
 +
| MT9P031
 +
| Rolling shutter
 +
| RAW (RGB/Mono)
 +
| 5MP-2592x1944
 +
| 14
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-V034M
 +
| MT9V034
 +
| Global shutter
 +
| RAW (Mono)
 +
| VGA-640x480
 +
| 60
 +
| TX1,TX2
 +
|}
 +
 +
*NT - Not Tested
 +
 +
[[File:e-Con_See3CAM_80.jpeg|240px|thumb|right|See3CAM_CU130 USB 3.0 1920x1080 Camera]]
 +
e-con Systems have tested many of their USB 3.0 cameras with [[Jetson TK1] [Jetson TX1] [[Jetson TX2]]. They require flashing a custom Linux kernel that has the [http://cateee.net/lkddb/web-lkddb/HIDRAW.html CONFIG_HIDRAW] setting enabled, by following [https://www.e-consystems.com/USB-3-Camera-on-JetsonTK1-kit.asp their tutorial], or using the [https://devtalk.nvidia.com/default/topic/795734/ The Grinch] kernel by [https://plus.google.com/+JarzebskiPl/posts/79tPL2eyyvn Korneliusz Jarzębski].
 +
 +
[[File:PointGrey_USB3_camera.jpg|240px|thumb|right|PointGrey USB 3.0 camera with standard lens mount]]
 +
Several PointGrey USB 3.0 cameras with CS-mount lens and Global Shutter have been tested as working on [[Jetson TK1]]:
 +
* [http://eu.ptgrey.com/blackfly-20-mp-color-usb3-vision-sony-icx274-2 PointGrey BlackFly] model BFLY-U3-20S4C-CS with 1624x1224 @ 15 FPS works (tested on L4T 21.3.3).
 +
* [http://www.ptgrey.com/flea3-usb3-vision-cameras PointGrey Flea3] model FL3-U3-13E4C-C with 1280x1024 @ 60 FPS has been tested and works with L4T 21.2 on [[Jetson TK1]].
 +
 +
Setup steps for the PointGrey Flea3 camera to work on [[Jetson TK1]]:
 +
* Install [http://www.ptgrey.com/support/downloads/10325/ FlyCapture SDK for ARM Hard Float]
 +
* [[Jetson/Cameras#Enabling_support_for_USB_3.0_on_the_full-sized_USB_port|Enable USB 3.0 support]]
 +
* [[Jetson/Cameras#Disabling_USB_auto-suspend|Disable USB auto suspend]]
 +
* You need to configure USBFS so that all pixel formats of the camera can be used. [http://eu.ptgrey.com/KB/10685#ConfiguringUSBFS Configure USBFS] describes how to do it for Grub. The same can be done on [[Jetson TK1]] by adding:
 +
usbcore.usbfs_memory_mb=1000
 +
to
 +
/boot/extlinux/extlinux.conf
 +
 +
IDS uEye cameras
 +
* [https://en.ids-imaging.com/store/ui-3241le.html UI-3241LE] tested on L4T 21.3, can capture at full frame rate and resolution (1280x1024, 60fps, 8bit mono) through native USB3 port. Experienced very poor performance when connected through this [http://www.amazon.com/gp/product/B009WN7SQA mini-PCIe USB3] adapter, (see [https://devtalk.nvidia.com/default/topic/903602/jetson-tk1/usb3-via-pcie-card/ forum]).
 +
 +
<div id="GigabitEthernet"></div>
  
 
== Gigabit Ethernet ==
 
== Gigabit Ethernet ==
"IP Cameras" are fairly easy to find and tend to be a good option. Gigabit Ethernet cameras (1 Gbps) has enough bandwidth for uncompressed 1080p video streams. eg: [http://ww2.ptgrey.com/GIGE GigE cameras] (untested) or regular [http://www.newegg.com/Product/ProductList.aspx?Submit=ENE&N=100023202%20600046262%20600046249%20600030158%204115%204114&IsNodeId=1&bop=And&Order=RATING&PageSize=20 IP network cameras]. Some IP cameras provide a URL where M-JPEG frames are available.
+
[[File:TRENDnet_IP_Cam.jpg|100px|thumb|right|TRENDnet IP camera for just $120]]
 +
 
 +
"IP Cameras" are fairly easy to find and are a good option for single or multiple cameras. Gigabit Ethernet (1 Gbps) has enough bandwidth for uncompressed 1080p video streams. eg: [http://ww2.ptgrey.com/GIGE GigE cameras] (untested) or regular [http://www.newegg.com/Product/ProductList.aspx?Submit=ENE&N=100023202%20600046262%20600046249%20600030158%204115%204114&IsNodeId=1&bop=And&Order=RATING&PageSize=20 IP network cameras]. [https://devtalk.nvidia.com/default/topic/745883/embedded-systems/tegra-k1-multiple-simultaneous-video-decoding-encoding-possible-/ Nico] notes that older GigE cameras typically do not apply any compression, since compression is a feature of the newer GigE Vision 2 standard, and thus most industrial GigE cameras for computer vision don't have compression and send Bayer images instead. IP cameras typically have M-JPEG compression as well as a video streaming server such as by providing a URL where M-JPEG or JPEG frames are available.
 +
 
 +
=== Gigabit network cameras known to be working ===
 +
{| class="wikitable"
 +
! Supplier
 +
! Product
 +
! Image Sensor
 +
! Sensor Type
 +
! Output Format
 +
! Max Resolution
 +
! Frame Rate
 +
! Supported Jetson Platform
 +
|-
 +
| FLIR
 +
| BFLY-PGE-03S2C-CS
 +
| Sony ICX424
 +
| Global shutter
 +
| Color
 +
| 648 x 488
 +
| 84
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-03S2M-CS
 +
| Sony ICX424
 +
| Global shutter
 +
| Mono
 +
| 648 x 488
 +
| 84
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-03S3C-CS
 +
| Sony ICX414
 +
| Global shutter
 +
| Color
 +
| 648 x 488
 +
| 90
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-03S3M-CS
 +
| Sony ICX414
 +
| Global shutter
 +
| Mono
 +
| 648 x 488
 +
| 90
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-05S2C-CS
 +
| Sony ICX693
 +
| Global shutter
 +
| Color
 +
| 808 x 608
 +
| 50
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-05S2M-CS
 +
| Sony ICX693
 +
| Global shutter
 +
| Mono
 +
| 808 x 608
 +
| 50
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-09S2C-CS
 +
| Sony ICX692
 +
| Global shutter
 +
| Color
 +
| 1288 x 728
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-09S2M-CS
 +
| Sony ICX692
 +
| Global shutter
 +
| Mono
 +
| 1288 x 728
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-12A2C-CS
 +
| Aptina AR0134
 +
| Global shutter
 +
| Color
 +
| 1280 x 960
 +
| 52
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-12A2M-CS
 +
| Aptina AR0134
 +
| Global shutter
 +
| Mono
 +
| 1280 x 960
 +
| 52
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-13E4C-CS
 +
| e2v EV76C560
 +
| Global shutter
 +
| Color
 +
| 1280 x 1024
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-13E4M-CS
 +
| e2v EV76C560
 +
| Global shutter
 +
| Mono
 +
| 1280 x 1024
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-13H2C-CS
 +
| Sharp  RJ33J3CAODT
 +
| Global shutter
 +
| Color
 +
| 1288 x 964
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-13H2M-CS
 +
| Sharp RJ33J4CAODT
 +
| Global shutter
 +
| Mono
 +
| 1288 x 964
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-13S2C-CS
 +
| Sony ICX445
 +
| Global shutter
 +
| Color
 +
| 1288 x 964
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-13S2M-CS
 +
| Sony ICX445
 +
| Global shutter
 +
| Mono
 +
| 1288 x 964
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-14S2C-CS
 +
| Sony IMX104
 +
| Rolling shutter
 +
| Color
 +
| 1296 x 1032
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-20E4C-CS
 +
| e2v EV76C570
 +
| Global shutter
 +
| Color
 +
| 1600 x 1200
 +
| 50
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-20E4M-CS
 +
| e2v EV76C570
 +
| Global shutter
 +
| Mono
 +
| 1600 x 1200
 +
| 50
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-23S2C-CS
 +
| Sony IMX136
 +
| Rolling shutter
 +
| Color
 +
| 1920 x 1200
 +
| 27
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-23S6C-C
 +
| Sony IMX249
 +
| Global shutter
 +
| Color
 +
| 1920 x 1200
 +
| 41
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-23S6M-C
 +
| Sony IMX249
 +
| Global shutter
 +
| Mono
 +
| 1920 x 1200
 +
| 41
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-31S4C-C
 +
| Sony IMX265
 +
| Global shutter
 +
| Color
 +
| 2048 x 1536
 +
| 35
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-31S4M-C
 +
| Sony IMX265
 +
| Global shutter
 +
| Mono
 +
| 2048 x 1536
 +
| 35
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-50A2C-CS
 +
| Aptina MT9P006
 +
| Rolling shutter with global reset
 +
| Color
 +
| 2592 x 1944
 +
| 13
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-50A2M-CS
 +
| Aptina MT9P031
 +
| Rolling shutter with global reset
 +
| Mono
 +
| 2592 x 1944
 +
| 13
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-50H5C-C
 +
| Sharp RJ32S3AA0DT
 +
| Global shutter
 +
| Color
 +
| 2448 x 2048
 +
| 7.5
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-50H5M-C
 +
| Sharp RJ32S4AA0DT
 +
| Global shutter
 +
| Mono
 +
| 2448 x 2048
 +
| 7.5
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-50S5C-C
 +
| Sony IMX264
 +
| Global shutter
 +
| Color
 +
| 2448 x 2048
 +
| 22
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFLY-PGE-50S5M-C
 +
| Sony IMX264
 +
| Global shutter
 +
| Mono
 +
| 2448 x 2048
 +
| 22
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-PGE-04S2C-CS
 +
| Sony IMX287
 +
| Global shutter
 +
| Color
 +
| 720 x 540
 +
| 291
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-PGE-04S2M-CS
 +
| Sony IMX287
 +
| Global shutter
 +
| Mono
 +
| 720 x 540
 +
| 291
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-PGE-13Y3C-C
 +
| ON Semi PYTHON 1300
 +
| Global shutter
 +
| Color
 +
| 1280 x 1024
 +
| 84
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-PGE-13Y3M-C
 +
| ON Semi PYTHON 1300
 +
| Global shutter
 +
| Mono
 +
| 1280 x 1024
 +
| 84
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-PGE-16S2C-CS
 +
| Sony IMX273
 +
| Global shutter
 +
| Color
 +
| 1440 x 1080
 +
| 78
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-PGE-16S2M-CS
 +
| Sony IMX273
 +
| Global shutter
 +
| Mono
 +
| 1440 x 1080
 +
| 78
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-PGE-200S6C-C
 +
| Sony IMX183
 +
| Rolling shutter with global reset
 +
| Color
 +
| 5472 x 3648
 +
| 6.1
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-PGE-200S6M-C
 +
| Sony IMX183
 +
| Rolling shutter with global reset
 +
| Mono
 +
| 5472 x 3648
 +
| 6.1
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-PGE-31S4C-C
 +
| Sony IMX265
 +
| Global shutter
 +
| Color
 +
| 2048 x 1536
 +
| 35
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-PGE-31S4M-C
 +
| Sony IMX265
 +
| Global shutter
 +
| Mono
 +
| 2048 x 1536
 +
| 35
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-PGE-50S5C-C
 +
| Sony IMX264
 +
| Global shutter
 +
| Color
 +
| 2448 x 2048
 +
| 22
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| BFS-PGE-50S5M-C
 +
| Sony IMX264
 +
| Global shutter
 +
| Mono
 +
| 2448 x 2048
 +
| 22
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-PGE-23S6C-C
 +
| Sony IMX174
 +
| Global shutter
 +
| Color
 +
| 1920 x 1200
 +
| 48
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-PGE-23S6M-C
 +
| Sony IMX174
 +
| Global shutter
 +
| Mono
 +
| 1920 x 1200
 +
| 48
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-PGE-50S5C-C
 +
| Sony ICX625
 +
| Global shutter
 +
| Color
 +
| 2448 x 2048
 +
| 15
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-PGE-50S5M-C
 +
| Sony ICX625
 +
| Global shutter
 +
| Mono
 +
| 2448 x 2048
 +
| 15
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-PGE-60S6C-C
 +
| Sony ICX694
 +
| Global shutter
 +
| Color
 +
| 2736 x 2192
 +
| 13
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-PGE-60S6M-C
 +
| Sony ICX694
 +
| Global shutter
 +
| Mono
 +
| 2736 x 2192
 +
| 13
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-PGE-91S6C-C
 +
| Sony ICX814
 +
| Global shutter
 +
| Color
 +
| 3376 x 2704
 +
| 9
 +
| TX1,TX2
 +
|-
 +
| FLIR
 +
| GS3-PGE-91S6M-C
 +
| Sony ICX814
 +
| Global shutter
 +
| Mono
 +
| 3376 x 2704
 +
| 9
 +
| TX1,TX2
 +
|}
 +
 
  
  
 
== Firewire ==
 
== Firewire ==
 +
[[File:DFK31BF03.jpg|130px|thumb|right|DFK31BF03 Firewire camera]]
 +
 
Firewire has been used for professional video capture for a long time, since Firewire cameras do a lot of both the compression and the data transmission in hardware and thus don't put nearly as much stress on the host CPU compared to USB.
 
Firewire has been used for professional video capture for a long time, since Firewire cameras do a lot of both the compression and the data transmission in hardware and thus don't put nearly as much stress on the host CPU compared to USB.
 +
 +
 +
 +
 +
 +
  
  
 
== CSI MIPI ==
 
== CSI MIPI ==
CSI is the ideal method for camera input, since the cameras are tiny and the images can be processed directly by the ISP rather than needing to be stored into the computer's DRAM first before processing. eg: [http://www.e-consystems.com/70mm-MIPI-Camera-Module.asp 720p 60fps] (untested). However there isn't a single standard for CSI cameras, thus each customer typically designs their own connector that is specific to a camera module and a computer or ISP.
+
[[File:E-Cam130_CUTK1.jpg|300px|thumb|right|13MP MIPI CSI-2 Camera Module for Jetson TK1]]
 +
CSI-2 MIPI is the method used for smartphone cameras and is the most efficient method for camera input, since the cameras are tiny (just a few millimeters in size!) and the images can be processed directly by the ISP rather than needing to be stored into the computer's DRAM first before processing. However using a raw CSI MIPI camera sensor directly requires much more work than using a USB, Ethernet or Firewire camera. If you are designing your own custom embedded product for mass-production then CSI MIPI is the recommended camera solution. Luckily, for hobbyists & DIY there are now some MIPI CSI camera modules starting to appear for Jetson TK1, that are fairly plug & play.
 +
 
 +
 
 +
=== MIPI CSI-2 sensors known to be working ===
 +
{| class="wikitable"
 +
! Supplier
 +
! Product
 +
! Image Sensor
 +
! Sensor Type
 +
! Output Format
 +
! Max Resolution
 +
! Frame Rate
 +
! Supported Jetson Platform
 +
|-
 +
| rowspan="4" | e-con Systems
 +
| rowspan="4" | e-CAM21_CUTX2
 +
| rowspan="4" | IMX 290
 +
| rowspan="4" | Rolling Shutter
 +
| rowspan="4" | YUV420
 +
| 1948x1096
 +
| 30
 +
| TX2
 +
|-
 +
| 1948x1096
 +
| 60
 +
| TX2
 +
|-
 +
| 1948x1096
 +
| 120 (10-bits only)
 +
| TX2
 +
|-
 +
| 1308x728
 +
| 30
 +
| TX2
 +
|-
 +
| rowspan="5" | e-con Systems
 +
| rowspan="5" | e-CAM20_CUTX2
 +
| rowspan="5" | AR0230AT
 +
| rowspan="5" | Rolling Shutter
 +
| rowspan="5" | UYVY
 +
| 1920x1080
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| 1280x960
 +
| 34
 +
| TX1,TX2
 +
|-
 +
| 1280X720
 +
| 45
 +
| TX1,TX2
 +
|-
 +
| 960x540
 +
| 54
 +
| TX1,TX2
 +
|-
 +
| 640x480
 +
| 60
 +
| TX1,TX2
 +
|-
 +
|-
 +
| rowspan="5" | e-con Systems
 +
| rowspan="5" | e-CAM30_HEXCUTX2
 +
| rowspan="5" | AR0330
 +
| rowspan="5" | Rolling Shutter
 +
| rowspan="5" | YUV422
 +
| 3.4 MP - 2304x1536
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| 3MP - 2304x1296
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Full HD - 1920x1080
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| HD - 1280x720
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| VGA - 640x480
 +
| 30
 +
| TX1,TX2
 +
|-
 +
|-
 +
| rowspan="5" | e-con Systems
 +
| rowspan="5" | e-CAM130_TRICUTX2
 +
| rowspan="5" | AR1335
 +
| rowspan="5" | Rolling Shutter
 +
| rowspan="5" | YUV422
 +
| 13.0 MP - 4192 x 3120
 +
| 19
 +
| TX1,TX2
 +
|-
 +
| 4K
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Full HD
 +
| 72
 +
| TX1,TX2
 +
|-
 +
| HD - 1280x720
 +
| 72
 +
| TX1,TX2
 +
|-
 +
| VGA - 640x480
 +
| 100
 +
| TX1,TX2
 +
|-
 +
| rowspan="6" | e-con Systems
 +
| rowspan="6" | e-CAM131_CUTX2
 +
| rowspan="6" | AR1335
 +
| rowspan="6" | Rolling Shutter
 +
| rowspan="6" | YUV422
 +
| 13.0 MP - 4192x3120
 +
| 20
 +
| TX1,TX2
 +
|-
 +
| 4K Cinema - 4096x2160
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| 4K UHD - 3840x2160
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Full HD - 1920x1080
 +
| 80
 +
| TX1,TX2
 +
|-
 +
| HD - 1280x720
 +
| 80
 +
| TX1,TX2
 +
|-
 +
| VGA - 640x480
 +
| 120
 +
| TX1,TX2
 +
|-
 +
| rowspan="5" | e-con Systems
 +
| rowspan="5" | e-CAM31_TX2
 +
| rowspan="5" | AR0330
 +
| rowspan="5" | Rolling Shutter
 +
| rowspan="5" | YUV422
 +
| 3.4 MP - 2304x1536
 +
| 50
 +
| TX1,TX2
 +
|-
 +
| 3MP - 2304x1296
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| Full HD - 1920x1080
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| HD - 1280x720
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| VGA - 640x480
 +
| 50
 +
| TX1,TX2
 +
|-
 +
| rowspan="5" | e-con Systems
 +
| rowspan="5" | e-CAM130_CUTX1
 +
| rowspan="5" | AR1820
 +
| rowspan="5" | Rolling Shutter
 +
| rowspan="5" | YUV422
 +
| 13.0 MP - 4224x3156
 +
| 20
 +
| TX1,TX2
 +
|-
 +
| 4K UHD - 3840x2160
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Full HD - 1920x1080
 +
| 72
 +
| TX1,TX2
 +
|-
 +
| HD - 1280x720
 +
| 72
 +
| TX1,TX2
 +
|-
 +
| VGA - 640x480
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| rowspan="5" | e-con Systems
 +
| rowspan="5" | e-CAM30_CUTX1
 +
| rowspan="5" | AR0330
 +
| rowspan="5" | Rolling Shutter
 +
| rowspan="5" | YUV422
 +
| 3.4 MP - 2304x1536
 +
| 50
 +
| TX1,TX2
 +
|-
 +
| 3MP - 2304x1296
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| Full HD - 1920x1080
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| HD - 1280x720
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| VGA - 640x480
 +
| 50
 +
| TX1,TX2
 +
|-
 +
| rowspan="5" | e-con Systems
 +
| rowspan="5" | e-CAM130_CUTK1
 +
| rowspan="5" | AR1820HS
 +
| rowspan="5" | Rolling Shutter
 +
| rowspan="5" | YUV422
 +
| 13.0 MP - 4224x3156
 +
| 20
 +
| TK1
 +
|-
 +
| 4K UHD - 3840x2160
 +
| 30
 +
| TK1
 +
|-
 +
| Full HD - 1920x1080
 +
| 72
 +
| TK1
 +
|-
 +
| HD - 1280x720
 +
| 72
 +
| TK1
 +
|-
 +
| VGA - 640x480
 +
| 60
 +
| TK1
 +
|-
 +
| rowspan="4" | e-con Systems
 +
| rowspan="4" | e-CAM40_CUTK1
 +
| rowspan="4" | OV4682
 +
| rowspan="4" | Rolling Shutter
 +
| rowspan="4" | RGB IR - Color and NIR
 +
| 4.0 MP - 2688x1520
 +
| 330
 +
| TK1
 +
|-
 +
| Full HD - 1920x1080
 +
| 120
 +
| TK1
 +
|-
 +
| HD - 1280x720
 +
| 180
 +
| TK1
 +
|-
 +
| VGA - 672x380
 +
| 330
 +
| TK1
 +
|-
 +
| rowspan="10" | e-con Systems
 +
| rowspan="10" | e-CAM30_CUTK1
 +
| rowspan="10" | AR0330
 +
| rowspan="10" | Rolling Shutter
 +
| rowspan="5" | YUV422
 +
| 3.4 MP - 2304x1536
 +
| 30
 +
| TK1
 +
|-
 +
| 3MP - 2304x1296
 +
| 30
 +
| TK1
 +
|-
 +
| Full HD - 1920x1080
 +
| 30
 +
| TK1
 +
|-
 +
| HD - 1280x720
 +
| 30
 +
| TK1
 +
|-
 +
| VGA - 640x480
 +
| 30
 +
| TK1
 +
|-
 +
| rowspan="5" | MJPEG
 +
| 3.4 MP - 2304x1536
 +
| 30
 +
| TK1
 +
|-
 +
| 3MP - 2304x1296
 +
| 30
 +
| TK1
 +
|-
 +
| Full HD - 1920x1080
 +
| 25
 +
| TK1
 +
|-
 +
| HD - 1280x720
 +
| 15
 +
| TK1
 +
|-
 +
| VGA - 640x480
 +
| 12
 +
| TK1
 +
|-
 +
| Leopard Imaging
 +
| LI-IMX274-MIPI
 +
| IMX274
 +
| Rolling Shutter
 +
| RGB
 +
| 8MP - 3864x2196
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-IMX185-MIPI
 +
| IMX185
 +
| Rolling Shutter
 +
| RGB
 +
| 2MP- 1920x1080
 +
| 60
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-IMX290-MIPI
 +
| IMX290
 +
| Rolling Shutter
 +
| RGB
 +
| 2.1M-1948x1096
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-IMX377-MIPI
 +
| IMX377
 +
| Rolling Shutter
 +
| RGB
 +
| 12M-4104x3046
 +
| 30
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-IMX477-MIPI
 +
| IMX477
 +
| Rolling Shutter
 +
| RGB
 +
| 12M-4056x3040
 +
| 30
 +
| TX1
 +
|-
 +
| Leopard Imaging
 +
| LI-IMX385-MIPI
 +
| IMX385
 +
| Rolling Shutter
 +
| RGB
 +
| 2MP-1952x1112
 +
| 30
 +
| TX1
 +
|-
 +
| Leopard Imaging
 +
| LI-AR0144-MIPI-360
 +
| AR0144
 +
| Global Shutter
 +
| RGBMono
 +
| 1MP-1280x720
 +
| 30
 +
| TX1
 +
|-
 +
| Leopard Imaging
 +
| LI-V024M-MIPI-IPEX30
 +
| V024
 +
| Global Shutter
 +
| Mono
 +
| WVGA-752x480
 +
| 60
 +
| TX1
 +
|-
 +
| Leopard Imaging
 +
| LI-IMX230-MIPI
 +
| IMX230
 +
| Rolling Shutter
 +
| RGB
 +
| 21MP-5344x4016
 +
| 21
 +
| TX1
 +
|-
 +
| Leopard Imaging
 +
| LI-IMX378-MIPI
 +
| IMX378
 +
| Rolling Shutter
 +
| RGB
 +
| 12MP-4000x3000
 +
| 30
 +
| TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-AR0231-GMSL
 +
| AR0231
 +
| Rolling Shutter
 +
| RCCB
 +
| 2MP-1920x1208
 +
| 30
 +
| TX1
 +
|-
 +
| Leopard Imaging
 +
| LI-IMX390-GMSL2
 +
| IMX390
 +
| Rolling Shutter
 +
| RGB
 +
| 2MP-1936x1096
 +
| 30
 +
| TX1
 +
|}
 +
 
 +
=== Building your own custom MIPI CSI-2 camera module ===
 +
Some embedded systems engineers may wish to design their own MIPI CSI-2 camera boards. This is not an easy task, but it is possible by using the information shown in the [https://developer.nvidia.com/embedded/downloads Tegra K1 Embedded Platform Design Guide] (Chapter 3.6: Video Input Interfaces) and taking care of the following guidelines:
 +
# GPIO/Pinmux selection, take care of the same power rail level and on/off power domain in different use case
 +
# Take care of the FPC and connector quality
 +
# EMI isolation from the nearby source
 +
# Suggest independent LDO source for sensitive rails
 +
# Check the I2C speed of the clients on the same I2C bus, which impact the camera response time
 +
 
 +
 
  
 +
 +
= Multiple Cameras =
 +
 +
There are several ways to handle multiple cameras on Jetson TK1 at the same time:
 +
* Ethernet: multiple IP cameras on a network (eg: several [http://www.newegg.com/Product/Product.aspx?Item=N82E16881102064 TRENDnet Internet Cameras] (untested) at $118 each). Theoretically you could have 6 x FullHD 1080p 30fps cameras using 3 x Gigabit Ethernet ports on Jetson TK1 ([https://devtalk.nvidia.com/default/topic/745883/ discussed on the forum])!
 +
* CSI MIPI: 2 cameras (eg: a front camera and a rear camera (untested)).
 +
[[File:4eyes_project.jpeg|200px|thumb|right| DCDZ 4eyes project]]
 +
* CSI MIPI bridge:aim to the ADAS or 360 deg view applications,a project(named [https://item.taobao.com/item.htm?spm=a230r.1.14.16.e0h3D3&id=542516625729&ns=1&abbucket=1#detail 4eyes project]) had been tested by [https://dcac.taobao.com DCDZ],supports up to 4 cameras via POC(power over cable). HDR 720p 30fps OmniVision's sensors, 3 meters RG174 cable
 +
 +
= Stereo Cameras =
 +
[[File:DUO3D_CROPPED.jpg|200px|thumb|right|DUO Stereo Camera]]
 +
[[File:thumb-tara_usb3_stereo_camera-with-casing.png|200px|thumb|right|TARA Stereo Camera]]
 +
 +
=== Stereo cameras known to be working ===
 +
{| class="wikitable"
 +
! Supplier
 +
! Product
 +
! Image Sensor
 +
! Sensor Type
 +
! Output Format
 +
! Max Resolution
 +
! Frame Rate
 +
! Supported Jetson Platform
 +
|-
 +
| Leopard Imaging
 +
| LI-OV580-OV7251ST
 +
| OV7251
 +
| Global shutter
 +
| Raw (Mono)
 +
| VGA-640x480
 +
| 100
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-OV580-OV9281ST
 +
| OV9281
 +
| Global shutter
 +
| Raw (Mono)
 +
| 1MP-1280x800
 +
| 100
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-OV580-OV9782ST
 +
| OV9782
 +
| Global shutter
 +
| Raw (RGB)
 +
| 1MP-1280x800
 +
| 100
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-OV580-STEREO
 +
| OV4689
 +
| Rolling shutter
 +
| YUV
 +
| 2.8MP-2208x1242
 +
| 15
 +
| TX1,TX2
 +
|-
 +
| Leopard Imaging
 +
| LI-USB30-V024STEREO
 +
| MT9V024
 +
| Global shutter
 +
| Raw (Mono)
 +
| VGA-640x480
 +
| 60
 +
| TX1,TX2
 +
|}
 +
 +
=== USB ===
 +
* e-con Systems : ([https://www.e-consystems.com/3D-USB-stereo-camera.asp Tara - USB Stereo Camera]) for $249. 3D USB3 stereo camera is based on OnSemi imaging's MT9V024 image sensor. Known to be working correctly on Jetson TK1. It also works with the [https://www.e-consystems.com/Articles/Camera/ros-support-for-tara.asp ROS].
 +
* Code Laboratories: ([https://duo3d.com/product/duo-minilx-lv1 DUO MLX]) (Known to be working / Manufacturer Supported on Jetson TK1. See [https://www.youtube.com/watch?v=ZoBVCSGQXN8 DUO3D on Jetson]).
 +
* Stereolabs: ([https://www.stereolabs.com/zed/specs/ Zed]) for $449. USB 3.0 stereo camera that includes depth from stereo using a CUDA-capable GPU. Known to be working correctly on Jetson TK1.
 +
* IDS: ([http://en.ids-imaging.com/store/n10-stereo-3d-kamera-400.html N10]) (untested).
 +
* Leopard Imaging: ([https://www.leopardimaging.com/LI-USB30-V024STEREO.html LI-USB30]) (untested).
 +
 +
=== Firewire ===
 +
(Would require a [[Jetson/mini-PCIe|Firewire mini-PCIe card]]).
 +
* Point Grey: ([http://www.ptgrey.com/stereo-vision-cameras-systems Bumblebee XB3])(untested).
  
 
= Specialized camera sensors =
 
= Specialized camera sensors =
* Stereo cameras (eg: [http://www.ptgrey.com/products/stereo.asp Bumblebee 2]) (untested).
 
 
* Time-Of-Flight 3D depth "RGBD" cameras (eg: Microsoft Kinect is known to work, see details below).
 
* Time-Of-Flight 3D depth "RGBD" cameras (eg: Microsoft Kinect is known to work, see details below).
 
* Night-vision or Thermal-imaging Infrared cameras, typically with interfaces similar to standard cameras.
 
* Night-vision or Thermal-imaging Infrared cameras, typically with interfaces similar to standard cameras.
 +
* Video frame grabbers, including a HDMI capture card discussed below.
 +
 +
 +
== Microsoft Kinect Structured-Light 3D Depth camera ==
 +
[[File:Kinect.jpg|180px|thumb|right|MS Kinect 3D camera]]
  
== Microsoft Kinect TOF 3D Depth camera ==
+
Several users (eg: [https://devtalk.nvidia.com/default/topic/751916/embedded-systems/microsoft-kinect-with-jetson-tk1/post/4239497/#4239497 HellMood]) have been able to use a Kinect camera on [[Jetson TK1]], after disabling the USB auto-suspend (mentioned above).
Several users (eg: [https://devtalk.nvidia.com/default/topic/751916/embedded-systems/microsoft-kinect-with-jetson-tk1/post/4239497/#4239497 HellMood] have been able to use a Kinect camera on [[Jetson TK1]], after disabling the USB auto-suspend (mentioned above).
 
  
 
Then you need to follow the [http://openkinect.org/wiki/Getting_Started#Manual_Build_on_Linux Kinect Manual Installation Guide] rather than the many x86 based guides, since the Tegra CPU uses ARM architecture.
 
Then you need to follow the [http://openkinect.org/wiki/Getting_Started#Manual_Build_on_Linux Kinect Manual Installation Guide] rather than the many x86 based guides, since the Tegra CPU uses ARM architecture.
 +
 +
User [https://devtalk.nvidia.com/default/topic/751916/embedded-systems/microsoft-kinect-with-jetson-tk1/post/4239497/#4239497 HellMood] also posted a video showing the new Kinect camera working on Jetson TK1: [https://www.youtube.com/watch?v=2Ip2ySAVDic MoodShades Preview].
 +
 +
 +
== Asus XTion Pro Live RGB-D Sensor using OpenNI2 library ==
 +
[[File:AsusXtionProLive.jpg|180px|thumb|right|Asus Xtion Pro Live]]
 +
Asus XTion Pro Live is a RGB-D sensor based on the [http://en.wikipedia.org/wiki/PrimeSense Primesense's] patent ([http://en.wikipedia.org/wiki/PrimeSense Primesense] has been acquired and deleted by Apple in the end of 2013) that drives the first Microsoft Kinect. Asus Xtion sensor, differently from Microsoft Kinect, can be powered directly by USB cable not requiring an external power source.
 +
 +
You can find a guide to compile OpenNI2 library for Jetson TK1 and use it to interface Asus XTion Pro Live on [http://myzharbot.robot-home.it/blog/software/configuration-nvidia-jetson-tk1/asus-xtion-pro-live-openni2-compilation-install-instructions/ the blog of the robotic project MyzharBot].
 +
 +
 +
== AVerMedia HDMI capture card ==
 +
AVerMedia sell a mini-PCIe frame grabber device that allows capturing HDMI input (or DVI or VGA) and fully supports Jetson TK1. For example, it could allow processing live video from a GoPro camera. More info [http://www.avermedia.com/professional/news/28 here].
 +
  
  
Line 86: Line 2,354:
 
  luvcview -o out.avi -s 640x480
 
  luvcview -o out.avi -s 640x480
 
Normally, guvcview can be used to adjust default camera settings, but it seems that the default guvcview is not working correctly on ARM due to a [http://lists.infradead.org/pipermail/linux-arm-kernel/2013-June/178645.html kernel change].
 
Normally, guvcview can be used to adjust default camera settings, but it seems that the default guvcview is not working correctly on ARM due to a [http://lists.infradead.org/pipermail/linux-arm-kernel/2013-June/178645.html kernel change].
 +
 +
= Camera Drivers =
 +
 +
{| class="wikitable"
 +
! Driver
 +
! Developer
 +
! Supported Jetson Platform
 +
|-
 +
| MAX96709/MAX96706 - GMSL1
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| MAX96705/MAX9286 - GMSL1
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| GMSL2 (work in progress on JP 3.3)
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| OV10640 and OV490
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| OV10635
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| OV5647
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| OV5670
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| TC358840
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| TC358743
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| TC358746
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| FPGA V4L2 driver
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| Galileo2 TCM8647MD
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| IMX219
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| IMX230
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| IMX274
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| IMX283
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| IMX290
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| IMX298
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| IMX334
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| IMX377
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| IMX385
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| IMX477
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| MT9M021 + Toshiba TC358746
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| AR0144
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| TW6869
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| OS08A10
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|-
 +
| MAX98357A-ASoC Driver
 +
| RidgeRun
 +
| TX1,TX2
 +
|-
 +
| AR1335
 +
| RidgeRun
 +
| TX1,TX2, Xavier
 +
|}
 +
 +
'''What happens if the driver I am looking for is not on the list?'''<br>
 +
RidgeRun has a wide experience in the development of kernel drivers, if the driver you are looking for is not on the list, it is most likely because they haven't received a request for it yet, but they can create it for you. Feel free to [https://www.ridgerun.com/contact Contact Them] if you have a special driver request, they would be glad to help you. For more information, please visit [https://developer.ridgerun.com/wiki/index.php?title=V4L2_driver_for_camera_sensor_or_capture_chip this page].

Revision as of 16:35, 3 June 2019

Camera interfaces on Jetson Platform

The Jetson boards provide several different interfaces that allow camera input:

  • USB 3.0 port (supports many USB 2.0 or USB 3.0 webcams). Additional USB 3.0 ports can be added through mini-PCIe, eg: mini-PCIe (untested).
  • USB 2.0 port (through a micro-B to female USB-A adapter, that is sometimes included with Jetson).
  • Gigabit Ethernet port. Additional Gigabit or Dual-Gigabit Ethernet ports can be added through mini-PCIE, eg: mini-PCIe (untested).
  • MIPI CSI-2 camera ports (up to 12 lanes at 2.5Gbps each)
  • Firewire (available through mini-PCIe), eg: mini-PCIe (untested).
  • Analog video capture cards, available through mini-PCIe (eg: mini-PCIe (untested)), USB 3.0 (eg: USB 3.0 (untested)), or USB 2.0 (eg: USB 2.0 (untested)).

It is also possible to use Multiple cameras, Stereo cameras, or Specialized camera sensors as discussed further below.

Many of these cameras can be accessed by following the Camera access section, also further bellow.

Interface details

USB 2.0

USB 2.0 (480 Mbps) is the most common & cheapest method for camera input, since USB 2.0 webcams range from $5 - $200. However, USB 2.0 is the slowest of the possible camera interfaces, so it usually only supports upto 720p 30fps (eg: Logitech C310 $45 (untested)), (except for the few USB 2.0 cameras supporting 1080p video compression, such as Logitech C910 (untested)). Logitech C910 is known to work on Jetson TK1 in uncompressed modes but has not been tested in 1080p compressed mode.

Typically, webcams are successfully giving the same frame-rates & resolutions on Jetson TK1 as on an x86 desktop running Linux (eg: 640x480 @ 30 FPS, 960x720 @ 15 FPS, and 1920x1080 @ 15 FPS). Note that many webcams will run slower if there is low lighting, so for example, it might be 30 FPS when pointed at a bright light but only 10 FPS when pointed at a shadow.

Disabling USB auto-suspend

Some USB devices & cameras have problems on Jetson TK1 due to automatic suspending of inactive USB ports in L4T 19.2 OS to save power. So you might need to disable USB auto-suspend mode. This will disable it temporarily until you reboot:

sudo bash -c 'echo -1 > /sys/module/usbcore/parameters/autosuspend'

To automatically disable USB auto-suspend on bootup, follow the instructions to Run a command automatically on bootup.

Or edit kernel parameters in /boot/extlinux/extlinux.conf to add usbcore.autosuspend=-1. (usbcore is built in the kernel so modprobe method would not work.)

USB 2.0 webcams known to be working

USB 2.0 webcams with known problems

Note: If a webcam or video capture card is supported by UVC or Video4Linux (see examples) then it will probably work the same on Jetson TK1 as on a desktop, but there is a possibility that it requires the firmware to be copied to your "/lib/firmware" folder or potentially even compiling & flashing your own custom Linux kernel with appropriate drivers enabled.

USB 3.0

USB 3.0 (5 Gbps "SuperSpeed") on the full-sized USB port (J1C2 connector) has enough bandwidth to allow sending uncompressed 1080p video streams. But USB 3.0 hasn't reached the mass consumer market like USB 2.0 has, so USB 3.0 cameras are mostly still limited to expensive professional-grade cameras. eg: PointGrey Flea3 1080p @ 60 FPS (working!) or e-Con See3CAM_CU130 1080p @ 60 FPS (working!) or Ximea MQ003CG-CM 480p @ 500 FPS (not tested).

Enabling support for USB 3.0 on the full-sized USB port

Note that early versions of Linux4Tegra didn't come with USB 3.0 support enabled, and thus you might need to enable USB 3.0 support and re-flash your whole L4T system. According to the L4T R19.2 Release Notes, you should modify the odmdata settings (in "pm375_release_armhf/Linux_for_Tegra/jetson-tk1.conf") to enable USB 3.0:

# Use ODMDATA=0x6009C000 for USB 2.0 operation or for use as a root device.
# Use ODMDATA=0x6209C000 for USB 3.0 operation. Requires firmware loaded from userspace or initial ramdisk.
ODMDATA=0x6209C000;

Then flash your L4T system and reboot.

Enabling USB 3.0 support on L4T 21.2 is easier. You only have to change one parameter in:

/boot/extlinux/extlinux.conf

Change

usb_port_owner_info=0

to

usb_port_owner_info=2

and reboot.

USB 3.0 webcams known to be working

Supplier Product Image Sensor Sensor Type Output Format Max Resolution Frame Rate Supported Jetson Platform
e-con Systems See3CAM_CU130 AR1820 Rolling shutter YUYV 4224x3156 4 TK1
640x480 60 TK1
MJPEG 1920x1080 30 TK1
4224x3156 5 TK1
640x480 60 TK1
1280x720 60 TK1
e-con Systems See3CAM_130 AR1335 Rolling shutter UYVY 640x480 60 TK1,TX1
1280x720 29 TK1,TX1
1920x1080 29 TK1,TX1
3840x2160 7 TK1,TX1
4096x2160 7 TK1,TX1
4208x3120 4 TK1,TX1
MJPEG 640x480 40 TK1,TX1
1280x720 35 TK1,TX1
1920x1080 15 TK1,TX1
e-con Systems See3CAM_CU30 AR0330 Rolling shutter MJPEG 1280x720 42 TK1,TX1
1920x1080 20 TK1,TX1
UYVY 1280x720 30 TK1,TX1
1920x1080 13 TK1,TX1
e-con Systems See3CAM_30 AR0330 Rolling shutter MJPEG 1280x720 42 TK1,TX1
1920x1080 20 TK1,TX1
UYVY 1280x720 30 TK1,TX1
1920x1080 13 TK1,TX1
e-con Systems See3CAM_CU50 OV5640 Rolling shutter YUYV 2592x1944 8 TK1
1920x1080 30 TK1
1280x720 30 TK1
640x480 30 TK1
MJPEG 2592x1944 15 TK1
1920x1080 30 TK1
1280x720 60 TK1
640x480 60 TK1
e-con Systems See3CAM_12CUNIR AR0130 Rolling shutter Y16 1280x960 40 TK1
1280x720 55 TK1
640x480 45 TK1
TK1
640x480 60 TK1
e-con Systems See3CAM_11CUG AR0134 Global shutter YUYV 1280x960 20 TK1
1280x720 30 TK1
640x480 30 TK1
640x480 60 TK1
e-con Systems See3CAM_10CUG_C AR0134 Global shutter BA8 1280x960 45 TK1
1280x720 60 TK1
640x480 45 TK1
e-con Systems See3CAM_10CUG_M AR0134 Global shutter GREY 1280x960 45 TK1
1280x720 60 TK1
640x480 45 TK1
e-con Systems See3CAM_80 OV8825 Rolling shutter YUYV 1920x1080 30 TK1
1280x720 30 TK1
640x480 30 TK1
e-con Systems See3CAM_CU135 AR1335 Rolling shutter UYVY 640x480 118 TK1,TX1,TX2
1280x720 29 TK1,TX1,TX2
1920x1080 29 TK1,TX1,TX2
3840x2160 6 TK1,TX1,TX2
4096x2160 6 TK1,TX1,TX2
4208x3120 3 TK1,TX1,TX2
MJPEG 640x480 100, 119, 119 TK1,TX1,TX2
1280x720 38, 46, 59 TK1,TX1,TX2
1920x1080 18, 21, 36 TK1,TX1,TX2
e-con Systems See3CAM_81 OV8865 Rolling shutter YUYV 640x480 30 TK1,TX1
1280x720 30 TK1,TX1
1920x1080 12 TK1,TX1
3264x2448 5 TK1,TX1
e-con Systems See3CAM_Stereo (Tara) MT9V024 Global shutter Y16(8 Bits per Sensor) 752x480 60 TX1,TX2
640x480 60 TX1,TX2
320x240 60 TX1,TX2
FLIR BFLY-U3-03S2C-CS Sony ICX424 Global shutter Color 648 x 488 84 TX1,TX2
FLIR BFLY-U3-03S2M-CS Sony ICX424 Global shutter Mono 648 x 488 84 TX1,TX2
FLIR BFLY-U3-05S2C-CS Sony ICX693 Global shutter Color 808 x 608 50 TX1,TX2
FLIR BFLY-U3-05S2M-CS Sony ICX693 Global shutter Mono 808 x 608 50 TX1,TX2
FLIR BFLY-U3-13S2C-CS Sony ICX445 Global shutter Color 1288 x 964 30 TX1,TX2
FLIR BFLY-U3-13S2M-CS Sony ICX445 Global shutter Mono 1288 x 964 30 TX1,TX2
FLIR BFLY-U3-20S4C-CS Sony ICX274 Global shutter Color 1624 x 1224 15 TX1,TX2
FLIR BFLY-U3-20S4M-CS Sony ICX274 Global shutter Mono 1624 x 1224 15 TX1,TX2
FLIR BFLY-U3-23S6C-C Sony IMX249 Global shutter Color 1920 x 1200 41 TX1,TX2
FLIR BFLY-U3-23S6M-C Sony IMX249 Global shutter Mono 1920 x 1200 41 TX1,TX2
FLIR BFLY-U3-50H5C-C Sharp RJ32S3AA0DT Global shutter Color 2448 x 2048 7.5 TX1,TX2
FLIR BFLY-U3-50H5M-C Sharp RJ32S4AA0DT Global shutter Mono 2448 x 2048 7.5 TX1,TX2
FLIR BFS-U3-04S2C-CS Sony IMX287 Global shutter Color 720 x 540 522 TX1,TX2
FLIR BFS-U3-04S2M-CS Sony IMX287 Global shutter Mono 720 x 540 522 TX1,TX2
FLIR BFS-U3-123S6C-C Sony IMX253 Global shutter Color 4096 x 3000 30 TX1,TX2
FLIR BFS-U3-123S6M-C Sony IMX253 Global shutter Mono 4096 x 3000 30 TX1,TX2
FLIR BFS-U3-13Y3C-C ON Semi PYTHON 1300 Global shutter Color 1280 x 1024 170 TX1,TX2
FLIR BFS-U3-13Y3M-C ON Semi PYTHON 1300 Global shutter Mono 1280 x 1024 170 TX1,TX2
FLIR BFS-U3-16S2C-CS Sony IMX273 Global shutter Color 1440 x 1080 226 TX1,TX2
FLIR BFS-U3-16S2M-CS Sony IMX273 Global shutter Mono 1440 x 1080 226 TX1,TX2
FLIR BFS-U3-200S6C-C Sony IMX183 Rolling shutter with global reset Color 5472 x 3648 18 TX1,TX2
FLIR BFS-U3-200S6M-C Sony IMX183 Rolling shutter with global reset Mono 5472 x 3648 18 TX1,TX2
FLIR BFS-U3-32S4C-C Sony IMX252 Global shutter Color 2048 x 1536 118 TX1,TX2
FLIR BFS-U3-32S4M-C Sony IMX252 Global shutter Mono 2048 x 1536 118 TX1,TX2
FLIR BFS-U3-51S5C-C Sony IMX250 Global shutter Color 2448 x 2048 75 TX1,TX2
FLIR BFS-U3-51S5M-C Sony IMX250 Global shutter Mono 2448 x 2048 75 TX1,TX2
FLIR BFS-U3-89S6C-C Sony IMX255 Global shutter Color 4096 x 2160 42 TX1,TX2
FLIR BFS-U3-89S6M-C Sony IMX255 Global shutter Mono 4096 x 2160 42 TX1,TX2
FLIR CM3-U3-13S2C-CS Sony ICX445 Global shutter Color 1288 x 964 30 TX1,TX2
FLIR CM3-U3-13S2C-CS-BD Sony ICX445 Global shutter Color 1288 x 964 30 TX1,TX2
FLIR CM3-U3-13S2M-CS Sony ICX445 Global shutter Mono 1288 x 964 30 TX1,TX2
FLIR CM3-U3-13S2M-CS-BD Sony ICX445 Global shutter Mono 1288 x 964 30 TX1,TX2
FLIR CM3-U3-13Y3C-CS ON Semi PYTHON 1300 Global shutter Color 1280 x 1024 149 TX1,TX2
FLIR CM3-U3-13Y3C-S-BD ON Semi PYTHON 1300 Global shutter Color 1280 x 1024 149 TX1,TX2
FLIR CM3-U3-13Y3M-CS ON Semi PYTHON 1300 Global shutter Mono 1280 x 1024 149 TX1,TX2
FLIR CM3-U3-13Y3M-S-BD ON Semi PYTHON 1300 Global shutter Mono 1280 x 1024 149 TX1,TX2
FLIR CM3-U3-28S4C-CS Sony ICX818 Global shutter Color 1928 x 1448 13 TX1,TX2
FLIR CM3-U3-28S4M-CS Sony ICX818 Global shutter Mono 1928 x 1448 13 TX1,TX2
FLIR CM3-U3-31S4C-CS Sony IMX265 Global shutter Color 2048 x 1536 55 TX1,TX2
FLIR CM3-U3-31S4M-CS Sony IMX265 Global shutter Mono 2048 x 1536 55 TX1,TX2
FLIR CM3-U3-50S5C-CS Sony IMX264 Global shutter Color 2448 x 2048 35 TX1,TX2
FLIR CM3-U3-50S5M-CS Sony IMX264 Global shutter Mono 2448 x 2048 35 TX1,TX2
FLIR FL3-U3-120S3C-C Sony IMX172 Rolling shutter with global reset Color 4000 x 3000 15 TX1,TX2
FLIR FL3-U3-13E4C-C e2v EV76C560 Global shutter Color 1280 x 1024 60 TX1,TX2
FLIR FL3-U3-13E4M-C e2v EV76C560 Global shutter Mono 1280 x 1024 60 TX1,TX2
FLIR FL3-U3-13S2C-CS Sony IMX035 Rolling shutter Color 1328 x 1048 120 TX1,TX2
FLIR FL3-U3-13S2M-CS Sony IMX035 Rolling shutter Mono 1328 x 1048 120 TX1,TX2
FLIR FL3-U3-13Y3M-C ON Semi VITA 1300 Global shutter Mono 1280 x 1024 150 TX1,TX2
FLIR FL3-U3-20E4C-C e2v EV76C5706F Global shutter Color 1600 x 1200 59 TX1,TX2
FLIR FL3-U3-20E4M-C e2v EV76C5706F Global shutter Mono 1600 x 1200 59 TX1,TX2
FLIR FL3-U3-32S2C-CS Sony IMX036 Rolling shutter with global reset Color 2080 x 1552 60 TX1,TX2
FLIR FL3-U3-32S2M-CS Sony IMX036 Rolling shutter with global reset Mono 2080 x 1552 60 TX1,TX2
FLIR GS3-U3-120S6C-C Sony ICX834 Global shutter Color 4240 x 2824 7 TX1,TX2
FLIR GS3-U3-120S6M-C Sony ICX834 Global shutter Mono 4240 x 2824 7 TX1,TX2
FLIR GS3-U3-123S6C-C Sony IMX253 Global shutter Color 4096 x 3000 30 TX1,TX2
FLIR GS3-U3-123S6M-C Sony IMX253 Global shutter Mono 4096 x 3000 30 TX1,TX2
FLIR GS3-U3-14S5C-C Sony ICX285 Global shutter Color 1384 x 1036 30 TX1,TX2
FLIR GS3-U3-14S5M-C Sony ICX285 Global shutter Mono 1384 x 1036 30 TX1,TX2
FLIR GS3-U3-15S5C-C Sony ICX825 Global shutter Color 1384 x 1032 45 TX1,TX2
FLIR GS3-U3-15S5M-C Sony ICX825 Global shutter Mono 1384 x 1032 45 TX1,TX2
FLIR GS3-U3-23S6C-C Sony IMX174 Global shutter Color 1920 x 1200 163 TX1,TX2
FLIR GS3-U3-23S6M-C Sony IMX174 Global shutter Mono 1920 x 1200 163 TX1,TX2
FLIR GS3-U3-28S4C-C Sony ICX687 Global shutter Color 1928 x 1448 26 TX1,TX2
FLIR GS3-U3-28S4M-C Sony ICX687 Global shutter Mono 1928 x 1448 26 TX1,TX2
FLIR GS3-U3-28S5C-C Sony ICX674 Global shutter Color 1920 x 1440 26 TX1,TX2
FLIR GS3-U3-28S5M-C Sony ICX674 Global shutter Mono 1920 x 1440 26 TX1,TX2
FLIR GS3-U3-32S4C-C Sony IMX252 Global shutter Color 2048 x 1536 121 TX1,TX2
FLIR GS3-U3-32S4M-C Sony IMX252 Global shutter Mono 2048 x 1536 121 TX1,TX2
FLIR GS3-U3-41C6C-C CMOSIS CMV4000-3E5 Global shutter Color 2048 x 2048 90 TX1,TX2
FLIR GS3-U3-41C6M-C CMOSIS CMV4000-3E5 Global shutter Mono 2048 x 2048 90 TX1,TX2
FLIR GS3-U3-41C6NIR-C CMOSIS CMV4000-3E12 Global shutter Mono 2048 x 2048 90 TX1,TX2
FLIR GS3-U3-41S4C-C Sony ICX808 Global shutter Color 2016 x 2016 18 TX1,TX2
FLIR GS3-U3-41S4M-C Sony ICX808 Global shutter Mono 2016 x 2016 18 TX1,TX2
FLIR GS3-U3-50S5C-C Sony ICX625 Global shutter Color 2448 x 2048 15 TX1,TX2
FLIR GS3-U3-50S5M-C Sony ICX625 Global shutter Mono 2448 x 2048 15 TX1,TX2
FLIR GS3-U3-51S5C-C Sony IMX250 Global shutter Color 2448 x 2048 75 TX1,TX2
FLIR GS3-U3-51S5M-C Sony IMX250 Global shutter Mono 2448 x 2048 75 TX1,TX2
FLIR GS3-U3-60QS6C-C Sony ICX694 Global shutter Color 2736 x 2192 25 TX1,TX2
FLIR GS3-U3-60QS6M-C Sony ICX694 Global shutter Mono 2736 x 2192 25 TX1,TX2
FLIR GS3-U3-60S6C-C Sony ICX694 Global shutter Color 2736 x 2192 13 TX1,TX2
FLIR GS3-U3-60S6M-C Sony ICX694 Global shutter Mono 2736 x 2192 13 TX1,TX2
FLIR GS3-U3-89S6C-C Sony IMX255 Global shutter Color 4096 x 2160 43 TX1,TX2
FLIR GS3-U3-89S6M-C Sony IMX255 Global shutter Mono 4096 x 2160 43 TX1,TX2
FLIR GS3-U3-91S6C-C Sony ICX814 Global shutter Color 3376 x 2704 9 TX1,TX2
FLIR GS3-U3-91S6M-C Sony ICX814 Global shutter Mono 3376 x 2704 9 TX1,TX2
Leopard Imaging LI-USB30-AR023ZWDR AR023Z + AP0202 Rolling shutter YUV 2MP-1920x1080 30 TX1,TX2
Leopard Imaging LI-USB30-AR1335ICP3 AR1335 + ICP3 Rolling shutter YUV 13MP-4208x3120 30 TX1,TX2
Leopard Imaging LI-USB30-C570X C570 Global shutter RAW (RGB/Mono) 2MP-1600x1200 60 TX1,TX2
Leopard Imaging LI-USB30-C661X C661 Global shutter RAW (RGB/Mono) 1.3MP-1280x1024 60 TX1,TX2
Leopard Imaging LI-USB30-IMX225C IMX225 Rolling shutter RAW (RGB) 1.27MP-1312x992 30 TX1,TX2
Leopard Imaging LI-USB30-IMX226C IMX226 Rolling shutter RAW (RGB) 12MP-4000x3000 10 TX1,TX2
Leopard Imaging LI-USB30-ISX017 ISX017 Rolling shutter YUV 1MP-1280x720 30 TX1,TX2
Leopard Imaging LI-USB30-M021X MT9M021 Global shutter RAW (RGB/Mono) 1.2MP-1280x960 30 TX1,TX2
Leopard Imaging LI-USB30-M034WDR MT9M034 + AP0100 Rolling shutter YUV 1.2MP-1280x960 30 TX1,TX2
Leopard Imaging LI-USB30-OV10635 OV10635 Rolling shutter YUV 1MP-1280x800 30 TX1,TX2
Leopard Imaging LI-USB30-OV10640-490 OV10640 + OV490 Rolling shutter YUV 1.3MP-1280x1080 30 TX1,TX2
Leopard Imaging LI-USB30-OV10640C OV10640 Rolling shutter RAW (RGB) 1MP-1280x720 30 TX1,TX2
Leopard Imaging LI-USB30-P031X MT9P031 Rolling shutter RAW (RGB/Mono) 5MP-2592x1944 14 TX1,TX2
Leopard Imaging LI-USB30-V034M MT9V034 Global shutter RAW (Mono) VGA-640x480 60 TX1,TX2
  • NT - Not Tested
See3CAM_CU130 USB 3.0 1920x1080 Camera

e-con Systems have tested many of their USB 3.0 cameras with [[Jetson TK1] [Jetson TX1] Jetson TX2. They require flashing a custom Linux kernel that has the CONFIG_HIDRAW setting enabled, by following their tutorial, or using the The Grinch kernel by Korneliusz Jarzębski.

PointGrey USB 3.0 camera with standard lens mount

Several PointGrey USB 3.0 cameras with CS-mount lens and Global Shutter have been tested as working on Jetson TK1:

Setup steps for the PointGrey Flea3 camera to work on Jetson TK1:

usbcore.usbfs_memory_mb=1000

to

/boot/extlinux/extlinux.conf

IDS uEye cameras

  • UI-3241LE tested on L4T 21.3, can capture at full frame rate and resolution (1280x1024, 60fps, 8bit mono) through native USB3 port. Experienced very poor performance when connected through this mini-PCIe USB3 adapter, (see forum).

Gigabit Ethernet

TRENDnet IP camera for just $120

"IP Cameras" are fairly easy to find and are a good option for single or multiple cameras. Gigabit Ethernet (1 Gbps) has enough bandwidth for uncompressed 1080p video streams. eg: GigE cameras (untested) or regular IP network cameras. Nico notes that older GigE cameras typically do not apply any compression, since compression is a feature of the newer GigE Vision 2 standard, and thus most industrial GigE cameras for computer vision don't have compression and send Bayer images instead. IP cameras typically have M-JPEG compression as well as a video streaming server such as by providing a URL where M-JPEG or JPEG frames are available.

Gigabit network cameras known to be working

Supplier Product Image Sensor Sensor Type Output Format Max Resolution Frame Rate Supported Jetson Platform
FLIR BFLY-PGE-03S2C-CS Sony ICX424 Global shutter Color 648 x 488 84 TX1,TX2
FLIR BFLY-PGE-03S2M-CS Sony ICX424 Global shutter Mono 648 x 488 84 TX1,TX2
FLIR BFLY-PGE-03S3C-CS Sony ICX414 Global shutter Color 648 x 488 90 TX1,TX2
FLIR BFLY-PGE-03S3M-CS Sony ICX414 Global shutter Mono 648 x 488 90 TX1,TX2
FLIR BFLY-PGE-05S2C-CS Sony ICX693 Global shutter Color 808 x 608 50 TX1,TX2
FLIR BFLY-PGE-05S2M-CS Sony ICX693 Global shutter Mono 808 x 608 50 TX1,TX2
FLIR BFLY-PGE-09S2C-CS Sony ICX692 Global shutter Color 1288 x 728 30 TX1,TX2
FLIR BFLY-PGE-09S2M-CS Sony ICX692 Global shutter Mono 1288 x 728 30 TX1,TX2
FLIR BFLY-PGE-12A2C-CS Aptina AR0134 Global shutter Color 1280 x 960 52 TX1,TX2
FLIR BFLY-PGE-12A2M-CS Aptina AR0134 Global shutter Mono 1280 x 960 52 TX1,TX2
FLIR BFLY-PGE-13E4C-CS e2v EV76C560 Global shutter Color 1280 x 1024 60 TX1,TX2
FLIR BFLY-PGE-13E4M-CS e2v EV76C560 Global shutter Mono 1280 x 1024 60 TX1,TX2
FLIR BFLY-PGE-13H2C-CS Sharp RJ33J3CAODT Global shutter Color 1288 x 964 30 TX1,TX2
FLIR BFLY-PGE-13H2M-CS Sharp RJ33J4CAODT Global shutter Mono 1288 x 964 30 TX1,TX2
FLIR BFLY-PGE-13S2C-CS Sony ICX445 Global shutter Color 1288 x 964 30 TX1,TX2
FLIR BFLY-PGE-13S2M-CS Sony ICX445 Global shutter Mono 1288 x 964 30 TX1,TX2
FLIR BFLY-PGE-14S2C-CS Sony IMX104 Rolling shutter Color 1296 x 1032 60 TX1,TX2
FLIR BFLY-PGE-20E4C-CS e2v EV76C570 Global shutter Color 1600 x 1200 50 TX1,TX2
FLIR BFLY-PGE-20E4M-CS e2v EV76C570 Global shutter Mono 1600 x 1200 50 TX1,TX2
FLIR BFLY-PGE-23S2C-CS Sony IMX136 Rolling shutter Color 1920 x 1200 27 TX1,TX2
FLIR BFLY-PGE-23S6C-C Sony IMX249 Global shutter Color 1920 x 1200 41 TX1,TX2
FLIR BFLY-PGE-23S6M-C Sony IMX249 Global shutter Mono 1920 x 1200 41 TX1,TX2
FLIR BFLY-PGE-31S4C-C Sony IMX265 Global shutter Color 2048 x 1536 35 TX1,TX2
FLIR BFLY-PGE-31S4M-C Sony IMX265 Global shutter Mono 2048 x 1536 35 TX1,TX2
FLIR BFLY-PGE-50A2C-CS Aptina MT9P006 Rolling shutter with global reset Color 2592 x 1944 13 TX1,TX2
FLIR BFLY-PGE-50A2M-CS Aptina MT9P031 Rolling shutter with global reset Mono 2592 x 1944 13 TX1,TX2
FLIR BFLY-PGE-50H5C-C Sharp RJ32S3AA0DT Global shutter Color 2448 x 2048 7.5 TX1,TX2
FLIR BFLY-PGE-50H5M-C Sharp RJ32S4AA0DT Global shutter Mono 2448 x 2048 7.5 TX1,TX2
FLIR BFLY-PGE-50S5C-C Sony IMX264 Global shutter Color 2448 x 2048 22 TX1,TX2
FLIR BFLY-PGE-50S5M-C Sony IMX264 Global shutter Mono 2448 x 2048 22 TX1,TX2
FLIR BFS-PGE-04S2C-CS Sony IMX287 Global shutter Color 720 x 540 291 TX1,TX2
FLIR BFS-PGE-04S2M-CS Sony IMX287 Global shutter Mono 720 x 540 291 TX1,TX2
FLIR BFS-PGE-13Y3C-C ON Semi PYTHON 1300 Global shutter Color 1280 x 1024 84 TX1,TX2
FLIR BFS-PGE-13Y3M-C ON Semi PYTHON 1300 Global shutter Mono 1280 x 1024 84 TX1,TX2
FLIR BFS-PGE-16S2C-CS Sony IMX273 Global shutter Color 1440 x 1080 78 TX1,TX2
FLIR BFS-PGE-16S2M-CS Sony IMX273 Global shutter Mono 1440 x 1080 78 TX1,TX2
FLIR BFS-PGE-200S6C-C Sony IMX183 Rolling shutter with global reset Color 5472 x 3648 6.1 TX1,TX2
FLIR BFS-PGE-200S6M-C Sony IMX183 Rolling shutter with global reset Mono 5472 x 3648 6.1 TX1,TX2
FLIR BFS-PGE-31S4C-C Sony IMX265 Global shutter Color 2048 x 1536 35 TX1,TX2
FLIR BFS-PGE-31S4M-C Sony IMX265 Global shutter Mono 2048 x 1536 35 TX1,TX2
FLIR BFS-PGE-50S5C-C Sony IMX264 Global shutter Color 2448 x 2048 22 TX1,TX2
FLIR BFS-PGE-50S5M-C Sony IMX264 Global shutter Mono 2448 x 2048 22 TX1,TX2
FLIR GS3-PGE-23S6C-C Sony IMX174 Global shutter Color 1920 x 1200 48 TX1,TX2
FLIR GS3-PGE-23S6M-C Sony IMX174 Global shutter Mono 1920 x 1200 48 TX1,TX2
FLIR GS3-PGE-50S5C-C Sony ICX625 Global shutter Color 2448 x 2048 15 TX1,TX2
FLIR GS3-PGE-50S5M-C Sony ICX625 Global shutter Mono 2448 x 2048 15 TX1,TX2
FLIR GS3-PGE-60S6C-C Sony ICX694 Global shutter Color 2736 x 2192 13 TX1,TX2
FLIR GS3-PGE-60S6M-C Sony ICX694 Global shutter Mono 2736 x 2192 13 TX1,TX2
FLIR GS3-PGE-91S6C-C Sony ICX814 Global shutter Color 3376 x 2704 9 TX1,TX2
FLIR GS3-PGE-91S6M-C Sony ICX814 Global shutter Mono 3376 x 2704 9 TX1,TX2


Firewire

DFK31BF03 Firewire camera

Firewire has been used for professional video capture for a long time, since Firewire cameras do a lot of both the compression and the data transmission in hardware and thus don't put nearly as much stress on the host CPU compared to USB.





CSI MIPI

13MP MIPI CSI-2 Camera Module for Jetson TK1

CSI-2 MIPI is the method used for smartphone cameras and is the most efficient method for camera input, since the cameras are tiny (just a few millimeters in size!) and the images can be processed directly by the ISP rather than needing to be stored into the computer's DRAM first before processing. However using a raw CSI MIPI camera sensor directly requires much more work than using a USB, Ethernet or Firewire camera. If you are designing your own custom embedded product for mass-production then CSI MIPI is the recommended camera solution. Luckily, for hobbyists & DIY there are now some MIPI CSI camera modules starting to appear for Jetson TK1, that are fairly plug & play.


MIPI CSI-2 sensors known to be working

Supplier Product Image Sensor Sensor Type Output Format Max Resolution Frame Rate Supported Jetson Platform
e-con Systems e-CAM21_CUTX2 IMX 290 Rolling Shutter YUV420 1948x1096 30 TX2
1948x1096 60 TX2
1948x1096 120 (10-bits only) TX2
1308x728 30 TX2
e-con Systems e-CAM20_CUTX2 AR0230AT Rolling Shutter UYVY 1920x1080 30 TX1,TX2
1280x960 34 TX1,TX2
1280X720 45 TX1,TX2
960x540 54 TX1,TX2
640x480 60 TX1,TX2
e-con Systems e-CAM30_HEXCUTX2 AR0330 Rolling Shutter YUV422 3.4 MP - 2304x1536 30 TX1,TX2
3MP - 2304x1296 30 TX1,TX2
Full HD - 1920x1080 30 TX1,TX2
HD - 1280x720 30 TX1,TX2
VGA - 640x480 30 TX1,TX2
e-con Systems e-CAM130_TRICUTX2 AR1335 Rolling Shutter YUV422 13.0 MP - 4192 x 3120 19 TX1,TX2
4K 30 TX1,TX2
Full HD 72 TX1,TX2
HD - 1280x720 72 TX1,TX2
VGA - 640x480 100 TX1,TX2
e-con Systems e-CAM131_CUTX2 AR1335 Rolling Shutter YUV422 13.0 MP - 4192x3120 20 TX1,TX2
4K Cinema - 4096x2160 30 TX1,TX2
4K UHD - 3840x2160 30 TX1,TX2
Full HD - 1920x1080 80 TX1,TX2
HD - 1280x720 80 TX1,TX2
VGA - 640x480 120 TX1,TX2
e-con Systems e-CAM31_TX2 AR0330 Rolling Shutter YUV422 3.4 MP - 2304x1536 50 TX1,TX2
3MP - 2304x1296 60 TX1,TX2
Full HD - 1920x1080 60 TX1,TX2
HD - 1280x720 60 TX1,TX2
VGA - 640x480 50 TX1,TX2
e-con Systems e-CAM130_CUTX1 AR1820 Rolling Shutter YUV422 13.0 MP - 4224x3156 20 TX1,TX2
4K UHD - 3840x2160 30 TX1,TX2
Full HD - 1920x1080 72 TX1,TX2
HD - 1280x720 72 TX1,TX2
VGA - 640x480 60 TX1,TX2
e-con Systems e-CAM30_CUTX1 AR0330 Rolling Shutter YUV422 3.4 MP - 2304x1536 50 TX1,TX2
3MP - 2304x1296 60 TX1,TX2
Full HD - 1920x1080 60 TX1,TX2
HD - 1280x720 60 TX1,TX2
VGA - 640x480 50 TX1,TX2
e-con Systems e-CAM130_CUTK1 AR1820HS Rolling Shutter YUV422 13.0 MP - 4224x3156 20 TK1
4K UHD - 3840x2160 30 TK1
Full HD - 1920x1080 72 TK1
HD - 1280x720 72 TK1
VGA - 640x480 60 TK1
e-con Systems e-CAM40_CUTK1 OV4682 Rolling Shutter RGB IR - Color and NIR 4.0 MP - 2688x1520 330 TK1
Full HD - 1920x1080 120 TK1
HD - 1280x720 180 TK1
VGA - 672x380 330 TK1
e-con Systems e-CAM30_CUTK1 AR0330 Rolling Shutter YUV422 3.4 MP - 2304x1536 30 TK1
3MP - 2304x1296 30 TK1
Full HD - 1920x1080 30 TK1
HD - 1280x720 30 TK1
VGA - 640x480 30 TK1
MJPEG 3.4 MP - 2304x1536 30 TK1
3MP - 2304x1296 30 TK1
Full HD - 1920x1080 25 TK1
HD - 1280x720 15 TK1
VGA - 640x480 12 TK1
Leopard Imaging LI-IMX274-MIPI IMX274 Rolling Shutter RGB 8MP - 3864x2196 60 TX1,TX2
Leopard Imaging LI-IMX185-MIPI IMX185 Rolling Shutter RGB 2MP- 1920x1080 60 TX1,TX2
Leopard Imaging LI-IMX290-MIPI IMX290 Rolling Shutter RGB 2.1M-1948x1096 30 TX1,TX2
Leopard Imaging LI-IMX377-MIPI IMX377 Rolling Shutter RGB 12M-4104x3046 30 TX1,TX2
Leopard Imaging LI-IMX477-MIPI IMX477 Rolling Shutter RGB 12M-4056x3040 30 TX1
Leopard Imaging LI-IMX385-MIPI IMX385 Rolling Shutter RGB 2MP-1952x1112 30 TX1
Leopard Imaging LI-AR0144-MIPI-360 AR0144 Global Shutter RGBMono 1MP-1280x720 30 TX1
Leopard Imaging LI-V024M-MIPI-IPEX30 V024 Global Shutter Mono WVGA-752x480 60 TX1
Leopard Imaging LI-IMX230-MIPI IMX230 Rolling Shutter RGB 21MP-5344x4016 21 TX1
Leopard Imaging LI-IMX378-MIPI IMX378 Rolling Shutter RGB 12MP-4000x3000 30 TX2
Leopard Imaging LI-AR0231-GMSL AR0231 Rolling Shutter RCCB 2MP-1920x1208 30 TX1
Leopard Imaging LI-IMX390-GMSL2 IMX390 Rolling Shutter RGB 2MP-1936x1096 30 TX1

Building your own custom MIPI CSI-2 camera module

Some embedded systems engineers may wish to design their own MIPI CSI-2 camera boards. This is not an easy task, but it is possible by using the information shown in the Tegra K1 Embedded Platform Design Guide (Chapter 3.6: Video Input Interfaces) and taking care of the following guidelines:

  1. GPIO/Pinmux selection, take care of the same power rail level and on/off power domain in different use case
  2. Take care of the FPC and connector quality
  3. EMI isolation from the nearby source
  4. Suggest independent LDO source for sensitive rails
  5. Check the I2C speed of the clients on the same I2C bus, which impact the camera response time



Multiple Cameras

There are several ways to handle multiple cameras on Jetson TK1 at the same time:

  • Ethernet: multiple IP cameras on a network (eg: several TRENDnet Internet Cameras (untested) at $118 each). Theoretically you could have 6 x FullHD 1080p 30fps cameras using 3 x Gigabit Ethernet ports on Jetson TK1 (discussed on the forum)!
  • CSI MIPI: 2 cameras (eg: a front camera and a rear camera (untested)).
DCDZ 4eyes project
  • CSI MIPI bridge:aim to the ADAS or 360 deg view applications,a project(named 4eyes project) had been tested by DCDZ,supports up to 4 cameras via POC(power over cable). HDR 720p 30fps OmniVision's sensors, 3 meters RG174 cable

Stereo Cameras

DUO Stereo Camera
TARA Stereo Camera

Stereo cameras known to be working

Supplier Product Image Sensor Sensor Type Output Format Max Resolution Frame Rate Supported Jetson Platform
Leopard Imaging LI-OV580-OV7251ST OV7251 Global shutter Raw (Mono) VGA-640x480 100 TX1,TX2
Leopard Imaging LI-OV580-OV9281ST OV9281 Global shutter Raw (Mono) 1MP-1280x800 100 TX1,TX2
Leopard Imaging LI-OV580-OV9782ST OV9782 Global shutter Raw (RGB) 1MP-1280x800 100 TX1,TX2
Leopard Imaging LI-OV580-STEREO OV4689 Rolling shutter YUV 2.8MP-2208x1242 15 TX1,TX2
Leopard Imaging LI-USB30-V024STEREO MT9V024 Global shutter Raw (Mono) VGA-640x480 60 TX1,TX2

USB

  • e-con Systems : (Tara - USB Stereo Camera) for $249. 3D USB3 stereo camera is based on OnSemi imaging's MT9V024 image sensor. Known to be working correctly on Jetson TK1. It also works with the ROS.
  • Code Laboratories: (DUO MLX) (Known to be working / Manufacturer Supported on Jetson TK1. See DUO3D on Jetson).
  • Stereolabs: (Zed) for $449. USB 3.0 stereo camera that includes depth from stereo using a CUDA-capable GPU. Known to be working correctly on Jetson TK1.
  • IDS: (N10) (untested).
  • Leopard Imaging: (LI-USB30) (untested).

Firewire

(Would require a Firewire mini-PCIe card).

Specialized camera sensors

  • Time-Of-Flight 3D depth "RGBD" cameras (eg: Microsoft Kinect is known to work, see details below).
  • Night-vision or Thermal-imaging Infrared cameras, typically with interfaces similar to standard cameras.
  • Video frame grabbers, including a HDMI capture card discussed below.


Microsoft Kinect Structured-Light 3D Depth camera

MS Kinect 3D camera

Several users (eg: HellMood) have been able to use a Kinect camera on Jetson TK1, after disabling the USB auto-suspend (mentioned above).

Then you need to follow the Kinect Manual Installation Guide rather than the many x86 based guides, since the Tegra CPU uses ARM architecture.

User HellMood also posted a video showing the new Kinect camera working on Jetson TK1: MoodShades Preview.


Asus XTion Pro Live RGB-D Sensor using OpenNI2 library

Asus Xtion Pro Live

Asus XTion Pro Live is a RGB-D sensor based on the Primesense's patent (Primesense has been acquired and deleted by Apple in the end of 2013) that drives the first Microsoft Kinect. Asus Xtion sensor, differently from Microsoft Kinect, can be powered directly by USB cable not requiring an external power source.

You can find a guide to compile OpenNI2 library for Jetson TK1 and use it to interface Asus XTion Pro Live on the blog of the robotic project MyzharBot.


AVerMedia HDMI capture card

AVerMedia sell a mini-PCIe frame grabber device that allows capturing HDMI input (or DVI or VGA) and fully supports Jetson TK1. For example, it could allow processing live video from a GoPro camera. More info here.


Camera access

To see which video capture devices you have available:

ls /dev/video*

To see the supported video formats of your webcam:

sudo apt-get install luvcview
luvcview -d /dev/video0 -L

You can also use luvcview to record video from your webcam to a video file. It will open a GUI window showing the camera preview. Then along the middle of the bottom row there are 4 rectangle buttons, click the bottom-left of the 4 buttons to start/stop video recording, and the bottom-right button to quit. To record video using the default settings of your webcam:

luvcview -o out.avi

To record video using a custom resolution (of those shown when running luvcview -L above):

luvcview -o out.avi -s 640x480

Normally, guvcview can be used to adjust default camera settings, but it seems that the default guvcview is not working correctly on ARM due to a kernel change.

Camera Drivers

Driver Developer Supported Jetson Platform
MAX96709/MAX96706 - GMSL1 RidgeRun TX1,TX2, Xavier
MAX96705/MAX9286 - GMSL1 RidgeRun TX1,TX2, Xavier
GMSL2 (work in progress on JP 3.3) RidgeRun TX1,TX2, Xavier
OV10640 and OV490 RidgeRun TX1,TX2, Xavier
OV10635 RidgeRun TX1,TX2, Xavier
OV5647 RidgeRun TX1,TX2, Xavier
OV5670 RidgeRun TX1,TX2, Xavier
TC358840 RidgeRun TX1,TX2, Xavier
TC358743 RidgeRun TX1,TX2, Xavier
TC358746 RidgeRun TX1,TX2, Xavier
FPGA V4L2 driver RidgeRun TX1,TX2, Xavier
Galileo2 TCM8647MD RidgeRun TX1,TX2, Xavier
IMX219 RidgeRun TX1,TX2, Xavier
IMX230 RidgeRun TX1,TX2, Xavier
IMX274 RidgeRun TX1,TX2, Xavier
IMX283 RidgeRun TX1,TX2, Xavier
IMX290 RidgeRun TX1,TX2, Xavier
IMX298 RidgeRun TX1,TX2, Xavier
IMX334 RidgeRun TX1,TX2, Xavier
IMX377 RidgeRun TX1,TX2, Xavier
IMX385 RidgeRun TX1,TX2, Xavier
IMX477 RidgeRun TX1,TX2, Xavier
MT9M021 + Toshiba TC358746 RidgeRun TX1,TX2, Xavier
AR0144 RidgeRun TX1,TX2, Xavier
TW6869 RidgeRun TX1,TX2, Xavier
OS08A10 RidgeRun TX1,TX2, Xavier
MAX98357A-ASoC Driver RidgeRun TX1,TX2
AR1335 RidgeRun TX1,TX2, Xavier

What happens if the driver I am looking for is not on the list?
RidgeRun has a wide experience in the development of kernel drivers, if the driver you are looking for is not on the list, it is most likely because they haven't received a request for it yet, but they can create it for you. Feel free to Contact Them if you have a special driver request, they would be glad to help you. For more information, please visit this page.