Difference between revisions of "Jetson AGX Xavier"

From eLinux.org
Jump to: navigation, search
(Computer Vision)
m (Enclosures)
(19 intermediate revisions by 5 users not shown)
Line 48: Line 48:
 
=== Software Support ===
 
=== Software Support ===
 
<div style="width:40%;column-count:2;-moz-column-count:2;-webkit-column-count:2">
 
<div style="width:40%;column-count:2;-moz-column-count:2;-webkit-column-count:2">
* [https://developer.nvidia.com/embedded/jetpack JetPack 4.2]
+
* [https://developer.nvidia.com/embedded/jetpack JetPack 4.2.2]
* [https://developer.nvidia.com/embedded/linux-tegra Linux4Tegra R31.2] (L4T)
+
* [https://developer.nvidia.com/embedded/linux-tegra Linux4Tegra R32.2.1] (L4T)
 
* Linux kernel 4.9
 
* Linux kernel 4.9
 
* Ubuntu 18.04 aarch64
 
* Ubuntu 18.04 aarch64
* [https://developer.nvidia.com/cuda-toolkit CUDA Toolkit] 10.0
+
* [https://developer.nvidia.com/cuda-toolkit CUDA Toolkit] 10.0.326
* [https://developer.nvidia.com/cudnn cuDNN] v7.3
+
* [https://developer.nvidia.com/cudnn cuDNN] 7.5.0
* [https://developer.nvidia.com/tensorrt TensorRT] 5.0
+
* [https://developer.nvidia.com/tensorrt TensorRT] 5.1.6
 +
* [https://docs.nvidia.com/deeplearning/frameworks/install-tf-jetson-platform/index.html TensorFlow] 1.14.0
 
* [https://developer.nvidia.com/embedded/visionworks VisionWorks] 1.6
 
* [https://developer.nvidia.com/embedded/visionworks VisionWorks] 1.6
 
* OpenCV 3.3.1
 
* OpenCV 3.3.1
Line 62: Line 63:
 
* GStreamer 1.14.1
 
* GStreamer 1.14.1
 
* V4L2 media controller support
 
* V4L2 media controller support
* [https://developer.nvidia.com/nsight-systems NVIDIA Nsight Systems] 2019.3
+
* [https://developer.nvidia.com/nsight-systems NVIDIA Nsight Systems] 2019.4
* [https://developer.nvidia.com/nsight-graphics NVIDIA Nsight Graphics] 2018.7
+
* [https://developer.nvidia.com/nsight-graphics NVIDIA Nsight Graphics] 2019.2
 
* [https://developer.nvidia.com/nsight-compute NVIDIA Nsight Compute] 1.0
 
* [https://developer.nvidia.com/nsight-compute NVIDIA Nsight Compute] 1.0
 
</div>
 
</div>
 +
See the '''[[Jetson Zoo]]''' for more software packages to install on top of JetPack.
  
 
= Jetson AGX Xavier Developer Kit =
 
= Jetson AGX Xavier Developer Kit =
Line 125: Line 127:
 
* '''[https://developer.nvidia.com/embedded/dlc/jetson-xavier-oem-product-designguide Design Guide]''' {{spaces|16}} detailed technical design and layout information for creating OEM products.  
 
* '''[https://developer.nvidia.com/embedded/dlc/jetson-xavier-oem-product-designguide Design Guide]''' {{spaces|16}} detailed technical design and layout information for creating OEM products.  
 
* '''[https://developer.nvidia.com/embedded/dlc/jetson-agx-xavier-thermal-design-guide Thermal Design Guide]''' {{spaces|2}} mechanical specifications for designing active and passive cooling solutions.
 
* '''[https://developer.nvidia.com/embedded/dlc/jetson-agx-xavier-thermal-design-guide Thermal Design Guide]''' {{spaces|2}} mechanical specifications for designing active and passive cooling solutions.
 +
* '''[https://developer.nvidia.com/embedded/dlc/agx-xavier-camera-module Camera Design Guide]''' {{spaces|2}} hardware design guide for creating MIPI CSI camera modules
 
* '''[https://developer.nvidia.com/embedded/dlc/jetson-xavier-developer-kit-user-guide DevKit User Guide]''' {{spaces|7}} user manual for setting up, configuring, and using the devkit.
 
* '''[https://developer.nvidia.com/embedded/dlc/jetson-xavier-developer-kit-user-guide DevKit User Guide]''' {{spaces|7}} user manual for setting up, configuring, and using the devkit.
 
* '''[http://developer.nvidia.com/embedded/dlc/jetson-xavier-developer-kit-carrier-board-spec DevKit Carrier Spec]''' {{spaces|5}} design info about the reference carrier board from the devkit.
 
* '''[http://developer.nvidia.com/embedded/dlc/jetson-xavier-developer-kit-carrier-board-spec DevKit Carrier Spec]''' {{spaces|5}} design info about the reference carrier board from the devkit.
Line 145: Line 148:
 
The following upcoming documents for Jetson AGX Xavier are being prepared by NVIDIA:
 
The following upcoming documents for Jetson AGX Xavier are being prepared by NVIDIA:
 
* Jetson AGX Xavier Battery and Charger Design Guide
 
* Jetson AGX Xavier Battery and Charger Design Guide
* Jetson AGX Xavier Camera Module Hardware Design Guide
 
 
* Jetson AGX Xavier Voltage and Current Monitor Configuration
 
* Jetson AGX Xavier Voltage and Current Monitor Configuration
 
* Jetson AGX Xavier Fuse Specification
 
* Jetson AGX Xavier Fuse Specification
Line 172: Line 174:
 
* [https://www.jetsonhacks.com/nvidia-jetson-agx-xavier-gpio-header-pinout/ GPIO Pinout Mapping]
 
* [https://www.jetsonhacks.com/nvidia-jetson-agx-xavier-gpio-header-pinout/ GPIO Pinout Mapping]
 
* [[Jetson/AGX_Xavier_Update_Pinmux|Update Pinmux on Jetson AGX Xavier]]
 
* [[Jetson/AGX_Xavier_Update_Pinmux|Update Pinmux on Jetson AGX Xavier]]
 +
* [[Jetson/AGX_Xavier_Check_Pin_Setting|Check Pin Setting on Jetson AGX Xavier]]
 
* [[Jetson/AGX_Xavier_DTBs|Device Trees of Jetson AGX Xavier]]
 
* [[Jetson/AGX_Xavier_DTBs|Device Trees of Jetson AGX Xavier]]
 
* [[Jetson/AGX_Xavier_Tegra_Combined_UART|Tegra Combined UART]]
 
* [[Jetson/AGX_Xavier_Tegra_Combined_UART|Tegra Combined UART]]
Line 180: Line 183:
 
* [https://github.com/rbonghi/jetson_stats jetson_stats] - jtop, service and other tools
 
* [https://github.com/rbonghi/jetson_stats jetson_stats] - jtop, service and other tools
 
</div>
 
</div>
 
=== Computer Vision ===
 
* [https://developer.ridgerun.com/wiki/index.php?title=GstInterpipe RidgeRun's GstInterpipe] (GStreamer plug-in for communication between two or more independent pipelines)
 
* [https://developer.ridgerun.com/wiki/index.php?title=GstWebRTC RidgeRun's GstRRWebRTC] (GStreamer plug-in that turns pipelines into WebRTC compliant endpoints)
 
* [https://developer.ridgerun.com/wiki/index.php?title=GstRtspSink RidgeRun's GstRTSPSink] (GStreamer element for high performance streaming to multiple computers using the RTSP/RTP protocols)
 
* [https://developer.ridgerun.com/wiki/index.php?title=GStreamer_Daemon RidgeRun's Gstreamer Daemon - GstD] (GStreamer framework for controlling audio and video streaming using TCP connection messages)
 
* [http://developer.ridgerun.com/wiki/index.php?title=GstCUDA RidgeRun's GstCUDA] (RidgeRun CUDA ZeroCopy for GStreamer)
 
* [https://developer.ridgerun.com/wiki/index.php?title=GStreamer_Pan_Tilt_Zoom_and_Rotate_Element RidgerRun's GstPTZR] (GStreamer Pan Tilt Zoom and Rotate Element)
 
* [https://developer.ridgerun.com/wiki/index.php?title=GStreamer_Color_Transfer RidgeRun's GstColorTransfer] (GStreamer plug-in that transfers the color scheme from a reference to a target image)
 
  
 
=== Deep Learning ===
 
=== Deep Learning ===
Line 200: Line 194:
 
* [https://developer.ridgerun.com/wiki/index.php?title=GstInference RidgeRun's GstInference]
 
* [https://developer.ridgerun.com/wiki/index.php?title=GstInference RidgeRun's GstInference]
 
* [https://developer.ridgerun.com/wiki/index.php?title=R2Inference RidgeRun's R2Inference]
 
* [https://developer.ridgerun.com/wiki/index.php?title=R2Inference RidgeRun's R2Inference]
 +
 +
=== Multimedia ===
 +
* [https://developer.ridgerun.com/wiki/index.php?title=Xavier/GStreamer_Pipelines Gstreamer Pipelines for AGX Xavier]
 +
* [https://developer.ridgerun.com/wiki/index.php?title=GstInterpipe RidgeRun's GstInterpipe] (GStreamer plug-in for communication between two or more independent pipelines)
 +
* [https://developer.ridgerun.com/wiki/index.php?title=GstWebRTC RidgeRun's GstRRWebRTC] (GStreamer plug-in that turns pipelines into WebRTC compliant endpoints)
 +
* [https://developer.ridgerun.com/wiki/index.php?title=GstRtspSink RidgeRun's GstRTSPSink] (GStreamer element for high performance streaming to multiple computers using the RTSP/RTP protocols)
 +
* [https://developer.ridgerun.com/wiki/index.php?title=GStreamer_Daemon RidgeRun's Gstreamer Daemon - GstD] (GStreamer framework for controlling audio and video streaming using TCP connection messages)
 +
* [http://developer.ridgerun.com/wiki/index.php?title=GstCUDA RidgeRun's GstCUDA] (RidgeRun CUDA ZeroCopy for GStreamer)
 +
* [https://developer.ridgerun.com/wiki/index.php?title=GStreamer_Pan_Tilt_Zoom_and_Rotate_Element RidgerRun's GstPTZR] (GStreamer Pan Tilt Zoom and Rotate Element)
 +
* [https://developer.ridgerun.com/wiki/index.php?title=GStreamer_Color_Transfer RidgeRun's GstColorTransfer] (GStreamer plug-in that transfers the color scheme from a reference to a target image)
 +
 +
=== V4L2 drivers for cameras ===
 +
 +
*RidgeRun has a [https://developer.ridgerun.com/wiki/index.php?title=V4L2_drivers_available_for_Jetson_SoCs list of drivers already supported in Jetson], please check if the driver that you need is already there. Otherwise, RidgeRun offers [https://developer.ridgerun.com/wiki/index.php?title=V4L2_driver_for_camera_sensor_or_capture_chip services to create the driver for you]
  
 
= Ecosystem Products & Cameras =
 
= Ecosystem Products & Cameras =
  
 
The following are 3rd-party accessories, cameras and carriers available for Jetson AGX Xavier.
 
The following are 3rd-party accessories, cameras and carriers available for Jetson AGX Xavier.
 +
 
Please see the '''[http://developer.nvidia.com/embedded/dlc/jetson-xavier-supported-components-list Supported Components List]''' and '''[https://developer.nvidia.com/embedded/community/ecosystem Jetson Ecosystem]''' directory for a full listing of product partners.
 
Please see the '''[http://developer.nvidia.com/embedded/dlc/jetson-xavier-supported-components-list Supported Components List]''' and '''[https://developer.nvidia.com/embedded/community/ecosystem Jetson Ecosystem]''' directory for a full listing of product partners.
  
<div style="width:70%;column-count:2;-moz-column-count:2;-webkit-column-count:2">
+
=== Cameras ===
* [https://www.youmagine.com/designs/jetson-xavier-base-cover 3D-printable cover for Xavier devkit base]
+
 
 +
* APPROPHO [http://www.appropho.com/products_ii_en.html?id=185&type=36 Xavier/TX2/TX1 sensor solutions]
 +
* e-con Systems [https://www.e-consystems.com/nvidia-cameras/jetson-agx-xavier-cameras/multiple-synchronized-imx290-camera.asp SurveilsQUAD - Synchronized Multi-Camera System for NVIDIA® Jetson AGX Xavier™ Developer Kit]
 +
* e-con Systems [https://www.e-consystems.com/nvidia-cameras/jetson-agx-xavier-cameras/stereo-camera.asp 3D MIPI Stereo camera for NVIDIA® Jetson AGX Xavier™/TX2]
 +
* e-con Systems [https://www.e-consystems.com/3d-usb-stereo-camera-with-nvidia-accelerated-sdk.asp USB Stereo Camera for NVIDIA® Jetson AGX Xavier™/TX2]
 +
* e-con Systems [https://www.e-consystems.com/nvidia-cameras/jetson-agx-xavier-cameras/four-synchronized-4k-cameras.asp Synchronized Four Camera Board for Xavier]
 +
* e-con Systems [https://www.e-consystems.com/nvidia-jetson-camera.asp#xavier-cameras Xavier Cameras]
 +
* D3 Engineering [https://store.d3engineering.com/product/designcore-d3cm-imx390-camera-module/ IMX390]
 +
* Leopard Imaging [https://leopardimaging.com/product-category/nvidia-jetson-cameras/nvidia-agx-xavier-camera-kits/ Xavier Camera Kits]
 +
* [[Jetson TX1/TX2 OV5693]] camera module
 +
* [https://www.stereolabs.com/ Stereolabs ZED] stereo camera
 +
 
 +
=== Carriers ===
 
* Auvidea [https://auvidea.eu/product/x200-jetson-agx-xavier-carrier-board-with-5-pcie-slots/ X200] (carrier)
 
* Auvidea [https://auvidea.eu/product/x200-jetson-agx-xavier-carrier-board-with-5-pcie-slots/ X200] (carrier)
* e-con Systems [https://www.e-consystems.com/nvidia-cameras/jetson-agx-xavier-cameras/stereo-camera.asp 3D MIPI Stereo camera for NVIDIA® Jetson AGX Xavier™/TX2]
+
* Auvidea [https://auvidea.eu/product/70410/ X220] (carrier)
* [https://www.e-consystems.com/nvidia-cameras/jetson-agx-xavier-cameras/four-synchronized-4k-cameras.asp e-con Systems Synchronized Four Camera Board for Xavier]
 
* [https://www.e-consystems.com/nvidia-jetson-camera.asp#xavier-cameras e-con Systems Xavier Cameras]
 
* [http://www.appropho.com/products_ii_en.html?id=185&type=36 APPROPHO XAVIER/TX2/TX1 Sensor module solution]
 
 
* ConnectTech [http://connecttech.com/product/mimic-adapter-nvidia-jetson-agx-xavier-tx2/ Mimic] (Xavier -> TX1/TX2 adapter)
 
* ConnectTech [http://connecttech.com/product/mimic-adapter-nvidia-jetson-agx-xavier-tx2/ Mimic] (Xavier -> TX1/TX2 adapter)
 
* ConnectTech [http://connecttech.com/product/rogue-carrier-nvidia-jetson-agx-xavier/ Rogue] (carrier)
 
* ConnectTech [http://connecttech.com/product/rogue-carrier-nvidia-jetson-agx-xavier/ Rogue] (carrier)
* ConnectTech [http://connecttech.com/product/sentry-x-rugged-embedded-system/ Sentry-X] (rugged enclosure)
+
 
* [https://store.d3engineering.com/product/designcore-d3cm-imx390-camera-module/ D3 Engineering IMX390]
+
=== Enclosures ===
* [https://leopardimaging.com/product-category/nvidia-jetson-camera/nvidia_agx_xavier_camera_kit/ Leopard Imaging Xavier Camera Kit] (The TX1/TX2 Camera Kit can work on Xavier too, but the LI-JTX1-MIPI-ADPT REV1.2 board needs to be reworked: [https://www.leopardimaging.com/uploads/LI-JTX1-MIPI-ADPT_rework_for_Xavier.pdf Guide])
+
* [http://connecttech.com/product/sentry-x-rugged-embedded-system/ ConnectTech Sentry-X] (rugged enclosure)
* [[Jetson TX1/TX2 OV5693]] camera module
+
* [http://www.miivii.com/en/index.html MiiVii Brain Apex] (fanless enclosure)
* [http://www.miivii.com/en/index.html MiiVii Brain Apex] fanless enclosure
+
* [https://www.syslogic.de/eng/ai-rugged-computer-jetson-agx-xavier-101557.shtml Syslogic RPC/COMPACTA-3] (IP67 enclosure)
* [https://www.stereolabs.com/ Stereolabs ZED] stereo camera
+
* [https://www.syslogic.com/eng/ai-railway-computer-xavier-98349.shtml?c4=0&total= Syslogic IPC/COMPACTA-3] (railway enclosure)
 +
 
 +
=== Other ===
 +
* [https://www.youmagine.com/designs/jetson-xavier-base-cover 3D-printable cover for Xavier devkit base] (Youmagine)
 +
* [https://www.thingiverse.com/thing:3877605 3D-printable cover for Xavier devkit base] (Thingiverse)
 
* [[Sensoray 1012]] 8 channel mPCIe analogue video capture card.
 
* [[Sensoray 1012]] 8 channel mPCIe analogue video capture card.
</div>
+
* [[BeadaPanel#BeadaPanel_for_NVIDIA_Jetson_Dev._Board|BeadaPanel]] USB Display+WiFi+Storage 3-In-1 Companion Kit
  
 
Note that many [https://developer.nvidia.com/embedded/community/ecosystem/camera CSI cameras] from the TX1/TX2 era may be compatible with Jetson AGX Xavier, those that are listed above have been confirmed to work by the community as of this time.
 
Note that many [https://developer.nvidia.com/embedded/community/ecosystem/camera CSI cameras] from the TX1/TX2 era may be compatible with Jetson AGX Xavier, those that are listed above have been confirmed to work by the community as of this time.

Revision as of 07:12, 17 October 2019

NVIDIA Jetson AGX Xavier is an embedded system-on-module (SoM) from the NVIDIA AGX Systems family, including an integrated Volta GPU with Tensor Cores, dual Deep Learning Accelerators (DLAs), octal-core NVIDIA Carmel ARMv8.2 CPU, 16GB 256-bit LPDDR4x with 137GB/s of memory bandwidth, and 650Gbps of high-speed I/O including PCIe Gen 4 and 16 camera lanes of MIPI CSI-2.

Useful for deploying computer vision and deep learning to the edge, Jetson AGX Xavier runs Linux and provides 32 TeraOPS of compute performance in user-configurable 10/15/30W power profiles.

Jetson AGX Xavier is currently available as the Jetson AGX Xavier Developer Kit and the production Jetson AGX Xavier standalone compute module. See the wiki of previous Jetson's here.

Xavier-module-dev-kit-3qrtr-1945px.png

Jetson AGX Xavier Module

The Jetson AGX Xavier compute module contains all the active processing components. The I/O ports are broken out through a carrier board via a 699-pin board-to-board connector.

Below is a partial list of the module's features. Please see the Jetson AGX Xavier Module Datasheet for the complete specifications.

Jetson Xavier Module Block Diagram.jpg

Processing Components

  • Octal-core NVIDIA Carmel ARMv8.2 CPU @ 2.26GHz
  • 512-core Volta GPU @ with 64 Tensor Cores
  • Dual Deep Learning Accelerator (DLA) engines
  • 16GB 256-bit LPDDR4x @ 2133MHz (137GB/s)
  • 32GB eMMC 5.1
  • Vision Accelerator engine
  • (4x) 4Kp60 H.264/H.265 video encoder
  • (2x) 8Kp30 / (6x) 4Kp60 H.265 video decoder
Xavier-module-standing-3qrtr-alpha-1500px.jpg

I/O Interfaces & Ports

  • (16x) MIPI CSI-2 lanes, (8x) SLVS-EC lanes
    • up to 6 active sensor streams and 36 virtual camera channels
  • (5x) PCIe Gen 4 controllers | 1x8, 1x4, 1x2, 2x1
    • (3x) Root Port & Endpoint
    • (2x) Root Port
  • (3x) USB 3.1 + (4x) USB 2.0
  • (3x) eDP 1.4 / DP 1.2 / HDMI 2.0 @ 4Kp60
  • 10/100/1000 BASE-T Ethernet + MAC + RGMII PHY
  • Dual CAN bus controller
  • UART, SPI, I2C, I2C, GPIOs

Form-Factor

  • 699-pin board-to-board connector
  • dimensions: 100x87mm with 16mm Z-height
  • Integrated Thermal Transfer Plate (TTP) with heatpipe
  • -25C to 80C operating temperature
  • 9.0-20VDC input power

Software Support

See the Jetson Zoo for more software packages to install on top of JetPack.

Jetson AGX Xavier Developer Kit

The Jetson AGX Xavier Developer Kit bundles together all the pre-assembled parts for developers to get started creating applications with Jetson AGX Xavier.

Xavier-devkit-3qtr-1500px.jpg

What's Included

  • Open-source reference carrier board (105x105mm)
  • Integrated active thermal solution
  • Jetson AGX Xavier compute module
  • USB 3.0 Type-A to Type-C cable (for flashing)
  • USB 2.0 OTG adapter
  • 19V power supply
  • AC power cable

The design files for the reference carrier board are freely available for download.

Ports & Connectors

The following I/O ports and mezzanines are provided on the devkit:

  • PCIe Gen 4 x16 slot (PCIe x8 / SLVS x8)
  • (2x) USB3.1 (DisplayPort optional) (Power Delivery optional)
  • (16x) MIPI CSI-2 lanes (camera header)
  • Gigabit Ethernet (RJ45)
  • M.2 Key E site (PCIe x1 for Wi-Fi/LTE/5G)
  • M.2 Key M site (NVMe x4)
  • eSATAp + USB 3.0
  • uSD/UFS card socket
  • HDMI 2.0 Type A
  • 40-pin GPIO header (UART, SPI, CAN, I2C, I2C, DMIC, GPIOs)
  • HD Audio header
  • 9.0-20VDC power barrel jack

Getting Started

  • Get the latest development software for PC and Jetson AGX Xavier by using JetPack.
  • Plug in an HDMI display into Jetson, attach the antennas and USB keyboard & mouse, and apply power to boot it up. (User Guide)
  • Visit NVIDIA's Embedded Computing developer portal and the Jetson AGX Xavier Developer Forum to access the latest documentation & downloads.

Availability

  • The devkit is available worldwide through NVIDIA's Jetson AGX Xavier Developer Kit webpage.
  • Alternatively, use the Region Selector to find distributors of the devkit in your region.
  • Pricing Information
    • The MSRP of the Jetson AGX Xavier Developer Kit is $1,299 USD (prices may vary by region)
    • Students, professors, and faculty members affiliated with academic institutions are eligible to receive an EDU discount at $899 USD (prices may vary by region)


Platform Documentation

NVIDIA has released comprehensive documentation and reference designs for Jetson AGX Xavier, available through the Jetson Downloads Center.

Above is a partial list of documents. Please visit the Jetson Downloads Center for the full list that's currently available.

Upcoming Documents

The following upcoming documents for Jetson AGX Xavier are being prepared by NVIDIA:

  • Jetson AGX Xavier Battery and Charger Design Guide
  • Jetson AGX Xavier Voltage and Current Monitor Configuration
  • Jetson AGX Xavier Fuse Specification
  • Jetson AGX Xavier Regulatory and Compliance Documents


Guides and Tutorials

This section contains recipes for following along on Jetson AGX Xavier.

System Tools

Deep Learning

Multimedia

V4L2 drivers for cameras

Ecosystem Products & Cameras

The following are 3rd-party accessories, cameras and carriers available for Jetson AGX Xavier.

Please see the Supported Components List and Jetson Ecosystem directory for a full listing of product partners.

Cameras

Carriers

  • Auvidea X200 (carrier)
  • Auvidea X220 (carrier)
  • ConnectTech Mimic (Xavier -> TX1/TX2 adapter)
  • ConnectTech Rogue (carrier)

Enclosures

Other

Note that many CSI cameras from the TX1/TX2 era may be compatible with Jetson AGX Xavier, those that are listed above have been confirmed to work by the community as of this time.

Getting Help

If you have a technical question or bug report, please visit the DevTalk Developer Forums and search or start a topic.

See the official Support page on Embedded Developer Zone for warranty and RMA information: https://developer.nvidia.com/embedded/support

For NVIDIA webstore Customer Service, please see the My Account page or contact 1-800-797-6530.