Environment Sensor Interface Unit

Feeding digital data into camera, radar and lidar ECUs

Les systèmes destinés à la conduite autonome utilisent divers capteurs d’environnement. Afin de simuler les capteurs dans une installation HIL réalisée pour la fusion de capteurs et les tests de fonction, il est essentiel de synchroniser précisément la stimulation de chaque capteur. The dSPACE Environment Sensor Interface Unit supports the time-correlated feeding of raw sensor data to one or more sensor ECUs.

  • Unité ESI : Preconfigured Solution for NVIDIA® DRIVE™ PX2 and AGX

    L'Unité ESI (Environment Sensor Interface) de dSPACE est la réponse flexible à la question sur comment alimenter des signaux numériques large bande dans des calculateurs de caméra, de radar et de lidar tout en maintenant la corrélation temporelle et de faibles latences. L’un des plus grands défis dans le développement de fonctions pour la conduite automatisée est la validation de capteurs d’environnement. Because many development departments use the NVIDIA® DRIVE™ PX2 and AGX platforms in their predevelopment and research for automated driving, dSPACE now offers the ESI Unit in an out-of-the-box variant that is preconfigured for these NVIDIA® platforms and can be used for inserting camera raw data. Les solutions dSPACE pour la simulation de capteurs et de l'environnement peuvent être utilisées directement avec l'Unité ESI préconfigurée pour valider les fonctions de conduite automatisée.

  • High-performance FPGA for feeding raw sensor data to sensor ECUs in a synchronized manner
  • Flexible adaption of long- and short-range raw data interfaces
  • Support for lidar, radar, and camera sensors, including FPGA-based sensor models
  • Simulation of up to 12 sensors with 50 Gbit/s of aggregated bandwidth

dSPACE Environment Sensor Interface Unit

Two typical use cases: (a) Insertion of raw sensor data into the digital interface behind the respective sensor front end. (b) Replay of pre-recorded sensor and bus data with RTMaps.

Domaines d’application

For the development and validation of environment sensors, e.g., radar, camera and lidar, and more generally the validation of ADAS/AD functions, support for a range of ECU interfaces for data insertion is essential. In addition to testing based on over-the-air methods and object lists, the insertion of raw data or target lists is of utmost importance for the validation of perception and fusion algorithms that are based on raw data. The Environment Sensor Interface (ESI) Unit supports all relevant sensor interfaces and is eminent for closed-loop and open-loop testing. Advanced sensor simulation in combination with the ESI Unit makes it easy to provide synthetic sensor data under realistic conditions and with low latencies. This is useful for validating functions for autonomous driving in hardware-in-the-loop (HIL) simulation, in both closed- and open-loop scenarios. If RTMaps is used as well, recorded sensor data can be replayed conveniently.

 

Key Benefits

The Environment Sensor Interface Unit supports the injection of raw data and target lists for HIL tests of camera, radar, and lidar ECUs as well as central processing units for autonomous driving. Thanks to its flexible and scalable architecture, the ESI Unit supports, for example, lidar point cloud data injection via 10 Gigabit Ethernet, radar raw data injection via MIPI CSI-2, and camera raw data injection via TI FPD-Link III or Maxim GMSL. To meet the requirements of next-generation ECUs, the ESI Unit can be configured to simulate the latest sensors, including FPGA-based sensor models. A single ESI Unit simulates up to twelve sensors synchronously and supports more than 50 Gbit/s of aggregated bandwidth. Multiple combined ESI Units let you test functions for autonomous driving with dozens of different sensors. Special customer requirements and functions can be implemented directly on the ESI Unit thanks to the powerful Xilinx® UltraScale+™ FPGA.

Preconfigured Environment Sensor Interface Unit

As NVIDIA® DRIVE PX2 and AGX platforms are widely used in predevelopment and research for functions for autonomous driving, dSPACE provides a preconfigured ESI Unit for camera raw data injection. In combination with dSPACE Sensor Simulation 1) up to four cameras (Sekonix SF332x) can be simulated as an off-the-shelf version.

1) For using the preconfigured ESI Unit together with RTMaps, please contact dSPACE for more information.

Parameter Specification

FPGA
  • Xilinx® Zynq® UltraScale+™ FPGA with an aggregated data rate of up to 50 Gbit/s

Memory
  • 8 GB RAM, 4 GByte flash memory
Sensor interfaces
  • TI FPD-Link III, TI FPD-Link IV, Maxim GMSL, Maxim GMSL2, MIPI CSI-2, HiSPI, LVDS, Parallel (up to 8 Gbit/s)
  • 1G/10G Ethernet, GigE Vision 1) , Ethernet AVB 1)
  • Simulation of control interface to sensor ECU (e.g., I2C, SPI), including full I2C imager simulation
  • Customer-specific interfaces on request
Input interfaces
  • Up to four DisplayPort or HDMI inputs (up to 17 Gbit/s, 4k resolution, and 120 Hz per input), 10G Ethernet
Design
  • 19'' rack-mount version
  • 2 height units (H)
Cooling
  • Active cooling
Power supply
  • 24 V DC
Weight
  • 3.8 kg (8.4 lb)
Size
  • 448.9 x 255.5 x 88.1 mm (17.7 x 10.1 x 3.5 in)
Camera
  • High dynamic range (HDR) with up to 24 bits, up to 4k resolution, high frame rates, stereo or multiple camera setups, imager sensor models, dynamic exposure control
Radar
  • Detection list (point cloud), raw data (ADC data) injection including multipath propagation, reflection, and scattering
Lidar
  • Extended point cloud injection including information like distance, reflectivity, azimuth, and elevation angle

1) Disponible sur demande.

  • Environment Sensor Interface Unit Informations produit, PDF, Anglais, 513 KB
Sujets apparentés Cas d'utilisation

S'inscrire à la Newsletter

S’abonner à nos newsletters, gérer ses abonnements ou se désabonner