Closed-Loop HIL System for Testing Camera-Based Systems by Inserting Data into the Image Sensor Output

  • HIL system with Automotive Simulation Models (ASM) and ModelDesk for the real-time simulation of the vehicle and traffic
  • GPU-based camera sensor models in MotionDesk for generating image raw data taking camera-specific effects such as lens, pincushion, and barrel distortions, vignetting, and chromatic aberration into account.
  • dSPACE Environment Sensor Interface Unit to insert raw data into the image processing unit
  • Plug-on device (POD) to adjust to specific interfaces and connectors with sensor ECUs featuring imager and processing unit in one housing (one-box)

The camera box is a widely used method when testing camera-based ADAS applications. However, with the increasing complexity of sensors, issues such as limited contrast of monitors or distortions caused by optical lenses become more evident. In addition, conventional HIL setups with stereo or multi-camera system often reach the limits of economic efficiency or technical feasibility. A very effective and space-saving alternative is feeding raw image data directly into the camera’s image processing unit. The basis for raw data generation is a GPU-based camera sensor model in MotionDesk that takes into account not only scenarios from the ASM simulation model but also effects typically caused by camera lens and image sensor when generating images. The data stream is then transmitted via HDMI to an Environment Sensor Interface Unit (ESI Unit), where it can be preprocessed in real time, i.e., provided with pixel errors or soiled, until it is finally fed to the camera via a long-range (e.g., GMSL) or short-range interface of the image processing unit. For short-range connection (e.g., CSI2), the ESI-POD is also used. The device is connected to the ESI unit via an optical fibre cable and via a short data line to the camera. For a test setup with a stereo front, four surround view, and an in-cabin (driver) camera, a single ESI unit is sufficient; it can be conveniently placed in the 19“rack of the HIL.     

혁신을 추진하세요. 항상 기술 개발의 동향을 주시해야 합니다.

저희 전문 지식 서비스에 가입하세요. dSPACE의 성공적인 프로젝트 사례를 확인해 보세요. 시뮬레이션 및 검증에 대한 최신 정보를 받아보세요. 지금 바로 dSPACE 다이렉트(뉴스레터)를 구독하세요.

Enable form call

At this point, an input form from Click Dimensions is integrated. This enables us to process your newsletter subscription. The form is currently hidden due to your privacy settings for our website.

External input form

By activating the input form, you consent to personal data being transmitted to Click Dimensions within the EU, in the USA, Canada or Australia. More on this in our privacy policy.