Identification of Critical Test Scenario Groups for Aircraft Functions Based on Operational Design Domains

Author(s):

S. Krause and S. Reglitz
dSPACE GmbH, Paderborn, NRW, 33102, Germany
D. Hillig and F. Thielecke
Hamburg University of Technology, Hamburg, 21129, Germany
M. Franke
Bremer Institut für Produktion und Logistik GmbH, Bremen, 28359, Germany

The development of aircraft systems requires robust verification and validation processes to ensure safety, reliability, and functionality. The rapid advancements in system automation have introduced a level of complexity where traditional testing methods reach their limits. Such methods often encounter challenges in identifying critical test scenarios early in the development cycle, which can cause delays. This delay can lead to significant cost implications due to late error detection and subsequent redevelopments. The primary objective of this research is to develop a method that enhances the early identification of critical test scenarios, thereby improving the efficiency and effectiveness of the testing process by using the concept of operational design domains (ODD) as a framework. By employing a hierarchical ODD approach, this study creates smaller, priority test groups that can be continuously used and shared among stakeholders throughout the testing process. As a further step, a stochastic test exploration method is used to generate a variety of scenario-based test cases, including critical test cases. These test cases, written in TA-SCXML, are analyzed using ODD-based observers within a virtual integration environment. To identify test cases to be shared between stakeholders, a grouping concept is proposed. The groups contain critical test cases that verify the behavior as described by the ODD, as well as test cases that explore behavior outside of the ODD. The method is applied on a flight control use case involving a virtually integrated software prototype for investigating new flight automation concepts for an UAV. The proposed method successfully identifies critical scenario-based test cases, which are then grouped and provided to suppliers and other stakeholders.