Automated Link-16 Testing Using the Discrete Event System Specification and Extensible Markup Language

Abstract

With the modernization of Department of Defense (DoD) systems and the growing complexity of communication equipment, traditional test methods and processes have to evolve in order to maintain their effectiveness. DoD acquisition policy requires the use of modeling and simulation (M&S) in all phases of system development life-cycles in order to ensure technical certification and mission effectiveness. The complexity of these systems poses significant challenges over traditional interoperability test methodologies. The Automated Test Case Generator (ATC-Gen), funded by the Joint Interoperability Test Command (JITC), captures a Military Standard (MIL-STD) 6016C document and translates it into rules. These are in turn formalized into test cases using the Discrete Event System Specification (DEVS). In this paper, we present a new methodology to generate the test models and perform conformance testing using system theory, the DEVS M&S framework, the System Entity Structure (SES), and Extensible Markup Language (XML). This new methodology promotes the separation of the models, the simulator, and the distributed simulation. These separations distinguish and promote reusability by developing models, the simulator, and distributed simulation independently. The DEVS test models are generated from the test cases by the Test Model Generator using the system specifications. These models are written in an XML-SES format; the resulting C++ DEVS source code is generated based on the test model XML file. The Test Driver (TD) was designed based on the Model/Simulator/View/Control (MSVC) design pattern and developed to execute the DEVS test models. MSVC supports model and simulator separation design. It was also designed to support multiple network simulation protocols and rapid software modifications in order to incorporate new network protocols into the simulation software. This methodology was used to verify the conformance of the Integrated Architecture Behavior Model (IABM) to the MIL-STD 6016C, and the results of the test scenarios were validated using the JITC’s Simple J network packet-monitoring tool. The network packet monitor captured the transmissions and the receipt of the tactical data messages from the TD. The system analyst interpreted and verified the messages, and determined whether these messages were the intended behavior of the TD.

Keywords

Discrete Event System Specification Extensible Markup Language System Entity Structure

Get full access to this article

View all access options for this article.

References

Zeigler B. , Hammonds P. , Fulton D. , Nunn K. , and Mak E. Simulation-based testing of emerging defense information system. In progress.

Technology for the United States Navy and Marine Corps. 2000-2035 Becoming a 21st-century force: volume 9: modeling and simulation. National Academy Press , 1997.

Modeling and simulation in manufacturing and defense acquisition: pathways to success. National Academy Press, 2002.

Zeigler BP , Fulton D. , Hammonds P. , and Nutaro J. Framework for M&S-based system development and testing in net-centric environment. ITEA J Test Eval 2005; 26(3).

Zeigler BP , Ball G. , Cho H. , Lee JS , and Sarjoughian H. Implementation of the DEVS formalism over the HLA/RTI: problems and Solutions . Spring Simulation Interoperability Workshop 1999 .

Extensible Markup Language. http://www.w3.org/XML (accessed April 15, 2006).

Rozenblit JW , Huang YM Rule-based generation of model structures in multifaceted modeling and system design. ORSA J Comput 1991; 3(4).

Zeigler BP , Praehofer H. , and Kim TG Theory of modeling and simulation. Academic Press , 2000.

Chairman. Interoperability and supportability of information technology and national security systems . JCS Instruction 6212.01C 20. November 2003 .

10.

Song HS , Kim TG The DEVS framework for discrete event systems control. In Proceedings of the fifth Annual Conference on Al, Simulation, and Planning in High Autonomy Systems. 1994, pp.228-234,

11.

Nutaro J. , Hammonds P. Combining the model/view/control design pattern with the DEVS formalism to achieve rigor and reusability in distributed simulation. J Defense Model Simulat 2004; 1(1): 19-28.

12.

Mittal S. , Mak E. , and Nutaro J. DEVS-based dynamic model reconfiguration and simulation control in the enhanced DoDAF design process. J Defense Model Simulat In press.

13.

Nutaro J. A Discrete Event Simulator, http://www.ece.arizona.edu/~nutaro (accessed April 15, 2006).

14.

Mak E. Automated Testing using XML and DEVS, http://www.acims.arizona.edu (accessed June 30, 2006).

15.

Riehle D. The event notification pattern - integrating implicit invocation with object orientation. Theor Pract Object Syst 1996; 2(1): 43-52.

16.

Gamma E. , Helm R. , Johnson R. , and Vlissides J. Design patterns: elements of reusable design. Addison-Wesley , 1995.

17.

Siso. Standard for Link 16 simulation. SISO-STD-002-2006. 8 May 2006.

18.

Zeigler B. , Hammonds P. Modeling and simulation-based data engineering. Academic Press, 2007.

19.

Tolk A. , Muguira JA The levels of conceptual interoperability model (LCIM). In Proceedings of the Fall Simulation Interoperability Workshop, 2003

20.

Turnista C. Extending the levels of conceptual interoperability model. In Proceedings of the IEEE Summer Computer Simulation Conference , 2005

21.

Muguira J. , Tolk A. Applying methodology to identify structural variances in interoperations . J Defense Model Simulat 2006; 3(2) 77-93.

22.

Hoffman M. Challenges of model interoperation in military simulations. Simulation 2004; 80: 659-667.

23.

Chaum E. , Hieb MR , and Tolk A. M&S and the Global Information Grid. In Proceedings of the Interservice/Industry Training, Simulation and Education Conference (I/ITSEC), 2005.

24.

Mittal S. , Martín JLR , and Zeigler BP DEVS-based simulation web services for net-centric T&E. In Proceedings of the Summer Computer Simulation Conference (SCSC’07) , San Diego, July 2007 .

25.

Mittal S. Extending DoDAF to allow DEVS-based modeling and simulation. J Defense Model Simulat 3(2) 95-123.