Risk-informed reliability improvement optimization for verification and validation planning based on set covering modeling

Abstract

Verification and validation plays a crucial role in the new product development process since it is able to assure product performance and eventually determine customer satisfaction. The verification and validation planning assigns a set of verification and validation activities such as computational simulations and physical tests, which are proposed to mitigate the design risks of specific failure modes, to verify and validate that the product conforms to the design objectives. This article formulates the optimal verification and validation planning using set covering, set partition, and set packing concepts. An extended optimization model based on set covering is also formulated, which can well accommodate the requirements including minimizing the overall risk of the product design, meeting pre-specified risk thresholds of specific failure modes, and covering identified critical failure modes. Additional constraints such as the implementation sequences, time gaps of various types of verification and validation activities, and the distinct effectiveness of each verification and validation activity in reducing design risks are considered in the verification and validation planning optimization models. The decay of the improvement effectiveness of a failure mode with multiple verification and validation activities over time is also considered. The application of the proposed mathematical optimization models for product verification and validation planning is illustrated through the product development of a power generation system within a diesel engine.

Keywords

Verification and validation planning risk mitigation new product development set covering optimization

Get full access to this article

View all access options for this article.

References

Harkonen

Improving product development process through verification and validation. Academic Dissertation, University of Oulu, 2009.

Mobin

Keyser

Multi-objective and multi-stage reliability growth planning in early product-development stage. IEEE Trans Reliab 2016; 65(2): 769–781.

Browning

TR.

The many views of a process: toward a process architecture framework for product development processes. Syst Eng 2009; 12(1): 69–90.

Murthy

DNP

Rausand

Virtanen

Investment in new product reliability. Reliab Eng Syst Saf 2009; 94(10): 1593–1600.

Gupta

Pawar

Smart

New product development in the pharmaceutical and telecommunication industries: a comparative study. Int J Prod Econ 2007; 106(1): 41–60.

Minderhoud

Fraser

Shifting paradigms of product development in fast and dynamic markets. Reliab Eng Syst Saf 2005; 88(2): 127–135.

Potty

Irdus

Ramanathan

. Case study and survey on time and cost overrun of multiple D&B projects. In: Proceedings of the IEEE national postgraduate conference (NPC), Kuala Lumpur, Malaysia, 19–20 September 2011, paper no. 12495044, pp.1–6. New York: IEEE.

Collopy

Hollingsworth

PM.

Value-driven design. J Aircr 2011; 48(3): 749–759.

Sikorsky CH-53K programme puts gearbox issues behind it, https://www.flightglobal.com/news/articles/sikorsky-ch-53k-programme-puts-gearbox-issues-behind-424123/ (accessed 13 April 2016).

10.

Boeing sees more narrowbody delivery delays in third quarter, https://www.reuters.com/article/us-boeing-production-delays/boeing-sees-more-narrowbody-delivery-delays-in-third-quarter-idUSKBN1KT1QW (accessed 8 August 2018).

11.

Rolls-Royce hit by delay to engine for new Airbus jet, https://www.cnbc.com/2018/10/26/rolls-royce-hit-by-delay-to-engine-for-new-airbus-jet.html (accessed 26 October 2018).

12.

MIL-STD-109A: 1961: Quality Assurance Terms and Definitions.

13.

IEEE 729:1983: Standard Glossary of Software Engineering Terminology.

14.

P1490/D1, May 2011—IEEE draft guide: adoption of the Project Management Institute (PMI) standard: a guide to the project management body of knowledge (PMBOK Guide)-2008, 4th ed.

15.

Babuska

Oden

JT.

Verification and validation in computational engineering and science: basic concepts. Comput Method Appl Mech Eng 2004; 193(36): 4057–4066.

16.

Plant

Gamble

Methodologies for the development of knowledge-based systems, 1982–2002. Knowl Eng Rev 2003; 18(1): 47–81.

17.

Maropoulos

Ceglarek

Design verification and validation in product lifecycle. CIRP Ann 2010; 59(2): 740–759.

18.

Murray

RM.

Recent research in cooperative control of multivehicle systems. J Dyn Syst Meas Contr 2007; 129(5): 571–598.

19.

Belt

Harkonen

Mottonen

, et al. Improving the efficiency of verification and validation. Int J Serv Stand 2008; 4(2): 150–166.

20.

Ramanathan

Yunfeng

Incorporating cost and environmental factors in quality function deployment using data envelopment analysis. Omega 2009; 37(3): 711–723.

21.

Whitney

DE.

The role of key characteristics in the design of mechanical assemblies. Assembly Autom 2006; 26(4): 315–322.

22.

Kim

Xirouchakis

CO 2 DE: a decision support system for collaborative design. J Eng Des 2010; 21(1): 31–48.

23.

Peggs

Maropoulos

Hughes

, et al. Recent developments in large-scale dimensional metrology. Proc IMechE, Part B: J Engineering Manufacture 2009; 223(6): 571–595.

24.

Kuo

Huang

Zhang

HC.

Design for manufacture and design for “X”: concepts, applications, and perspectives. Comput Ind Eng 2001; 41(3): 241–260.

25.

Francis

Maropoulos

Mullineux

, et al. Design for verification. Procedia CIRP 2016; 56: 61–66.

26.

Liao

An approach to quality function deployment based on probabilistic linguistic term sets and ORESTE method for multi-expert multi-criteria decision making. Inform Fusion 2018; 43: 13–26.

27.

Han

Wang

, et al. Identification of key design characteristics for complex product adaptive design. Int J Adv Des Manuf Technol 2018; 95(1–4): 1215–1231.

28.

Bjarklev

Eifler

Mortensen

, et al. Application of a graphical scheme for representing the mode of action of products for identification of key characteristics. Proc CIRP 2018; 75: 39–44.

29.

Cho

Park

Cost-effective concept development using functional modeling guidelines. Robot Comput Integr Manuf 2019; 55: 234–249.

30.

Estrada

Shunk

Systematic continuous improvement model for variation management of key characteristics running with low capability. Int J Prod Res 2018; 56(6): 2370–2387.

31.

Kukulies

Schmitt

Stabilizing production ramp-up by modeling uncertainty for product design verification using Dempster–Shafer theory. CIRP J Manuf Sci Technol 2018; 23: 187–196.

32.

Chahin

Paetzold

. Planning validation & verification steps according to the dependency of requirements and product architecture. In: Proceedings of the IEEE international conference on engineering, technology and innovation (ICE/ITMC), Stuttgart, 17–20 June 2018, paper no. 18009225, pp.1–6. New York: IEEE.

33.

Mobin

. An integrated approach to plan the design verification and validation activities for the new product reliability improvement. In: Proceedings of the annual reliability and maintainability symposium (RAMS), Reno, NV, 22–25 January 2018, paper no. 18112381, pp.1–7. New York: IEEE.

34.

Ahmed

Chateauneuf

Optimal number of tests to achieve and validate product reliability. Reliab Eng Syst Safe 2014; 131: 242–250.

35.

Mobin

Cheraghi

, et al. An approach for design verification and validation planning and optimization for new product reliability improvement. Reliab Eng Syst Safe 2019; 190: 106518.

36.

Stamatis

DH.

Failure mode and effect analysis: FMEA from theory to execution. Milwaukee, WI: ASQ Quality Press, 2003.

37.

Vazirani

VV.

Approximation algorithms. New York: Springer, 2013.

38.

Farrell

MJ.

The measurement of productive efficiency. J R Stat Soc 1957; 120(3): 253–290.

39.

Mirdehghan

Shirzadi

Ranking decision making units based on the cost efficiency measure. Int J Pure Appl Math 2012; 81(1): 55–63.

40.

Mitchell

An introduction to genetic algorithms. Cambridge, MA: MIT Press, 1998.