Effort of EAI Projects: A Repertory Grid Investigation of Influencing Factors

Abstract

Many companies struggle with effective and efficient accomplishment of enterprise application integration (EAI), resulting in significant time and budget overruns. Concerning project management, a major reason for failure is considered to be effort underestimation. This underestimation is an aftermath of applying estimation methods that do not account for all relevant factors influencing EAI project effort. Applying the Repertory Grid Technique, we explore factors affecting the effort of such projects by conducting 22 semi-structured expert interviews. We provide an extensive overview of 91 effort-influencing factors and their classification in nine categories, which can be used as a checklist in EAI projects.

Keywords

enterprise application integration effort estimation repertory grid project management

Get full access to this article

View all access options for this article.

References

Abts

C. M.

, & Boehm

B.W.

(1997). COTS software integration cost modeling study (Technical Report). Los Angeles, CA: University of Southern California, Center for Software Engineering.

Ahsan

, Ho

, & Khan

(2013). Recruiting project managers: A comparative analysis of competencies and recruitment signals from job advertisements. Project Management Journal, 44(5), 36–54.

Basten

, & Mellis

(2011, September 22–23). A current assessment of software development effort estimation. Proceedings of the 5th ACM/IEEE international symposium on empirical software engineering and measurement, Banff, Canada, pp. 235–244.

Basten

, & Sunyaev

(2014). A systematic mapping of factors affecting accuracy of software development effort estimation. Communications of the Association for Information Systems, 34(Article 4), 51–86.

Beecham

, Baddoo

, Hall

, Robinson

, & Sharp

(2008). Motivation in software engineering: A systematic literature review. Information and Software Technology, 50(9-10), 860–878.

Benediktsson

, & Dalcher

(2004). New insights into effort estimation for incremental software development projects. Project Management Journal, 35(2), 5–12.

Besner

, & Hobbs

(2012). An empirical identification of project management toolsets and a comparison among project types. Project Management Journal, 43(5), 24–46.

Besner

, & Hobbs

(2013). Contextualized project management practice: A cluster analysis of practices and best practices. Project Management Journal, 44(1), 17–34.

Boehm

B.W.

(1981). Software engineering economics. Englewood Cliffs, NJ: Prentice Hall.

10.

Boehm

B. W.

, Abts

, Brown

A. W.

, Chulani

, Clark

B. K.

, Horowitz

, … Steece

(2000). Software cost estimation with CoCoMo II. Upper Saddle River, NJ: Prentice Hall.

11.

Boehm

B. W.

, & Fairley

R.E.

(2000). Software estimation perspectives. IEEE Software, 17(6), 22–26.

12.

Chipulu

, Neoh

J. G.

, Ojiako

, & Williams

(2013). A multidimensional analysis of project manager competences. IEEE Transactions on Engineering Management, 60(3), 506–517.

13.

Connolly

, & Dean

(1997). Decomposed versus holistic estimates of effort required for software writing tasks. Management Science, 43(7), 1029–1045.

14.

Creasy

, & Anantatmula

V.S.

(2013). From every direction: How personality traits and dimensions of project managers can conceptually affect project success. Project Management Journal, 44(6), 36–51.

15.

Crosman

, Bruno-Britz

, & O'Donnell

(2007). 2008 IT budgets up more than 10% for financial services firms.

16.

Curtis

A. M.

, Wells

T. M.

, Lowry

P. B.

, & Higbee

(2008). An overview and tutorial of the repertory grid technique in information systems research. Communications of the Association for Information Systems, 23(3), 37–62.

17.

Dalcher

, & Benediktsson

(2006). Managing software development project size: Overcoming the effort-boxing constraint. Project Management Journal, 37(2), 51–58.

18.

Daneva

(2008). Complementing approaches in ERP effort estimation practice: An industrial study. Proceedings of the 4th international workshop on predictor models in software engineering (pp. 87–92). Leipzig, Germany: ACM.

19.

Daneva

(2010). Balancing uncertainty of context in ERP project estimation: An approach and a case study. Journal of Software Maintenance and Evolution: Research and Practice, 22(5), 329–357.

20.

Dejaeger

, Verbeke

, Martens

, & Baesens

(2012). Data mining techniques for software effort estimation: A comparative study. IEEE Transactions on Software Engineering, 38(2), 375–397.

21.

Dillon

, & McKnight

(1990). Towards a classification of text types: A Repertory Grid Approach. International Journal of Man-Machine Studies, 33(6), 623–636.

22.

Dunn

W. N.

, & Ginsberg

(1986). A sociocognitive network approach to organizational analysis. Human Relations, 39(11), 955–975.

23.

Flick

(2009). An introduction to qualitative research. Los Angeles, CA: Sage.

24.

Francalanci

(2001). Predicting the implementation effort of ERP projects: Empirical evidence on SAP/R3. Journal of Information Technology, 16(1), 33–48.

25.

Fransella

, Bell

, & Bannister

(2004). A manual for repertory grid technique. Chichester, England: Wiley.

26.

Furulund

K. M.

, & Moløkken-Østvold

(2007, October 11–12). Increasing software effort estimation accuracy—Using experience data, estimation models and checklists. Proceedings of the seventh international conference on quality software, Portland, OR, pp. 342–347.

27.

Ganly

(2009). Estimating the costs of an ERP/business application initiative. Gartner RAS Core Research Note G00167162.

28.

Gartner Inc. (2006). Gartner says worldwide application integration and middleware market increased 7 percent in 2005. Stamford, CT. Retrieved from http://gartner.com/newsroom/id/492892

29.

Gartner Inc. (2008). Gartner says worldwide application infrastructure and middleware market revenue increased 13 percent in 2007. Stamford, CT. Retrieved from http://www.gartner.com/newsroom/id/689410

30.

Gericke

, Klesse

, Winter

, & Wortmann

(2010). Success factors of application integration: An exploratory analysis. Communications of the Association for Information Systems, 27(Article 37), 677–694.

31.

Glaser

B. G.

, & Strauss

A.L.

(1967). The discovery of grounded theory: Strategies for qualitative research. Chicago, IL: Aldine Publishing Company.

32.

González

G. E. G.

, Casas

G. H. P.

, & Coronado

C. A. L.

(2013). Project manager profile characterization in the construction sector in Bogotá, Colombia. Project Management Journal, 44(6), 68–93.

33.

Gray

A. R.

, MacDonell

S. G.

, & Shepperd

(1999, November 4–6). Factors systematically associated with errors in subjective estimates of software development effort: The stability of expert judgment. Proceedings of the sixth international software metrics symposium, pp. 216–227.

34.

Grimstad

, & Jørgensen

(2007). Inconsistency of expert judgment-based estimates of software development effort. Journal of Systems and Software, 80(11), 1770–1777.

35.

Gruschke

T. M.

, & Jørgensen

(2008). The role of outcome feedback in improving the uncertainty assessment of software development effort estimates. ACM Transactions on Software Engineering and Methodology, 17(4), 20: 1–20: 35.

36.

Guba

E.G.

(1978). Toward a methodology of naturalistic inquiry in educational evaluation. Los Angeles, CA: University of California.

37.

Hasselbring

(2000). Information system integration. Communications of the ACM, 43(6), 32–38.

38.

Hassenzahl

(2002). Character grid: A simple repertory grid technique for web site analysis and evaluation. In Ratner

(Ed.), Human factors and web development (pp. 183–206). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

39.

Heemstra

F. J.

, & Kusters

R.J.

(1991). Function point analysis: Evaluation of a software cost estimation model. European Journal of Information Systems, 1(4), 229–237.

40.

Hinkle

D.N.

(1965). The change of personal constructs from the viewpoint of a theory of construct implications (PhD dissertation). Ohio State University, Columbus, OH.

41.

Hirschheim

, & Newman

(1988). Information systems and user resistance: Theory and practice. The Computer Journal, 31(5), 398–408.

42.

L. T.

, & Lin

G. C. I.

(2004). Critical success factor framework for the implementation of integrated-enterprise systems in the manufacturing environment. International Journal of Production Research, 42(17), 3731–3742.

43.

Jankowicz

(2001). Why does subjectivity make us nervous? Making the tacit explicit. Journal of Intellectual Capital, 2(1), 61–73.

44.

Jankowicz

(2004). The easy guide to repertory grids. Chichester, England: Wiley.

45.

Jørgensen

(2004a). A review of studies on expert estimation of software development effort. Journal of Systems and Software, 70(1-2), 37–60.

46.

Jørgensen

(2004b). Top-down and bottom-up expert estimation of software development effort. Information and Software Technology, 46(1), 3–16.

47.

Jørgensen

(2014). What we do and don't know about software development effort estimation. IEEE Software, 31(2), 37–40.

48.

Jørgensen

, Boehm

, & Rifkin

(2009). Software development effort estimation: Formal models or expert judgment? IEEE Software, 26(2), 14–19.

49.

Keen

P.G.

(1981). Information systems and organizational change. Communications of the ACM, 24(1), 24–33.

50.

Keil

, Lee

H. K.

, & Deng

(2013). Understanding the most critical skills for managing IT projects: A Delphi study of IT project managers. Information & Management, 50(7), 398–414.

51.

Kelly

G.A.

(1955). The psychology of personal constructs. New York, NY: Norton.

52.

Kemerer

C.F.

(1987). An empirical validation of software cost estimation models. Communications of the ACM, 30(5), 416–429.

53.

Khoumbati

, & Themistocleous

(2006). Integrating the IT infrastructures in healthcare organisations: A proposition of influential factors. Electronic Journal of E-Government, 4(1), 27–36.

54.

Klakegg

O. J.

, Williams

, Magnussen

O. M.

, & Glasspool

(2008). Governance frameworks for public project development and estimation. Project Management Journal, 39(S1), S27–S42.

55.

Kugeler

, & Vieting

(2003). Design of a process-oriented organizational structure. In Becker

, Kugeler

, & Rosemann

(Eds.), Process management: A guide for the design of business processes (pp. 165–205). Berlin, Germany: Springer.

56.

Lam

(2005). Investigating success factors in enterprise application integration: A case-driven analysis. European Journal of Information Systems, 14(2), 175–187.

57.

Lane

J.A.

(2004, August). Constructive cost model for system-of-system integration. ACM-IEEE international symposium on empirical software engineering, Redondo Beach, CA, pp. 19–20.

58.

Lincoln

Y. S.

, & Guba

E.G.

(1985). Naturalistic inquiry. Newbury Park, CA: Sage.

59.

Linthicum

D.S.

(2000). Enterprise application integration. Reading, MA: Addison-Wesley.

60.

Linthicum

D.S.

(2004). Next generation application integration: From simple information to web services. Boston, MA: Addison-Wesley.

61.

Lublinsky

, & Farrell

J.M.

(2002). Top 10 reasons why EAI fails. eAI Journal (12), 41–42.

62.

Markus

M.L.

(2000). Paradigm shifts: E-Business and business/systems integration. Communications of the Association for Information Systems, 4(Article 10), 1–45.

63.

Mendoza

L. E.

, Pérez

, & Grimán

(2006). Critical success factors for managing systems integration. Information Systems Management, 23(2), 56–75.

64.

Meyer

W.G.

(2014). The effect of optimism bias on the decision to terminate failing projects. Project Management Journal, 45(4), 7–20.

65.

Miranda

, & Abran

(2008). Protecting software development projects against underestimation. Project Management Journal, 39(3), 75–85.

66.

Moløkken-Østvold

, Jørgensen

, Tanilkan

S. S.

, Gallis

, Lien Anette

, & Hove Siw

(2004, September 11–17). A survey on software estimation in the Norwegian industry. Proceedings of the 10th international symposium on software metrics, Chicago, IL, pp. 208–219.

67.

Mouzakitis

, Sourouni

A.-M.

, & Askounis

(2009). Effects of enterprise interoperability on integration efforts in supply chains. International Journal of Electronic Commerce, 14(2), 127–155.

68.

Nonaka

(1994). A dynamic theory of organizational knowledge creation. Organization Science, 5(1), 14–37.

69.

Patton

M.Q.

(2002). Qualitative research & evaluation methods. Thousand Oaks, CA: Sage.

70.

Polanyi

(1966). The tacit dimension. Chicago, IL, London, England: University of Chicago Press.

71.

Procaccino

J. D.

, Verner

J. M.

, Shelfer

K. M.

, & Gefen

(2005). What do software practitioners really think about project success: An exploratory study. Journal of Systems and Software, 78(2), 194–203.

72.

Reel

J.S.

(1999). Critical success factors in software projects. IEEE Software, 16(3), 18–23.

73.

Riempp

, & Gieffers-Ankel

(2007). Application portfolio management: A decision-oriented view of enterprise architecture. Information Systems and e-Business Management, 5(4), 359–378.

74.

Rosa

, Packard

, Krupanand

, Bilbro

J. W.

, & Hodal

M.M.

(2013). COTS integration and estimation for ERP. Journal of Systems and Software, 86(2), 538–550.

75.

Rugg

, Eva

, Mahmood

, Rehman

, Andrews

, & Davies

(2002). Eliciting information about organizational culture via laddering. Information Systems Journal, 12(3), 215–229.

76.

Ruh

W. A.

, Maginnis

F. X.

, & Brown

W.J.

(2000). Enterprise application integration: A Wiley tech brief. New York, NY: Wiley.

77.

Schwinn

, & Winter

(2007). Success factors and performance indicators for enterprise application integration. In Lam

, & Shankararaman

(Eds.), Enterprise architecture and integration (pp. 23–39). Hershey, PA: IGI Global.

78.

Seaver

(2006). Estimating enterprise resource planning. Pittsburgh, PA: Soft Ware Engineering Institute SEPG, Carnegie Mellon University.

79.

Shaw

M. L.

, & Gaines

B.R.

(1989). Comparing conceptual structures: Consensus, conflict, correspondence and contrast. Knowledge Acquisition, 1(4), 341–363.

80.

Siau

, Tan

, & Sheng

(2010). Important characteristics of software development team members: An empirical investigation using Repertory Grid. Information Systems Journal, 20(6), 563–580.

81.

Smith

(1986). A repertory grid analysis of supervisory jobs. Applied Psychology, 35(4), 501–511.

82.

Sommerville

(2011). Software engineering. Boston, MA: Pearson.

83.

Sprott

(2000). Enterprise resource planning: Componentizing the enterprise application packages. Communications of the ACM, 43(4), 63–69.

84.

Stelzer

, Mellis

, & Herzwurm

(1997). A critical look at ISO 9000 for software quality management. Software Quality Journal, 6(2), 65–79.

85.

Stensrud

(2001). Alternative approaches to effort prediction of ERP projects. Information and Software Technology, 43(7), 413–423.

86.

Stensrud

, & Myrtveit

(1998, November 20–21). Human performance estimating with analogy and regression models: An empirical validation. IEEE international software metrics symposium, Bethesda, MD, pp. 205–213.

87.

Stewart

, Stewart

, & Fonda

(1981). Business applications of repertory grid. London, England: McGraw-Hill.

88.

Strauss

A. L.

, & Corbin

J.M.

(1990). Basics of qualitative research: Techniques and procedures for developing grounded theory. Newbury Park, CA: Sage.

89.

Tan

F. B.

, & Hunter

M.G.

(2002). The repertory grid technique: A method for the study of cognition in information systems. MIS Quarterly, 26(1), 39–57.

90.

Themistocleous

(2004). Justifying the decisions for EAI implementations: A validated proposition of influential factors. Journal of Enterprise Information Management, 17(2), 85–104.

91.

Themistocleous

, & Irani

(2002). Novel taxonomy for application integration. Benchmarking: An International Journal, 9(2), 154–165.

92.

Thompson

(2007). Integration is out of the limelight but growing in importance. Stamford, CT: Gartner, Inc.

93.

Tuft

(2001). The changing role of IT strategy: Enterprise architecture strategies. eAI Journal, 3(1). Retrieved from http://www.datamation.com/entdev/article.php/623041/The-Changing-Role-of-IT-Strategy-Enterprise-Architecture-Strategies.htm

94.

Valerdi

(2005). The Constructive Systems Engineering Cost Model (COSYSMO) (Dissertation). University of Southern California, Los Angeles, CA.

95.

Valerdi

, & Madachy

(2007). Impact and contributions of MBASE on software engineering graduate courses. Journal of Systems and Software, 80(8), 1185–1190.

96.

Whyte

, & Bytheway

(1996). Factors affecting information systems’ success. International Journal of Service Industry Management, 7(1), 74–93.

97.

Xia

, Ho

, & Capretz

L.F.

(2008). A neuro-fuzzy model for function point calibration. WSEAS Transactions on Information Science and Applications, 5(1), 22–30.

98.

Yang

, & Papazoglou

M.P.

(2000). Interoperation support for electronic business. Communications of the ACM, 43(6), 39–47.

99.

Zahavi

(2000). Enterprise application integration with CORBA: Component and web-based solutions. New York, NY: Wiley.

100.

Zaitun

A.B.

(2001). Success factors to systems integration implementation: More technically oriented than human related. Malaysian Journal of Computer Science, 14(2), 64–69.