The evaluation of information systems technology (IS/IT) investments has been a much debated issue in the IS literature. This paper adds to that debate by discussing the IS/IT project evaluation practices of a sample of the top 1000 UK companies. The study sheds light on a number of evaluation issues, including the extent to which formal procedures of evaluation exist within organizations, and the extent to which consultation with stakeholders takes place, in addition to identifying the problems inherent in evaluating IS/IT investments. The implications of the findings are discussed, where possible in the light of previous research, in addition to identifying a number of key issues where further research is needed.
Get full access to this article
View all access options for this article.
References
1.
AllenC., ScheweT.C.D., and WijkG. (1980). Foot technique in the pre-call/mail survey setting. Journal of Marketing Research, XVII, 489–502.
2.
AngellI.O., and SmithsonS. (1991). Evaluation, monitoring and control, in Information Systems Management: Opportunities and Risks (MacMillan Educational, Hong Kong) pp. 189–212.
3.
BaconJ.C. (1992). The use of decision criteria in selecting information systems/technology investments. MIS Quarterly, 16, 335–53.
4.
BadriM.A. (1992). Critical issues in information systems management: an international perspective. International Journal of Information Management, 12, 179–91.
5.
BallantineJ.A., GalliersR.D., and StrayS.J. (1995). The use and importance of financial appraisal techniques in the IS/IT investment decision making process – recent UK evidence. Project Appraisal, 10, 210–18.
6.
BelsonW.A. (1964). Readership in Britain. Business Review, 6, 416–20.
7.
BlacklerF., and BrownC. (1988). Theory and practice in evaluation: the case of the new information technologies, in Information Systems Assessment: Issues and Challenges, Bjorn-AndersonN., and DavisG.B. (eds), (North-Holland) pp. 351–67.
8.
BowerJ.L. (1970). Managing the Resources Allocation Process (Harvard University Press, Cambridge).
9.
CarsbergB., and HopeA. (1976). Business Investment Decisions Under Inflation: Theory and Practice (Institute of Chartered Accountants in England and Wales, London).
10.
ChandlerJ.S. (1982). A multiple criteria approach for evaluating information systems. MIS Quarterly, 6, 61–75.
11.
ClarkT.D.Jr (1992). Corporate systems management: an overview and research perspective. Communications of the ACM, 35, 61–75.
12.
DavisD. (1989). US giants run a $50 billion IS tab. Datamation, November 15, 35, 42–4.
13.
DawesG.M. (1987). Information systems assessment: post implementation practice. Journal of Applied Systems Analysis, 14, 53–62.
14.
DicksonG.W., and NechisM. (1984). Key information systems issues for the 1980's. MIS Quarterly, 8, 135–49.
15.
EtzerodtP., and MadsenK.H. (1988). Information systems assessment as a learning process, in Information Systems Assessment: Issues and Challenges, Bjorn-AndersonN., and DavisG.B. (eds), (North-Holland, Amsterdam), pp. 333–47.
16.
FarbeyB., LandF., and TargettD. (1992). Evaluating investments in IT. Journal of Information Technology, 7, 109–22.
17.
FarbeyB., LandF., and TargettD. (1993). How to Assess Your IT Investment: A Study of Methods and Practice (Butterworth-Heinemann Ltd, Oxford).
18.
FarbeyB., LandF., and TargettD. (1995). Hard Money – Soft Outcomes, Evaluating and Managing the IT Investment (Alfred Waller Limited, Henley on Thames).
19.
GalliersR.D. (1987). Information systems planning in the United Kingdom and Australia – a comparison of current practice, in Oxford Surveys in Information Technology, ZorkorczyP.I. (ed.), (Oxford University Press, Oxford), pp. 223–55.
20.
GalliersR.D. (1995). A manifesto for information management research. British Journal of Management, 6, special issue, S45–S52.
21.
GalliersR.D., MeraliY., and SpearingL. (1994). Coping with information technology? How British executives perceive the key information systems management issues in the mid-1990s. Journal of Information Technology, 9, 223–38.
22.
GinzbergM.J. (1979). Improving MIS project selectionOMEGA, 7, 527–37.
23.
GinzbergM.J., and ZmudR.W. (1988). Evolving criteria for information systems assessment, in Information Systems Assessment: Issues and Challenges, Bjorn-AndersonN., and DavisG.B. (eds), (North-Holland, Amsterdam), pp. 41–52.
24.
GitmanL., and ForresterJ. (1977). A survey of capital budgeting techniques used by major US firms. Financial Management, 61, 66–71.
25.
HamiltonS., and ChervancyN.L. (1981). Evaluating information system effectiveness – part 1: comparing evaluation approaches. MIS Quarterly, 5, 55–69.
26.
HawgoodJ., and LandF. (1988). A multivalent approach to information system assessment, in Information Systems Assessment: Issues and Challenges, Bjorn-AndersonN., and DavisG.B. (eds), (North-Holland, Amsterdam), pp. 103–20.
27.
HirschheimR., and SmithsonS. (1988). A critical analysis of information systems evaluation, in Information Systems Assessment: Issues and Challenges, Bjorn-AndersonN., and DavisG.B. (eds), (North-Holland, Amsterdam), pp. 17–37.
28.
HochstrasserB., and GriffithsC. (1991). Controlling IT Investment Strategy and Management (Chapman and Hall, London).
29.
IanM. (1989). Computing Matters: Making it Work to Best Effect. Management Today, January, 109–10.
30.
KeenP.G.W. (1991). Shaping the Future: Business Design Through Information TechnologyHarvard Business School Press, Boston, MA).
31.
KellyG.G., WatsonR.T., GalliersR.D., and BrancheauJ.C. (1994). Key issues in information systems management: an international perspective, Warwick Business School Research Paper No 134.
32.
KimS.H., and FarragherE.J. (1981). Current capital budgeting practices. Management Accounting, June, 62, 26–9.
33.
KingJ.L., and SchremsE.L. (1978). Cost-benefit analysis in information systems development and operation. Computer Surveys, 10, 19–34.
34.
KlammerT. (1972). Financial evidence of the adoption of sophisticated capital budgeting techniques. Journal of Business, 45, 387–97.
35.
KleinG., and BeckP.O. (1987). A decision aid for selecting among information system alternatives. MIS Quarterly, 11, 177–85.
36.
LovermanG. (1991). Cash drain, no gain. Computerworld, November 25, 69–72.
37.
MaglittaJ., and Sullivan-TrainorM. (1991). Do the right things. Computerworld: The Premier 100 (supplement), 6–13.
38.
MarshP., BarwiseP., ThomasK., and WensleyR. (1988). Strategic Investment Decisions in Large Diversified Companies (Centre for Business Strategy, London Business School, London).
39.
MillsR.W. (1988). Capital budgeting techniques used in the UK and the USA. Management Accounting, 61, 1.
40.
MooreJ.S., and ReichertA.K. (1983). An analysis of financial management techniques currently employed by large US corporations. Journal of Business Finance and Accounting, 10, 623–45.
41.
MoserC., and KaltonG. (1971). Survey Methods in Social Investigation, 2nd Edition. (Heinemann).
42.
NiedermanF., BranchaeuJ.C., and WetherbeJ.C. (1991). Information systems management issues for the 1990s. MIS Quarterly, 15, 475–99.
43.
ParkerM.M., TrainorH.E., and BensonR.J. (1989). Information Strategy and Economics (Prentice-Hall, New Jersey).
44.
PettyJ.W., ScottD.F., and BirdM.M. (1975). The capital expenditure decision-making process of large corporations. The Engineering Economist, 20, 159–72.
45.
PikeR.H. (1982). Capital Budgeting in the 1980s: A Major Survey of the Investment Practices in Large Companies (Institute of Chartered Management Accountants, London).
46.
PikeR.H. (1988). An empirical study of the adoption of sophisticated capital budgeting practices and decision making effectiveness. Accounting and Business Research, 18, 341–51.
47.
PollardC.E., and HayneS.C. (1996). A comparative analysis of information systems issues facing Canadian business, in Proceedings of the 29th Annual Hawaii International Conference on System Sciences, (January) Vol 2, Information Systems-Decision Support and Knowledge-Based Systems, NunamakerJ.F., and SpragueR.H. (eds), pp. 68–77.
48.
Price Waterhouse (1994). Information Technology Review 1993/94 (London).
49.
Price Waterhouse (1995). Information Technology Review 1994/95 (London).
50.
RemenyiD.S.J., MoneyA., and TwiteA. (1993). A Guide to Measuring and Managing IT Benefits. 2nd Edition (Blackwell, Manchester).
51.
SangsterA. (1993). Capital investment appraisal techniques: a survey of current usage. Journal of Business Finance and Accounting, 20, 307–32.
52.
ScapensR.W., and SaleJ.R. (1981). Performance measurement and formal capital expenditure controls in divisionalised companies. Journal of Business Finance and Accounting, 8, 389–419.
53.
SchallL., SundenG., and GeijsbeekW. (1978). Survey and analysis of capital budgeting methods. Journal of Finance, 33, 281–92.
54.
SundemG.L., and GeijsbeekW.R. (1978). Survey and analysis of capital budgeting methods. Journal of Finance, 33, 281–7.
55.
TarnK.Y. (1992). Capital budgeting in information systems development. Information and Management, 23, 345–57.
56.
WangP., and TurbanE. (1994). Management information systems issues of the 1990s in the Republic of China: an industry analysis. International Journal of Information Management, 14, 25–38.
57.
WardJ., TaylorP., and BondP. (1995). Identification, realisation and measurement of IS/IT benefits: an empirical study of current practice, in The Second European Conference on Information Technology Investment Evaluation Conference Proceedings, BrownA., and ReminiD. (eds) (Operational Research Society) (11–12 July), 133–45.
58.
WeillP., and OlsonM. (1989). Managing investment in IT. MIS Quarterly, 13, 3–17.
59.
WillcocksL. (1992). Evaluating information technology investments: research findings and reappraisal. Journal of Information Systems, 2, 243–68.
60.
WillcocksL., and LesterS. (1991). Information systems investments: evaluation at the feasibility stage of projects, Technovation, 11, 283–302.
61.
WillcocksL., and LesterS. (1993). How do organisations evaluate and control information systems investments? Recent UK survey Evidence. Journal of Information Systems, 2, 5–39.
62.
WilnerN., KochB., and KlammerT. (1992). Justification of high technology capital investment – an empirical study. The Engineering Economist, 37, 341–53.
63.
ZuboffI. (1988). The Age of the Smart Machine (Heinemann, Oxford).
