Designing New York City Subways’ Key Performance Indicators to Improve Service Delivery and Operations

Abstract

A balanced scorecard (BSC) is widely used in private industry and the public sector to monitor key performance indicators (KPIs) and to help achieve strategic outcomes. This concept is widely used in the transit industry for carrier–regulator contractual relationships and performance monitoring. After a fact-finding mission to Southeast Asia, New York City Transit (NYCT) adopted KPIs for continuous improvement of service delivery performance. Subway line-level KPIs based on BSC concepts were introduced in conjunction with a line general manager program and numerous initiatives for incremental performance management. After a reorganization that re-created functional departments—car equipment, stations, and rapid transit operations—BSC was applied at departmental levels and resulted in maintenance-oriented passenger environment survey (PES)-KPIs and operations-oriented service (S)-KPIs. Weightings of indicator sub components were assigned as a result of surveys of customer priorities. KPIs provided one number that represented overall performance, and they also made it possible to identify each subcomponent's contribution. The KPI design processes generated public feedback; this feedback prompted NYCT to tighten underlying performance standards. Today, PES-KPIs and S-KPIs are reported monthly to the Metropolitan Transportation Authority Board's NYCT Committee. Advantages of these indicators include high-level visibility and ease of communication, timely report availability, and detailed diagnostics. These factors, together with a reinvigorated competitive spirit between divisions triggered by reorganizations, resulted in a much more proactive organization focused on using performance scores to take corrective action. Wait assessment, the principal component of the S-KPI, improved 2.5% on the heavily crowded 1 through 6 lines in 2012 compared with 2011, even as ridership increased steadily systemwide.

Get full access to this article

View all access options for this article.

References

Transit Record, Vol. I. New York City Board of Transportation, New York, 1921.

Newhouser

R. J.

An Assessment of Performance Measures. Metropolitan Transportation Authority, New York, 2003.

Straphangers Campaign. State of Subway Report Card. New York Public Interest Research Group, 1999. http://www.straphangers.org/statesubs99/statesubs99.html. Accessed March 7, 2014.

Straphangers Campaign. How We Developed Our Profiles and Metro Card Ratings. http://www.straphangers.org/statesub12/BigMeth_Web.pdf. Accessed March 7, 2014.

Millennium Cities Database for Sustainable Mobility (CD-ROM), L'Union Internationale des Transports Publics, Brussels, Belgium, 2001.

Anderson

Improving the Management and Delivery of Mass Public Transportation in Cities. Presented at Nova Symposium, Buenos Aires, Brazil, 2006. http://www3.imperial.ac.uk/pls/portallive/docs/1/8595698.PDF. Accessed March 7, 2014.

London Underground. TfL Rail and Underground Annual Benchmarking Report. http://www.tfl.gov.uk/assets/downloads/tfl-rail-and-underground-benchmarking-report-2012.pdf. Accessed March 7, 2014.

Harrington-Hughes and Associates. TCRP Research Results Digest 95: Performance Measurement and Outcomes. Transportation Research Board of the National Academies, Washington, D.C., 2010.

Reddy

A. V.

, Lu

, and Wang

Subway Productivity, Profitability, and Performance: A Tale of Five Cities. In Transportation Research Record: Journal of the Transportation Research Board, No. 2143, Transportation Research Board of the National Academies, Washington, D.C., 2010, pp. 48–58.

10.

London Underground. Performance Report. http://www.tfl.gov.uk/corporate/modesoftransport/londonunderground/1592.aspx. Accessed March 7, 2014.

11.

Mayor of London. London Underground Performance Reports. http://data.london.gov.uk/datastore/package/london-underground-performance-reports. Accessed March 7, 2014.

12.

Chicago Transit Authority. Performance Metrics, March 2013. http://www.transitchicago.com/assets/1/performance_metrics/Performance_Metrics_Mar_2013.pdf. Accessed March 7, 2014.

13.

Gallucci

, and Allen

J. G.

Regional Transit Performance Measures at Chicago's Regional Transportation Authority. Presented at 90th Annual Meeting of the Transportation Research Board, Washington, D.C., 2011.

14.

Scovel

C. L.

III Inspector General's Report on Amtrak's Actual and Forecast Financial Performance. http://www.oig.dot.gov/sites/dot/files/Amtrak_Semiannual_5-17-10.pdf. Accessed March 7, 2014.

15.

National Rail Passenger Corporation. Amtrak Monthly Performance Report, March 2013. http://www.amtrak.com/ccurl/1009/146/Amtrak-Monthly-Performance-Report-March-2013.pdf. Accessed March 7, 2014.

16.

Schneiderman

A. M.

Analog Devices: 1986–1992, The First Balanced Scorecard. Boxford, Mass., 1999. http://www.schneiderman.com/Concepts/The_First_Balanced_Scorecard/BSC_INTRO_AND_CONTENTS.htm. Accessed March 7, 2014.

17.

Kaplan

R. S.

, and Norton

D. P.

The Balanced Scorecard: Translating Strategy into Action. Harvard Business School Press, Boston, Mass., 1996.

18.

Rohm

Using the Balanced Scorecard to Align Your Organization. Balanced Scorecard Institute, Cary, N.C., 2008.

19.

Liberatore

M. J.

, and Miller

T. C.

A Framework for Integrating Activity-Based Costing and the Balanced Scorecard into the Logistics Strategy Development and Monitoring Process. Journal of Business Logistics, Vol. 19, No. 2, 1998, pp. 131–154.

20.

Walker

, and Aft

Linking Strategic and Operational Performance Using the Balanced Scorecard. Proc., 1999 APTA Bus Conference, Cleveland, Ohio, May 2–6, 1999, pp. 34–43.

21.

Phillips

J. K.

An Application of the Balanced Scorecard to Public Transit System Performance Assessment. Transportation Journal, Vol. 43, No. 1, 2004, pp. 26–55.

22.

Poli

P. M.

, and Scheraga

C. A.

A Balanced Scorecard Framework for Assessing LTL Motor Carrier Quality Performance. Journal of the Transportation Research Forum, Vol. 57, No. 3, 2003, pp. 105–130.

23.

Brewer

P. C.

, and Speh

T. W.

Using the Balanced Scorecard to Measure Supply Chain Performance. Journal of Business Logistics, Vol. 21, No. 1, 2000, pp. 75–93.

24.

Ray

Four Leadership Principles to Help Transportation Professionals. In Transportation Research Circular E-C098: Maintenance Management 2006, Transportation Research Board of the National Academies, Washington, D.C., 2006, pp. 154–167.

25.

Pei

Y. L.

, Amekudzi

A. A.

, Meyer

M. D.

, Barrella

E. M.

, and Ross

C. L.

Performance Measurement Frameworks and Development of Effective Sustainable Transport Strategies and Indicators. In Transportation Research Record: Journal of the Transportation Research Board, No. 2163, Transportation Research Board of the National Academies, Washington, D.C., 2010, pp. 73–80.

26.

Donohue

NYC Transit Reports That Most Subway Cars Are Well Air-Conditioned. New York Daily News, August 3, 2008. http://www.nydailynews.com/new-york/nyc-transit-reports-subway-cars-air-conditioned-article-1.312604. Accessed March 7, 2014.

27.

, Aievoli

, Ackroyd

, Carlin

H. C.

, and Reddy

Passenger Environment Survey: Representing the Customer Perspective in Quality Control. In Transportation Research Record: Journal of the Transportation Research Board, No. 2112, Transportation Research Board of the National Academies, Washington, D.C., 2009, pp. 93–103.

28.

Stagl

New York City Transit's Road to Reorganization. Progressive Railroading, March 2008. http://www.progressiverailroading.com/passenger_rail/article/New-York-City-Transits-Road-to-Reorganization-15342. Accessed March 7, 2014.

29.

New York Public Authorities Law, Article V, Title 11, Section 1269(d)—Submission of Strategic Operation Plan. http://www.lawserver.com/law/state/new-york/ny-laws/ny_public_authorities_law_1269-d. Accessed March 7, 2014.

30.

Metropolitan Transportation Authority. PERS Operating Performance Dashboard. http://www.mta.info/persdashboard/performance14.html. Accessed March 7, 2014.

31.

New York City Transit. MTA NYC Transit Names Line General Managers for 7 and L. Press release. Dec. 6, 2007. http://new.mta.info/mta-nyc-transit-names-line-general-managers-7-and-l. Accessed March 7, 2014.

32.

Orlando

Subways’ Line General Manager Program on Track. At Your Service, New York City Transit Employee Newsletter, Dec. 2008–Jan. 2009.

33.

Washington Metropolitan Area Transit Authority. Transit Ridership Trends and Markets, March 2009. http://www.wmata.com/pdfs/planning/FINAL%20Transit%20Ridership%20and%20Market%20Trends%20Report.pdf. Accessed March 7, 2014.

34.

New York City Transit. MTA NYC Transit Names Group and Line General Managers for All Subway Lines. Press release. Aug. 7, 2009. http://new.mta.info/mta-nyc-transit-names-group-and-line-general-managers-all-subway-lines. Accessed March 7, 2014.

35.

Joy

Public and Private Railways. Journal of Transport Economics and Policy, Vol. 32, No. 1, 1997, pp. 27–49.

36.

Allen

J. G.

, and Lu

Organizational Regimes for Commuter Rail: Improving Train Service Worldwide. In Transportation Research Record: Journal of the Transportation Research Board, No. 2146, Transportation Research Board of the National Academies, Washington, D.C., 2010, pp. 100–108.

37.

New York City Transit. MTA NYC Transit Introduces First Group of Subway Line Managers. Press release. Oct. 27, 2008. http://new.mta.info/mta-nyc-transit-introduces-first-group-subway-line-managers. Accessed March 7, 2014.

38.

Orlando

Expanded Line General Managers Program Aims for Line-by-Line Teamwork Across Subway System. At Your Service, New York City Transit Employee Newsletter, Aug.–Sept. 2009.

39.

Sander

E. G.

, and Roberts

H. H.

Letters to NYC Transit Subway Riders on the 2nd Rider Report Card. http://enterprise.mtanyct.info/survey/english/letters_new.asp. Accessed March 7, 2014.

40.

New York City Transit. Rider Report Card Goes Express Again! Riders to Grade NYC Transit & MTA Bus Express Service City Wide. Press release. Aug. 11, 2009. http://new.mta.info/rider-report-card-goes-express-again-riders-grade-nyc-transit-mta-bus-express-service-city-wide. Accessed March 7, 2014.

41.

Cramer

, Cucarese

, Tran

, Lu

, and Reddy

A. V.

Performance Measurements on Mass Transit: Case Study of New York City Transit Authority. In Transportation Research Record: Journal of the Transportation Research Board, No. 2111, Transportation Research Board of the National Academies, Washington, D.C., 2009, pp. 125–138.

42.

Savas

E. S.

Slow Train to Better Service. New York Times, Op-Ed, Dec. 16, 2007. http://www.nytimes.com/2007/12/16/opinion/nyregionopinions/16CIsavas.html. Accessed March 7, 2014.

43.

Kabak

In Subway Shake-up, Line Managers Lose Some Oversight. http://secondavenuesagas.com/2010/02/26/in-subway-shake-up-line-managers-lose-some-oversight/. Accessed March 7, 2014.

44.

Donohue

NYC Transit President Howard Roberts Resigns in Wake of Jay Walder's Elevation to MTA Chair. New York Daily News, Nov. 4, 2009. http://www.nydailynews.com/new-york/nyc-transit-president-howard-roberts-resigns-wake-jay-walder-elevation-mta-chair-article-1.413476. Accessed March 7, 2014.

45.

New York City Transit. MTA New York City Transit Restructures Department of Subways. Press release. Feb. 26, 2010. http://new.mta.info/mta-new-york-city-transit-restructures-department-subways. Accessed March 7, 2014.

46.

Permanent Citizens’ Advisory Council. Minutes Matter: A Review of Performance Metrics at MTA, Jan. 2011. http://www.pcac.org/wp-content/uploads/2011/01/minutes-matter-12711.pdf. Accessed March 7, 2014.

47.

Massachusetts Bay Commuter Railroad. Track Record: Performance Report Card. http://www.mbcr.net/Report_Card/TrackRecord_North_Apr13.pdf. Accessed July 30, 2013.

48.

Bureau of Transportation Statistics. Airline On-Time Performance and Causes of Flight Delays. https://www.rita.dot.gov/bts/help_with_data/aviation/index.html. Accessed March 7, 2014.

49.

U.S. Department of Transportation. Reporting the Causes of Airline Delays and Cancellations, Docket No. OST 2000-8164, Final rule. Federal Register, Vol. 67, No. 227 (Nov. 25, 2002), pp. 70535–70545.

50.

Office of Rail Regulation, U.S. Department of Transportation. Rail Performance—Public Performance Measure Up to and Including 2010-11 Q3. http://webarchive.nationalarchives.gov.uk/20110601212617/rail-reg.gov.uk/upload/pdf/nrt-ch2-railperformance.pdf. Accessed March 7, 2014.

51.

New York City Transit Authority. Recommended Modifications to Train Performance Indicators. Presented to MTA Board's NYC Transit Committee, May 2010. http://mta.info/mta/news/books/docs/train%20performance%20presentation%205-24-10%20(CAB1173).pdf. Accessed Nov. 25, 2010.

52.

Levine

, Lu

, and Reddy

A. V.

Measurement of Subway Service Performance at New York City Transit: Case Study with Automated Train Supervision Track-Occupancy Data. In Transportation Research Record: Journal of the Transportation Research Board, No. 2353, Transportation Research Board of the National Academies, Washington, D.C., 2013, pp 57–68.

53.

Trompet

, Liu

, and Graham

D. J.

Development of Key Performance Indicator to Compare Regularity of Service Between Urban Bus Operators. In Transportation Research Record: Journal of the Transportation Research Board, No. 2216, Transportation Research Board of the National Academies, Washington, D.C., 2011, pp. 33–41.

54.

Frumin

, and Zhao

Analyzing Passenger Incidence Behavior in Heterogeneous Transit Services Using Smartcard Data and Schedule-Based Assignment. In Transportation Research Record: Journal of the Transportation Board, No. 2274, Transportation Research Board of the National Academies, Washington, D.C., 2012, pp. 52–60.

55.

Reddy

, Lu

, Kumar

, Bashmakov

, and Rudenko

Entry-Only Automated Fare-Collection System Data Used to Infer Ridership, Rider Destinations, Unlinked Trips, and Passenger Miles. In Transportation Research Record: Journal of the Transportation Research Board, No. 2110, Transportation Research Board of the National Academies, Washington, D.C., 2009, pp. 128–136.

56.

Rhindress

Design Considerations for the Customer Priorities Study. Abt SRBI, New York, 2010.

57.

Rhindress

, Hsieh

, and Dutchman

2010 Customer Priorities Survey Final Quadrant Chart Results. Abt SRBI, New York, 2010.

58.

Rhindress

, and Hsieh

2010 Customer Priorities Technical Memorandum. Abt SRBI, New York, 2010.

59.

New York City Transit Authority. Transit Committee Meeting Agenda, Sept. 2010. http://www.mta.info/mta/news/books/. Accessed March 7, 2014.

60.

Beekman

MTA Plans to Fix Bronx Subway Stations, the City's Worst-Kept Lines. New York Daily News, July 27, 2011. http://www.nydailynews.com/new-york/bronx/mta-plans-fix-bronx-subway-stations-city-worst-kept-lines-article-1.159350. Accessed March 7, 2014.