An Analysis of Java Programming Behaviors,Affect,Perceptions,and Syntax Errors among Low-Achieving,Average,and High-Achieving Novice Programmers

Abstract

In this article we quantitatively and qualitatively analyze a sample of novice programmer compilation log data, exploring whether (or how) low-achieving, average, and high-achieving students vary in their grasp of these introductory concepts. High-achieving students self-reported having the easiest time learning the introductory programming topics. In a quantitative analysis, though, high-achieving and average students were: 1) more effective at debugging (on average, as quantified by Jadud's Error Quotient (EQ)) than low-achieving students; and 2) were least confused, as quantified using Lee's confusion metric. However, the differences in EQ and confusion between groups were not statistically significant. This implied that all groups struggled with programming to similar extents. This finding was further supported by was used to delineate two sets of variables. The results indicate that preference for autonomy in computer science learning positively predicts selfefficacy in learning computer science with the strongest coefficient. Computer science learner preference for teacher control is also a positive predictor. However, preference for participation in managing the computer class and preference for depending on the teacher did not play a significant role in the students' self-efficacy in learning computer science.

Get full access to this article

View all access options for this article.

References

Ahmadzadeh

Elliman

Higgins

(2005). An analysis of patterns of debugging among novice computer science students. Proceedings of the 10th annual SIGCSE conference on Innovation and Technology in Computer Science Education – ITiCSE '05 (pp. 84–88). New York, NY: ACM Press. doi: 10.1145/1067445.1067472

Bonar

Khrlich

Soloway

Rubin

(1982). Collecting and analyzing on-line protocols from novice programmers. Behavior Research Methods & Instrumentation, 14(2), 203–209.

Bonar

Soloway

(1983). Uncovering principles of novice programming. Proceedings of the 10th ACM SIGACT-SIGPLAN Syposium on Principles of Programming Languages – POPL '83 (pp. 10–13). New York, NY: ACM Press. doi: 10.1145/567067.567069

Dann

Cooper

Pausch

(2008). Learning to program with Alice (2nd. ed.). Upper Saddle River, NJ: Pearson Education Inc.

Decker

Anderson

(1989). From reactive to proactive: A continuum. Journal of Extension, 27(3). Retrieved from http://www.joe.org/joe/1989fall/f1.php

de Leon

Espejo-Lahoz

M. B.

Rodrigo

M. M.

(2008). An analysis of novice programmer doodles and student achievement in an introductory programming class. Philippine Information Technology Journal, 1(2), 17–21.

Denny

Luxton-Reilly

Tempero

(2012). All syntax errors are not equal. Proceedings of the 17th ACM Annual Conference on Innovation and Technology in Computer Science Education – ITiCSE '12 (p. 75). New York, NY: ACM Press. doi: 10.1145/2325296.2325318

D'Mello

Graesser

(2012). Dynamics of affective states during complex learning. Learning and Instruction, 22(2), 145–157. Elsevier Ltd. doi: 10.1016/j.learninstruc.2011.10.001

Rodrigo

M. M.

(2010). A detector for non-literal Java errors. Proceedings of the 10th Koli Calling International Conference on Computing Education Research – Koli Calling '10 (pp. 118–122). New York, NY: ACM Press. doi: 10.1145/1930464.1930485.

10.

Freund

S. N.

Roberts

E. S.

(1996, February). Thetis: An ANSI C programming environment designed for introductory use. Proceedings of the trail verison of the twenty-seventh SIGCSE technical symposium on computer science education (pp. 300–304), February 15–17, 1996, Philadelphia, Pennsylvania.

11.

Goldenson

D. R.

(1989). The impact of structure editing on introductory computer science education: The results so far. SIGCSE Bulletin, 21(3), 26–29.

12.

Hartmann

Macdougall

Brandt

Klemmer

S. R.

(2010). What would other programmers do: Suggesting solutions to error messages. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems – CHI '10 (pp. 1019–1028). New York, NY: ACM Press. doi: 10.1145/1753326. 1753478

13.

Hughes

M. C.

Jadud

M. C.

Rodrigo

M. M. T.

(2010). String formatting considered harmful for novice programmers. Computer Science Education, 20(3), 201–228. doi: 10.1080/08993408.2010.507335

14.

Hundhausen

C. D.

Brown

J. L.

Farley

Skarpas

(2006). A methodology for analyzing the temporal evolution of novice programs based on semantic components. Proceedings of the 2006 International Workshop on Computing Education Research – ICER '06 (p. 59). New York, NY: ACM Press. doi: 10.1145/1151588. 1151599

15.

Interim Review Task Force, Association for Computing Machinery, & IEEE Computing Society. (2008). Computer Science curriculum 2008: An interim revision of CS 2001. Retrieved from http://www.acm.org./education/curricula/ComputerScience2008.pdf

16.

Jackson

Cobb

Carver

(2005). Identifying top Java errors for novice programmers. Frontiers in Education 35th Annual Conference – FIE '05 (pp. T4C-24–T4C-27). doi: 10.1109/FIE.2005.1611967

17.

Jadud

(2006). An exploration of novice compilation behaviour in BlueJ. Doctoral dissertation. Retrieved from Kent Academic Repository.

18.

Joint Task Force on Computing Curricula, IEEE Computer Society, & ACM. (2001). Computing curricula 2001. Retrieved from http://www.acm.org/education/curric_vols/cc2001.pdf

19.

Kolling

Rosenberg

(1996). Blue—A language for teaching object-oriented programming. In Klee

K. J.

(Ed.), Proceedings of the Twenty-Seventh SIGCSE Technical Symposium on Computer Science Education (SIGCSE '96). New York, NY: ACM Press (pp. 190–194). doi: 10.1145/236452.236537. Available at http://doi.acm.org/10.1145/236452.236537

20.

Kummerfeld

S. K.

Kay

(2003, January). The neglected battle fields of syntax errors. In Proceedings of the fifth Australasian conference on computing education (Vol. 20; pp. 105–111). Australian Computer Society, Inc.

21.

Lane

H. C.

VanLehn

(2005). Intention-based scoring: An approach to measuring success at solving the composition problem. Proceedings of the 36th SIGCSE Technical Symposium on Computer Science Education – SIGCSE '05 (pp. 373–377). doi: 10.1145/1047124.1047471

22.

Lang

(1986). On the usefulness of syntax directed editors. In Conradi

Didricksen

T. M.

Wanvik

D. H.

(Eds.), Advanced programming environments: Proceedings of an international workshop (pp. 47–51). London, UK: Springer-Verlag. doi: 10.1007/3-540-17189-4_87

23.

Lee

(2011). Detecting confusion among novice programmers using BlueJ compile logs. Unpublished master's thesis. Ateneo de Manila University, Quezon City, Philippines.

24.

Lee

D. M.

Rodrigo

M. M. T. R.

Baker

R. S. J. D.

Sugay

J. O.

Coronel

(2011). Exploring the relationship between novice programmer confusion and achievement. In D'Mello

Graesser

(Eds.), ACII 2011, Part 1. LNCS 6974 (pp. 175–184). Berlin Heidelberg, Germany: Springer-Verlag.

25.

Lewandowski

(2003). Using process journals to gain qualitative understanding of beginning programmers. Journal of Computing Sciences in Colleges, 19(1), 299–310.

26.

Lewandowski

Gutschow

McCartney

Sanders

Shinners-Kennedy

(2005). What novice programmers don't know. Proceedings of the 2005 International Workshop on Computing Education Research – ICER '05 (pp. 1–12). New York, NY: ACM Press. doi: 10.1145/1089786.1089787

27.

Lister

Adams

E. S.

Fitzgerald

Fone

Hamer

Lindholm

(2004). A multi-national study of reading and tracing skills in novice programmers. ACM SIGCSE Bulletin, 36(4), 119–150. New York, NY: ACM Press. doi: 10.1145/1041624. 1041673

28.

Lynch

W. C.

(1967). Description of a high capacity fast turnaround university computing center. Proceedings of the 1967 22nd National Conference – ACM '67 (pp. 273–288). New York, NY: ACM Press. doi: 10.1145/800196.805997

29.

Maloney

Resnick

Rusk

Silverman

Eastmond

(2010). The Scratch programming language and environment. ACM Transactions on Computing Education, 10(4). New York, NY: ACM Press. doi: 10.1145/1868358.1868363

30.

Marceau

Fisler

Krishnamurthi

(2011). Measuring the effectiveness of error messages designed for novice programmers. Proceedings of the 42nd ACM Technical Symposium on Computer Science Education – SIGCSE '11 (pp. 499–504). New York, NY: ACM Press. doi: 10.1145/1953163.1953308

31.

Matthews

(2011). Assessing organizational effectiveness: The role of performance measures. The Library Quarterly, 81(1), 83–110. Chicago, IL: The University of Chicago Press. doi: 10.1086/657447

32.

McCartney

Moström

J. E.

Sanders

Seppälä

(2005). Take note: The effectiveness of novice programmers' annotations on examinations. Informatics in Education, 4(1), 69–86. Vilinus, Lithuania: Institute of Mathematics and Informatics.

33.

McCracken

Almstrum

Diaz

Guzdial

Hagan

Kolikant

(2001). A multi-national, multi-institutional study of assessment of programming skills of first-year CS students. ACM SIGCSE Bulletin, 33(4), 125–180. New York, NY: ACM Press. doi: 10.1145/572139.572181

34.

McDowell

Werner

Bullock

Fernald

(2006). Pair programming improves student retention, confidence, and program quality. Communications of the ACM, 49(8), 90–95. doi: 10.1145/1145287.1145293

35.

Miller

Pane

Meter

Vorthmann

(1994). Evolution of novice programming environments: The structure editors of Carnegie Mellon University. Interactive Learning Environments, 4(2), 140–158.

36.

Murphy

Kaiser

Loveland

Hasan

(2009). Retina: Helping students and instructors based on observed programming activities. Proceedings of the 40th ACM Technical Symposium on Computer Science Education – SIGCSE '09 (pp. 178–192). New York, NY: ACM Press. doi: 10.1145/1508865.1508929

37.

Perkins

D. N.

Hancock

Hobbs

Martin

Simmons

(1986). Conditions of learning in novice programmers. Journal of Educational Computing Research, 2(1), 37–55. Amityville, NY: Baywood. doi: 10.2190/GUJT-JCBJ-Q6QU-Q9PL

38.

PLT. (n.d.). DivaScheme. Brown Computer Science. Retrieved from http://cs.brown.edu/research/plt/software/divascheme.

39.

Porter

Lee

C. B.

Simon

(2013). Halving fail rates using peer instruction: A study of four computer science courses. In Proceeding of the 44th ACM Technical Symposium on Computer Science Education (SIGCSE '13) (pp. 177–182). New York, NY: ACM Press. doi: 10.1145/2445196.2445250. Available at http://doi.acm.org/10.1145/2445196.2445250

40.

Rodrigo

M. M.

Tabanao

Lahoz

M. B.

Jadud

(2009). Analyzing online protocols to characterize novice Java programmers. Philippine Journal of Science, 138(2), 177–190.

41.

Romero

Ventura

Pechenizkiy

Baker

R. S. J. D.

(2011). Handbook of educational data mining. Boca Raton, FL: Taylor & Francis Group.

42.

Simon

Parris

Spacco

(2013). How we teach impacts student learning: Peer instruction vs. lecture in CS0. In Proceeding of the 44th ACM Technical Symposium on Computer Science Education (SIGCSE '13) (pp. 41–46). New York, NY: ACM Press. doi: 10.1145/2445196.2445215. Available at http://doi.acm.org/10.1145/2445196.2445215

43.

Sison

Chen

J. J.

(2005). Intention-based diagnosis of novice C programmer errors in a web-based tutoring system. Journal Research in Science, Computing and Engineering, 2(1), 34–41.

44.

Stanford HCI Group. (n.d.). Opportunistic programming: Helping people prototype, ideate, and discover by building software. Stanford HCI Group. Retrieved from http://hci.stanford.edu/research/opportunistic/

45.

Thomasson

Ratcliffe

Thomas

(2006). Identifying novice difficulties in object oriented design. Proceedings of the 11th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education – ITICSE '06 (pp. 28–32). New York, NY: ACM Press. doi: 10.1145/1140123.1140135

46.

Traver

V. J.

(2010). On compiler error messages: What they say and what they mean. Advances in Human-Computer Interaction, 2010, 1–26. doi: 10.1155/2010/602570

47.

Truong

Roe

Bancroft

(2004). Static analysis of students' Java programs. Proceedings of the Sixth Australasian Conference on Computing Education – ACE '04 (pp. 30, 317–325). Darlinghurst, Australia: Australian Computer Society, Inc.

48.

Vee

M. N. C.

Meyer

Mannock

K. L.

(2006). Understanding novice errors and error paths in object-oriented programming through log analysis. Proceedings of the Workshop on Educational Data Mining at the 8th International Conference on Intelligent Tutoring Systems – ITS 2006 (pp. 13–20). New York, NY: ACM Press.

49.

Victor

(2012). Learnable programming: Designing a programming system for understanding programs. Bret Victor. Retrieved from http://worrydream.com/#!/LearnableProgramming

50.

Williams

Kessler

(2000). All I really need to know about pair programming I learned in kindergarten. Communications of the ACM, 43(5), 108–114. New York, NY: ACM Press. doi: 10.1145/332833.332848

51.

Worsley

Blikstein

(2013). Programming pathways: A technique for analyzing novice programmers' learning trajectories. In Yacef

(Eds.), AIED 2013, LNAI 7926 (pp. 844–847). Berlin, Germany: Springer-Verlag.