Technological Implications for Assessment Ecosystems: Opportunities for Digital Technology to Advance Assessment

Almond R. G. , DiBello L. V. , Moulder B. , & Zapata-Rivera J. (2007). Modeling diagnostic assessment with Bayesian networks. Journal of Educational Measurement, 44(4), 341–359.

Bagley E. , & Shaffer D. W. (2010). Stop talking and type: Mentoring in a virtual and face-to-face environment. International Journal of Computer-Supported Collaborative Learning. Retrieved from http://edgaps.org/gaps/

Barab S. A. , Dodge T. , Thomas M. K. , Jackson C. , & Tuzun H. (2007). Our designs and the social agendas they carry. The Journal of the Learning Sciences, 16, 263–305.

Barab S. A. , Gresalf M. , Ingram-Goble A. , Jameson E. , Hickey D. , Akram S. , & Kizer S. (2009). Transformational play and virtual worlds: Worked examples from the Quest Atlantis project. International Journal of Learning and Media, 1(2). Retrieved from http://ijlm.net/knowinganddoing/10.1162/ijlm.2009.0023

Bartle R. (2005). Virtual worlds: Why people play. In Alexander T. (Ed.), Massively multiplayer game development 2. Hingham, MA: Charles River Media.

Behrens J. T. , Frezzo D. C. , Mislevy R. J. , Kroopnick M. , & Wise D. (2008). Structural, functional, and semiotic symmetries in simulation-based games and assessments. In Baker E. , Dickieson J. , Wulfeck W. , & O'Neil H. F. (Eds.), Assessment of problem solving using simulations (pp. 59–80). New York: Earlbaum.

Behrens J. T. , Mislevy R. J. , Bauer M. , Williamson D. M. , & Levy R. (2004). Introduction to evidence centered design and lessons learned from its application in a global e-learning program. The International Journal of Testing, 4, 295–301.

Behrens J. T. , Mislevy R. J. , DiCerbo K. E. , & Levy R. (2012). Evidence centered design for learning and assessment in the digital world. In Mayrath M. , Clarke-Midura J. , & Robinson D. H. (Eds.). Technology-based assessments for 21st century skills: Theoretical and practical implications from modern research (pp. 13–54). Charlotte, NC: Information Age Publishing.

Brooks S. , Gelman A. , Jones G. , & Meng X. L. (2011). (Eds.). Handbook of Markov chain Monte Carlo methods. Boca Raton, FL: Chapman.

Chin J. , Dukes R. , & Gamson W. (2009). Assessment in simulation and gaming: A review of the last 40 years. Simulation & Gaming, 40, 553–568.

Csikszentmihalyi M. (1990). Flow: The psychology of optimal experience. New York: Harper and Row.

Dede C. , Nelson B. , Ketelhut D. J. , Clarke J. , & Bowman C. (2004). Design-based research strategies for studying situated learning in a multi-user virtual environment. ICLS Proceedings of the 6th international conference on learning sciences (pp. 158–165). Bloomington, IN: International Society of the Learning Sciences.

DiCerbo K. E. & Behrens J. T. (2012). Implications of the digital ocean on current and future assessment. In Lissitz R. & Jiao H. (Eds.) Computers and their impact on state assessment: Recent history and predictions for the future (pp. 273–306). Charlotte, NC: Information Age Publishing.

Dikli S. (2006). An overview of automated scoring of essays. Journal of Technology, Learning, and Assessment, 5(1). Retrieved from http://ejournals.bc.edu/ojs/index.php/jtla/article/view/1640

Engeström Y. (1987). Learning by expanding: An activity theoretical approach to developmental research. Helsinki: OrientaKonsultit.

Freire P. (1993). Pedagogy of the oppressed. New York: Bloomsbury.

Frezzo D. C. (2009). Using activity theory to understand the role of a simulation-based interactive learning environment in a computer networking course (Doctoral dissertation). Available from ACM Digital Library http://dl.acm.org/citation.cfm?id=1751494

Frezzo D. C. , Behrens J. T. , & Mislevy R. J. (2010). Design patterns for learning and assessment: Facilitating the introduction of a complex simulation-based learning environment into a community of instructors. The Journal of Science Education and Technology, 19(2), 105–114. Retrieved from http://www.springerlink.com/content/566p6g4307405346/

Frezzo D. C. , Behrens J. T. , Mislevy R. J. , West P. , & DiCerbo K. E. (2009). Psychometric and evidentiary approaches to simulation assessment in Packet Tracer Software. Paper presented at the International Conference on Networking and Services, Valencia, Spain.

Gee J. P. (2003). What video games have to teach us about learning and literacy. New York: Palgrave/Macmillan.

Hunt E. , & Pellegrino J. W. (2002). Issues, examples, and challenges in formative assessment. New Directions for Teaching and Learning, 89, 73–86.

Jensen F. V. (1996). An introduction to Bayesian networks. New York: Springer-verlag.

Kent W. J. , Sugnet C. W. , Furey T. S. , Roskin K. M. , Pringle T. H. , Zahler A. M. , & Haussler D. (2002). The human genome browser at UCSC. Genome Research, 12, 996–1006.

Ketelhut D. J. , Dede C. , Clarke J. , Nelson B. , & Bowman C. (2007). Studying situated learning in a multi-user virtual environment. In Baker E. , Dickieson J. , Wulfeck W. , & O'Neil H. (Eds.), Assessment of problem solving using simulations. Mahwah, NJ: Lawrence Erlbaum Associates.

Khatib F. , Cooper S. , Tyka M. D. , Xu K. , Makedon I. , Popovic Z. , Baker D. , & Players . (2011). Algorithm discovery by protein folding game players. Proceedings of the National Academy of Sciences, 108, 18949–18953.

Kounin J. (1970). Discipline and group management in classrooms. New York: Holt, Rinehart, & Winston.

Krathwohl D. (2009). Methods of educational & social science research: An integrated approach (3rd ed.). Long Grove, IL: Waveland Press.

Kuhn T. S. (1962). The structure of scientific revolutions (1st ed.). Chicago: University of Chicago Press.

Lenhart A. , Kahne J. , Middaugh E. , Macgill A. , Evans C. , & Vitak J. (2008). Teens, video games, and civics. Washington, DC: Pew. Retrieved from: http://www.pewinternet.org/Reports/2008/Teens-video-Games-and-Civics.aspx

Lepper M. R. , & Malone T. W. (1987). Intrinsic motivation and instructional effectiveness in computer-based education. In Snow R. E. & Farr M. J. (Eds.), Aptitude, learning, and instruction. Volume 3: Cognitive and affective process analysis. Hillsdale, NJ: Erlbaum.

Levy R. , & Mislevy R. J (2004). Specifying and refining a measurement model for a computer-based interactive assessment. International Journal of Testing, 4, 333–369.

Margolis M. J. , & Clauser B. E. (2006). A regression-based procedure for automated scoring of a complex medical performance assessment. In. Williamson D.W. , Bejar I. I. , & Mislevy R. J. (Eds.), Automated scoring of complex tasks in computer-based testing (pp. 123–168). Mahwah, NJ: Lawrence Erlbaum.

Mislevy R. J. (1994). Evidence and inference in educational assessment. Psychometrika, 59, 439–483.

Mislevy R. J. , Behrens J. T. , DiCerbo K. E. , & Levy R. (in press). Data mining versus psychometrics in educational assessment: An evidence centered design approach. Journal of Educational Data Mining, 4(1), 11–48.

Mislevy R. J. , Steinberg L. S. , & Almond R. G. (2002). Design and analysis in task-based language assessment. Language Testing, 19(4), 477–496. doi:10.1191/0265532202lt241oa

Mislevy R. J. , Steinberg L. S. , & Almond R. G. (2003). On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1, 3–62.

Noddings N. (2001). Care and coercion in school reform. Journal of Educational Change, 2, 35–43.

Olsen S. (2000). Web browser offers incognito surfing. CNET News. Retrieved from http://news.cnet.com/2100-1017-247263.html

Peacock Al , Ke X. , & Wilkerson M. (2004). Typing patterns: A key to user identification. Security and Privacy, IEEE, 2, 40–47.

Pearl J. 1998. Probabilistic reasoning in intelligent systems: Networks of plausible inference. Morgan Kaufmann.

Prensky M. (2001). Digital natives. Digital immigrants. On the Horizon, 9(5), 1–6.

Rowland S. (2001, December 21). Use passion to counter culture of compliance. Times Higher Education. Retrieved from http://www.timeshighereducation.co.uk/story.asp?storyCode=166322&sectioncode=26

Rupp A. A. , Gushta M. , Mislevy R. J. , & Shaffer D. W. (2010). Evidence-centered design of epistemic games: Measurement principles for complex learning environments. Journal of Technology, Learning, and Assessment, 8(4). Available online at http://ejournals.bc.edu/ojs/index.php/jtla/article/view/1623

Salen K. (2012). Seminar. Presented at Educational Testing Services, Princeton, NJ.

Shute V. J. , Hansen E. G. , & Almond R. G. (2008). You can't fatten a hog by weighing it – or can you? Evaluating an assessment for learning system called ACED. International Journal of Artificial Intelligence in Education, 18, 289–316.

Shute V. J. , & Kim Y. J. (2011). Does playing the World of Goo facilitate learning?. In Dai D. Y. (Ed.), Design research on learning and thinking in educational settings: Enhancing intellectual growth and functioning (pp. 359–387). New York: Routledge Books.

Shute V. J. , Ventura M. , Bauer M. , & Zapata-Rivera D. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning: Flow and grow. In Ritterfeld U. , Cody M. J. , & Vorderer P. (Eds.), The social science of serious games: Theories and applications (pp. 295–321). Philadelphia, PA: Routledge/LEA.

Wainess R. , Koenig A. , & Kerr D. (2011). Aligning instruction and assessment with game and simulation design. CRESST Research Report. Los Angeles: The National Center for Research on Evaluation, Standards, Student Testing (CRESST), Center for Studies in Education, UCLA. Retrieved from: http://www.cse.ucla.edu/products/reports/R780.pdf

Williamson D. W. (2012). The conceptual and scientific basis for automated scoring of performance items. In Lissitz R. W. & Jiao H. (Eds), Computers and their impact on state assessments: Recent history and predictions for the future (pp. 157–194). Charlotte, NC: Information Age Publishing.

Williamson D. W. , Almond R. G. , Mislevy R. J. , & Levy R. (2006). An application of Bayesian networks in automated scoring of computerized simulation tasks. In Williamson D. W. , Bejar I. I. , & Mislevy R. J. (Eds.), Automated scoring of complex tasks in computer-based testing (pp. 123–168). Mahwah, NJ: Lawrence Erlbaum.