Abstract
Assessment of oral presentation skills is an underexplored area. The study described here focuses on the agreement between professional assessment and self- and peer assessment of oral presentation skills and explores student perceptions about peer assessment. The study has the merit of paying attention to the inter-rater reliability of the teachers. Comparison of the teacher and peer assessment rubric scores points at a positive relationship, but also at critical differences. The lower intra-class correlation suggests that peers and teachers still interpret the criteria and indicators of the rubric in a different way. With regard to the comparison of self-assessment scores and teacher scores, we have to conclude that there are significant differences between these scores. Self-assessment scores are, for the most part, higher than the marks given by teachers. The results also reflect a very positive attitude of students towards peer assessment as a relevant source of external feedback.
Quality of assessment
Recent approaches to assessment stress the learning potential of assessment (Taras, 2008), particularly formative assessment, which is defined as ‘assessment that is specifically intended to provide feedback on performance to improve and accelerate learning’ (Nicol and Milligan, 2006: 64). Some consider this a key quality of assessment and regard it as the ‘consequential validity’ of assessment (Gielen et al., 2003). Consequential validity sits alongside the two other traditional psychometric qualities of an assessment: reliability and validity. According to Messick (1994) consequential validity is one of the six aspects of his unified concept of validity. Involvement of students in assessment can be organized in two ways: self-assessment and peer assessment. In peer assessment, according to Falchikov (2005: 27), ‘. . . students use criteria and apply standards to the work of their peers in order to judge that work’. Building on this, we state that in self-assessment students use criteria and apply standards to judge their own work. Both self- and peer assessment are expected to decrease the central role of the teacher in assessment activities. During recent decades, there has been an increase in the implementation of self- and peer assessment in higher education learning environments (Segers et al., 2003). Despite this increased interest, formative assessment in higher education is still largely controlled by teachers (Nicol and Macfarlane-Dick, 2006).
The theoretical position of self- and peer assessment in a self-regulated learning process
In this study a socio-cognitive theoretical perspective towards self-regulated learning is adopted as a theoretical basis for oral presentation skills instruction (Bandura, 1997; Schunk, 2001). This choice builds on the literature that links the instruction of oral presentation skills to observational learning (Bandura, 1997). Via observational learning, learners compare their performance or the performance of others with more or less explicit standards of a good oral presentation. The oral presentation skills will evolve by achieving a better match between these standards and the current performance level (Sadler, 1989). We adopt the term calibration to refer to the match between an internal evaluation and a standard (Winne, 2004). Both internal and external sources of feedback are helpful to foster the calibration process to attain higher performance levels in the context of productive self-regulated learning (Winne, 2004). The calibration activity can be fostered by providing opportunities for self-assessment.
External feedback from peers can play a comparable role (Topping, 1998). An accurate calibration of oral presentation performance and the standards suggests that a sufficient level of reliability can be attained when comparable assessment results are reported by a teacher/expert, by peers, or by the learner. Self- and peer assessment result in a more active involvement of students in their own learning process (Ozogul and Sullivan, 2007). A student who always expects teachers to present a judgment will develop to a lesser extent a self-assessment orientation (Boud and Falchikov, 2006). From a self-regulated learning point of view, it is however critical to develop self-observation skills that help to compare the information gathered via self-observation with a performance goal. Sub-processes related to self-observation and self-judgment are important. They are regarded as the steps in a learning monitoring process that helps learners to bring their behaviour in line with their performance and goals (Schunk, 2001). Next to self-assessment, peer assessment was also found to have positive effects on domain-specific and on peer assessment skills (Van Zundert et al., 2009). Topping (2009) explains this by linking peer assessment to the provision of immediate, individualized and richer feedback. Since this feedback is formative in nature, it has a clear potential of fostering the subsequent learning process (Hattie, 2009).
Analysis of the assessment of oral presentation skills mainly results in an overview of studies about self- and peer assessment of individual (oral) presentation skills (AlFallay, 2004; Campbell et al., 2001; Cheng and Warren, 2005; Hafner and Hafner, 2003; Hughes and Large, 1993; Langan et al., 2005; Langan et al., 2008; Magin and Helmore, 2001; Oldfield and Macalpine, 1995; Patri, 2002; Sellnow and Treinen, 2004). In some studies, the research focuses only partly on self- and peer assessment (Fallows and Chandramohan, 2001). In a minor number of cases, group presentations have been assessed (Kerby and Romine, 2009).
In general, research about self- and peer assessment of oral presentation skills reveals under-explored areas and diverging views. Moreover, the use of very different samples and different assessment instruments makes it difficult to compare the findings of those studies. The study by AlFallay (2004), for instance, involved students in applied sciences enrolled in an English language programme, while the study by Patri (2002) involved Chinese students, and Campbell et al. (2001) American students. These results indicate that more research is needed regarding self- and peer assessment of oral presentation skills.
Benefits of self- and peer assessments
Falchikov (2005: 16) hypothesizes that ‘involving students in the assessment of presentations is extremely beneficial’ for developing self-regulating skills. Students are expected to analyse their own behaviour and develop a better understanding of the nature of quality criteria. Cheng and Warren (2005) cite several studies that reported improved presentation performance as a result of peer assessment. Other studies adopted videotaped feedback for self-assessments, and also reported the attainment of improved oral presentation skills (Bourhis and Allen, 1998).
Topping (1998) dedicates part of his review of the literature about peer assessment to the assessment of oral presentation skills. He summarizes improvements in marks, perceived higher learning performance, higher presentation confidence (self-efficacy), and the development of appraisal skills. In addition, Topping (2003) mentions the economic benefits of adopting self- and peer assessment. Shifting part of the responsibilities for assessment and feedback from the teacher to the student has – next to educational benefits – also benefits in terms of reducing teaching workload.
Inter-rater reliability of self- and peer assessments
There is considerable debate about the inter-rater reliability of self- and peer assessments (Topping, 2009). Topping (2003) points to the widespread approach in discussions of the reliability of self- and peer assessments compared with assessment by teachers, stressing that the a priori assumption that assessment by a teacher is more reliable and more valid can be doubted in some contexts. This a priori assumption relates to a positivist epistemological perspective about assessment (Elton and Johnston, 2002). There is little research that actually tested this assumption, and sometimes disagreement between tutors is mentioned (Langan et al., 2008).
Freeman (1995) concludes that there is no significant difference in the overall mark averages given by peers and those given by teachers. In contrast, Langan et al. (2005) report that peer marks are on average 5% higher than marks given by their tutors. Other correlational studies conclude that peer assessment can be a relevant substitute for assessments by teachers (AlFallay, 2004; Campbell et al., 2001; Hughes and Large, 1993; Oldfield and Macalpine, 1995; Patri, 2002). Nevertheless, Hughes and Large (1993) warn that a high correlation between marks of peers and teachers can still hide a considerable variation in the marks. Freeman (1995) reports only a moderate correlation between peer and teacher scores. He also reports that the standard deviation of marks given by peers was half the value of the standard deviation in scores given by teachers (see also Hughes and Large, 1993). Cheng and Warren (2005) add to this that student average marks are within one standard deviation of teacher marks, but they point out that students did not always assess the same elements or criteria as their teachers did. Kappe (2008) found that students were able to provide a reliable overall assessment but needed additional training to provide reliable marks on specific criteria of oral presentations. Hafner and Hafner (2003) adopted regression analysis showing a significant positive functional relationship between instructor and mean peer scores and found that students come to a strong agreement in the final ranking of their scores.
Fewer studies are found that compare teacher assessment with self-assessment of oral presentation skills, and it is clear that results are not univocal. Some studies report lower correlations values between self- and teacher assessments than between teacher and peer assessment (Campbell et al., 2001; Langan et al., 2008; Patri, 2002). Nevertheless, others consider self-assessment to be as valid as peer assessment (AlFallay, 2004; Hafner and Hafner, 2003).
Variables affecting the quality of self- and peer assessment of oral presentations
A continuous debate is observed about the reliability of self- and peer assessment in relation to the development of presentation skills. In the context of peer assessment, rating errors and the impact of student perceptions of peer assessment is a key topic for discussion. Rating errors are central in the study of Sluijsmans et al. (2001), who refer to personal differences in standards and rating styles, and the extent to which peers distribute grades and have different opinions about the rating tasks. Student perceptions are stated to have a considerable influence on student learning (Struyven et al., 2003). Concerns have been raised about resulting difficulties in peer assessment contexts (Hanrahan and Isaacs, 2001). Results show that students were concerned about their inexperience in marking, they felt uncomfortable critiquing others’ work and remarked that their marking input was not taken seriously because it was not considered when calculating the final mark. Students also complained about the time-consuming nature of the activity and asked for feedback on their involvement in the assessment.
Only a small number of studies explore the views that students hold about peer assessments of oral presentation skills. The findings of Cheng and Warren (2005) showed that students reflected a low level of comfort in a peer assessment situation, and a low degree of confidence in their personal peer assessment skills. This suggests that low self-efficacy levels for peer assessment skills can affect the nature and quality of peer assessment. Langan et al. (2005) point at obvious problems with anonymity when building on peer assessment of oral presentations. Lack of anonymity may lead to assessment bias. These authors also detected gender effects and found that peers rated students from the same university slightly higher than students from other universities. Falchikov (2005: 154) cites a 1999 study of Lapham and Webster, who mention bias when peers are asked to mark seminar presentations. Lastly, Sellnow and Treinen (2004) report that neither the gender of the presenter, nor the gender of the assessor, affects overall peer ratings.
As to self-assessment, a meta-analysis of Falchikov (2005) indicates that some, but clearly not all, students are able to assess in the way that teachers apply assessment criteria. This is confirmed by a study of Kruger and Dunning (1999) where novices and low performers overestimate their performance level and lack related metacognitive abilities (monitoring, evaluation). Rust et al. (2003) and Langan et al. (2008) reported that women are more likely to underestimate their performance, whereas males tend to overestimate the quality of their performance in a self-assessment context.
Improving the quality of self- and peer assessments
There is no unequivocal answer as to how the quality of self- and peer assessments of oral presentation skills can be improved. Earlier research focused on the critical value of assessment training, the feasibility of student-based assessment, the nature of the assessment criteria and the scoring approach. Hafner and Hafner (2003) state that providing training is not sufficient. In addition, Carlson and Smith-Howell (1995) found hardly any differences in assessment practices between untrained and trained teachers. Others conclude that peers need training in view of peer assessment (AlFallay, 2004; Campbell et al., 2001; Freeman, 1995; Patri, 2002; Sluijsmans, 2002). Langan et al. (2005) found that marks awarded by students who participated in preliminary discussions about the assessment criteria were significantly lower than the marks of students who were not involved in these initial discussions. Compensating for low self-efficacy related to peer assessment during these discussions was a key point in the study of Fallows and Chandramohan (2001). Miller (2003) concluded that a larger number of items in the evaluation checklist resulted in an increase in variance in scores. This diminishes inter-rater reliability but, on the other hand, provides students with more detailed and thus better feedback. In contrast, Freeman (1995) suggests reducing the number of criteria in the checklist, diminishing the quality of feedback generated by the assessment. Langan et al. (2008) recommend adopting short sessions in order to minimize loss of concentration.
To conclude, many questions remain unanswered. The main problem is the lack of empirical research that directs specific practices in the field of self- and peer assessment (Sluijsmans, 2008). Building on the theoretical and empirical basis outlined above, we put forward the following research questions:
What is the level of agreement between undergraduate students’ peer assessments and the assessments of university teachers in relation to oral presentations?
What is the level of agreement between self-assessments and assessments by university teachers?
What are the student perceptions about peer assessment?
Research design
Participants
Oral presentations and answers on a questionnaire were collected from 57 university freshmen students (21 females and 36 males) enrolled for a Business Administration introductory course on psychology. The research was set up during the first semester. Administration of the questionnaire was carried out at the end of the semester (December). Initially, 73 students participated in the study but, owing to illnesses, incompatibility of roster, internships or other reasons among the students, 16 students dropped out. The reasons for drop-out were deemed not to be systematic. The average age among the 57 students who participated was 18 years. Informed consent was obtained from all participants, but they were not informed about the nature of the research questions.
Research instruments
Assessment instrument for oral presentation performance
In a preliminary study (De Grez et al., 2009b), six existing assessment scales to judge the quality of an oral presentation were analysed by four experienced higher education teachers acquainted with the knowledge domain. On the basis of the results of semi-structured interviews with these experts, a rubric was developed consisting of nine oral presentation evaluation criteria: three content-related criteria (quality of introduction, structure and conclusion), five criteria about the nature of the delivery (eye contact, vocal delivery, enthusiasm, interaction with the audience and body language), and a general quality criterion (professionalism). Descriptors and indicators were added to support the use of the assessment criteria in the rubric. These were improved after application of the rubric by trained assessors who judged the quality of more than 300 oral presentations (for a detailed description, see De Grez et al., 2009b).
On the basis of a factor analysis, two evaluation components can be distinguished when applying the nine criteria: content-related criteria and delivery-related criteria (see Table 1). One item, labelled ‘professionalism’, loads on both components (De Grez et al., 2009b).
Components found on the basis of the principal components analysis, and loadings
University teachers and peer assessors were asked to rate the quality of an oral presentation on the basis of the rubric. For each criterion a five-point Likert scale was used. Descriptors and indicators are provided to support the assessment process.
As an example, we describe the assessment related to the criterion ‘quality of the introduction’. Assessors are invited to consider three indicators to score this criterion:
Grasps the attention of the audience with the first sentences.
Gives a goal or central idea of the presentation in the introduction.
Gives an idea of the structure of the presentation in the introduction.
The score reflects the extent to which the quality of the introduction meets none, one or more of the three indicators.
Perception of peer assessment and of the learning process
A subscale focusing on ‘perceptions of peer assessment’ was adopted from the seven-item questionnaire (α = .74) developed and validated by Sluijsmans (2002). One item that was context-specific for the Sluijsmans (2002) study was omitted from the scale, and some words were changed in order to adapt the subscale to the specific oral presentation situation (for example ‘You can learn from the feedback of peers’ and ‘I think students should be able to assess each other’). The scale, as used in this study, reflects a good reliability (α = .80). Respondents were also asked how much they learned from seven instructional components (on a ten-point Likert scale).
Teachers and peer assessors
The oral presentations (recorded) were assessed by five different assessors (two male, three female) on the basis of the assessment rubric as explained above. Four of these assessors were faculty members with at least five years experience of language teaching but who had not taught the students being assessed. The fifth assessor was a junior researcher. These assessors (and their assessments) are labelled as teachers in this article. As well as the teachers, 47 students were involved as peer assessors. These students did not belong to the same group as those being assessed. They were enrolled in the second year of a Business Administration course (32 males) and participated in the study as a formal part of their course on communication skills. Both the teachers and the peer assessors were unaware of the nature of the research questions. All the teachers received some short training (45 minutes on average) about the nature and use of the assessment rubric. Peer assessors received, as part of their formal instruction programme, an introduction to oral presentation skills and the use of the evaluation rubric. They had extensive experience in using the assessment instrument, as part of their communication course.
Procedure
The students in the research sample were, as a formal part of their psychology course, invited to deliver three short (on average three minutes) oral presentations about a prescribed topic. Topics were of similar level of difficulty: my town, my high school, my university. All the presentations were recorded. In the research setting, as well as the presenter, those present included an audience consisting of two other participants (but always a different pair), and the first author. A camera, recording the session, was positioned in an unobtrusive location. As a result of the drop-out of a number of participants for the second or third presentation, the final number of recordings was 209 instead of 219 (73 students, 3 oral presentations each).
After the first presentation, students participated individually in a computer-based multimedia training programme about oral presentations (see De Grez et al. (2009a) for more details). After the second presentation, students received feedback on their first presentation, based on the scores for the nine assessment criteria (see below). The intervention was spread over nine lesson weeks.
Assessors and the assessment procedure
The evaluation of the oral presentations by the teachers and peer assessors was based on video recordings. None of the assessors was aware whether they were assessing a recording of a first, a second or a third oral presentation. Recorded presentations were assigned randomly to assessors. Table 2 indicates the allocation of specific assessors to specific oral presentations.
Summary of the assessment procedure
Each teacher individually evaluated between 34 and 49 of the total number of 209 oral presentations. For each oral presentation, scores were required for the nine rubric criteria. Student peers assessed 29 presentations. Each of these 29 presentations was assessed by six different peers. The choice of this specific number is based on the work of Hafner and Hafner (2003), who reported a large improvement in reliability when moving from a single rater to about five raters, and on the work of Dannefer et al. (2005), who concluded that at least six peers are needed to achieve a moderate reliability when assessing professional competences. As part of the research design, participants were also asked to rate their own presentation on the basis of the assessment rubric. One third of the participants rated their first presentation and all the participants rated their second presentation. The rubric was introduced as part of the multimedia instruction package. Therefore, we assume that students were sufficiently acquainted with the rubric criteria in view of the self-assessment activity.
The consistency between scores of different raters is central to the concept of reliability. There is much debate about ways to calculate or estimate the inter-correlations between assessors. We calculated intra-class correlation coefficients, as suggested by Cho et al. (2006: 896), who recommend adopting measures that are not influenced by distribution features, so correlation measures are preferred to percentage agreement measures. However, the use of the Pearson product-moment correlations can also be criticized. Following Shrout and Fleiss (1979), we used intra-class correlations (ICC), a common measure of reliability of either different judges or different items on a scale, in this study.
Results
Initial analyses
Prior to the actual analysis of the research data, a quality control of the assessment process was carried out. This focused on the way teachers applied the assessment rubric. Analysis of variance was applied to test differences. Post hoc comparisons confirm that teachers did not differ significantly in applying the rubric criteria Introduction, Structure and Contact with audience. But significant differences were observed in relation to the other six criteria. Additional analysis revealed that, for five of the six criteria, it was consistently the same teacher adopting a more lenient view compared with the other assessors. Scores from this teacher were removed from the data set.
To detect gender bias, an analysis of variance was carried out to compare whether the gender of the teacher and the gender of the assessed participant resulted in significantly different oral presentation skill sum scores. The results indicate that there was no significant difference between the scores of male and female presenters when assessed by a male or a female teacher.
What is the level of agreement between peer assessments and teacher assessments?
After calculating the sum score of the nine rubric criteria, sum scores of teachers and peer assessors were compared. It is important to keep in mind that, as indicated in Table 2, peers only assessed ‘first’ presentations. Table 3 summarizes the analysis results. We can conclude that we have achieved an acceptable but low reliability level considering the value of the intra-class correlation.
Teacher scores versus peer assessment scores: descriptives and intra-class correlation (n = 29)
The rubric sum score reported by teachers is significantly lower compared with the peer assessments (t = 6.210; p < .001). To detect possible gender effects, an analysis of variance was carried out with the gender of the assessor and the gender of the assessed student as independent variables and the oral presentation sum score as the dependent variable. The analysis was repeated for teachers and for peer assessors. Results indicate that gender of the teachers (F(1,205) = .03, p = .87) and of the peer assessors (F(1,170) = .85, p = .36) did not result in significant differences in scoring. This implies that male assessors were not more severe or lenient than female assessors, and this was the case for teachers and for peer assessors. The interaction effect between gender of the assessor and gender of the assessed was not significant for teachers but was significant for peers (F(1,170) = 4.17, p < .05), as can be seen in Figure 1. Male peers allocated higher scores to female presenters than female peers did. Female presenters obtained higher scores than male presenters.

Gender interaction effect peer assessors
What is the level of agreement between self-assessments and teacher assessments?
To answer this question, the scores of teachers were compared with the scoring results obtained via self-assessment. It is important to keep in mind that, as indicated in Table 2, participants self-assessed first and second presentations. Table 4 summarizes the analysis results. We can conclude that we have achieved again an acceptable but low level of reliability considering the value of the intra-class correlation.
Teacher assessment versus self-assessment: descriptives and intra-class correlation (n = 79)
The ‘total’ rubric score of teacher assessments is significantly lower compared with self-assessment scores (t = 6.19; p < .001). The self-assessment scores of male and female participants are not significantly different (F(1,75) = .30, p = .58).
What are the student perceptions about peer assessment and the learning process?
The average perception score about peer assessment reflects a predominantly positive opinion about peer assessment. Comparison of the first (m = 3.67) and second administration (m = 4.11) of the scale indicates a significant increase in the positive appreciation of peer assessment (t = 4.11; p = < .001).
Participants ranked the instructional components, and results showed they believed they learned most from the feedback (M = 7.42) and least from their first presentation (M = 5.91). They indicated, however, that they learned more from the second (M = 6.79) and third (M = 7.02) presentations.
Discussion and conclusions
In this study, alternative assessment approaches were explored. Self- and peer assessment were positioned within a socio-cognitive perspective on self-regulated learning. The limited, and often contradictory, empirical evidence about self- and peer assessment of oral presentation skills prompted the design of a study in which self- and peer assessment were contrasted with the assessment by teaching staff.
Comparison of the teacher and peer assessment rubric scores points at a positive relationship, but also at critical differences. The lower intra-class correlation described here suggests that peers and teachers still interpret the criteria and indicators of the rubric in a different way. This can be explained by differences in the width and depth of their experience basis. Also, within the group of peers, not all students could have applied the same criteria in a comparable and/or consistent way. Lastly, the finding that peers report higher marks compared with teachers is in agreement with the results of other studies (Langan et al., 2008).
With regard to the comparison of self-assessment scores and teacher scores, we have to conclude that there is a level of agreement and disagreement when assessing the oral presentations. Also the finding that the self-assessment scores are, mostly, higher than the marks given by teachers is consistent with the results reported in the literature (Patri, 2002).
As stated above, these scoring differences can be explained by the broader experience of teachers when judging the quality of oral presentations. They can retrieve from their memory a larger set of models that exemplify how oral presentations do or do not meet the criteria. Price and O’Donovan (2006) mention tacit knowledge that is experience-based and can only be made explicit through the sharing of experiences. This also implies that, in an implicit way, teachers add criteria and/or indicators when judging the quality of an oral presentation. This adds to the unreliable, but often neglected, nature of teacher assessments. This study has the merit of paying attention to the inter-rater reliability of the teachers. As explained above, one of the teachers applied a number of the criteria in a more lenient way. This problem was tackled by removing the particular assessment from the data set. Nevertheless, in a normal instructional setting, teachers have to be aware of bias potentially caused by assessors approaching the criteria in diverse ways. This should also be considered when setting up assessment-related research (Topping, 2009).
With regard to the research question focusing on student perceptions of peer assessment, it can be concluded that the results reflect a very positive attitude towards the value of peer assessment. In addition, the results indicate that the actual process of carrying out self- and or peer assessment affects this perception in a positive way. This is a promising finding in the light of the impact of perceptions on the outcomes of student learning (Struyven et al., 2003). We might assume that students’ perceptions of peer assessments will influence their willingness to take into account the feedback generated by peer assessment and to actually do something with that feedback. This positive attitude is probably also reflected in the ranking of the instructional components when participants declared that they learned most from the feedback.
Gender was also studied as a potential source of bias. Neither the gender of the assessor nor that of the student being assessed seems to influence the assessment process or assessment marks. The interaction effect between gender of the assessor and gender of the assessed was not significant for teachers but was significant for peers. Gender effects are also reported by some researchers (Edens et al., 2000; Langan et al., 2005) but not by others (Sellnow and Treinen, 2004). It is possible that the gender effect observed in peer assessments interacted with the lower correlation between peer and teacher assessments. This gender effect can lower the quality of the peer assessments and the correlation with teacher assessments. The gender effect was caused by male assessors who gave higher marks to female presenters than female assessors did. Male assessors might have been somewhat biased towards female presenters and were too generous with their marks. It is also possible that female assessors underestimated the female presenters. Further research should shed more light on this issue.
Although a large number of recorded oral presentation sessions were assessed by peers, teachers and students themselves, the study remains limited when it comes to sample size, duration of the instructional intervention, scope of the skills to be mastered and the complexity level of the competencies. An important limitation is the limited variation in nature and background of the participants. The study has to be replicated involving students from other domains and from other educational levels. Additional research could focus on the impact of assessment training and student collaboration in relation to defining assessment criteria. Future studies should also consider the nature of the target audience, which could vary in knowledge domains and expertise levels. These studies should investigate the short-term, middle-term and long-term effects of self- and peer assessment. It would also be interesting to investigate the impact of individual and interpersonal variables (Van Gennip et al., 2009). In this study, as in many other studies, teacher assessments were compared with peer and self-assessments. It might be interesting, in future research, to additionally compare self- and peer assessments.
Though a more in-depth and qualitative analysis of differences in scoring behaviour between teachers, peers and the students giving the oral presentations is beyond the scope of the present study, we have to bear in mind that the requirement to attain a high level of reliability was not completely answered (Price and O’Donovan, 2006; Topping, 2003). This finding suggests that the training of assessors is very important, and is in line with ideas presented (Van Zundert et al., 2009). Such training could provide more examples and/or more concrete indicators. The suggestion is also very important for practitioners. They should provide extensive training to learners. Enriching the learning process with an explicit discussion of the assessment approach and criteria between peers and between teacher and learners could enhance the quality of the educational process.
Nevertheless, the results do not question the value of self- and peer assessment of oral presentation skills, and practitioners are advised to use both forms of assessment in order to provide the learner with a sufficient level of formative feedback. Also Langan et al. (2005) and Sluijsmans (2002) make clear that the benefits of peer assessment outweigh a certain degree of discrepancy between student marks, tutor marks and peer markings. Boud (2007) refers in this context to the consequential validity of assessment. This means that the value of self- and peer assessment is also to be found in the impact on the acquisition process of complex oral presentation skills. Some studies, such as Winne (2004), stress the importance of the accuracy of feedback in view of future learning outcomes. But others, such as Gibbs (2006) and Yorke (2003), state that it is not only the quality of the feedback evolving from the assessment that is crucial but what a student does with the feedback. In our opinion, a combination of both views is needed. On the one hand we do not want students to take wrong actions based on low-quality feedback but on the other we want students to do something with the feedback.
The question is therefore how to improve the quality of self- and peer assessment approaches. Falchikov (2005) recommends developing evaluation criteria in close collaboration with students. Price and O’Donovan (2006) warn that it is insufficient to concentrate on more detailed indicators for assessment criteria or standards because these indicators can become counterproductive if they are too comprehensive. They stress the importance of giving students sufficient practice and discussion to develop a shared understanding of the explicit and tacit assessment criteria. Part of the less positive results of the present study can therefore be explained on the basis of insufficient practice. The students did not get sufficient opportunities to practise with the assessment criteria. This conclusion also challenges the statements of Hafner and Hafner (2003) and Carlson and Smith-Howell (1995) that assessment training is not essential.
Our study revealed some interesting results about the, until now, underexplored self- and peer assessment field of oral presentation skills. Additional research could help to clarify the relationship between self- and peer assessment and our theoretical framework about self-regulated learning.
Footnotes
Biographical notes
Luc De Grez is assistant professor in Psychology and Leadership Behaviour at the University College Brussels (PhD Ghent University). His research interests include the learning and teaching of communication skills, and entrepreneurial learning. Address: University College Brussels, Stormstraat 2, B1000 Brussel, Belgium. [email:
Martin Valcke is full Professor of Instructional Sciences at Ghent University, Belgium, and head of the Educational Studies department. His main research field is linked to the innovation of higher education and the integrated use of Information and Communication Technologies (ICT). Address: University of Ghent, H. Dunantlaan 2, B9000 Gent, Belgium. [email:
Irene Roozen is assistant professor in Marketing at the University College Brussels. Her research interests include marketing communication, advertising effectiveness and assessment of communication skills. Address: University College Brussels, Stormstraat 2, B1000 Brussel, Belgium. [email:
