共查询到20条相似文献，搜索用时 31 毫秒
1.
Teresa McConlogue 《Assessment & Evaluation in Higher Education》2012,37(1):113-123
Peer assessment of long written tasks poses particular problems as these tasks typically involve complex learning and solving ill‐structured problems which require divergent responses. Marking reliability of this kind of writing task is difficult to achieve. The author illustrates this through an evaluation of two implementations of peer assessment, involving 81 students, in a UK university. In these implementations, all peer assessor grades were returned to students (not just mean grades). In this way students were exposed to subjectivity in marking. The implementations were evaluated through questionnaires, focus groups, observations of lectures and tutor interview. While students reported a better understanding of quality in student writing as a result of their experience, many complained that peer assessors’ marks were not ‘fair’. The article draws on recent research on the reliability of tutor marking to argue that marking judgements are subjective and that peer assessment offers the opportunity to explore subjectivity in marking, creating an opportunity for dialogue between tutors and students. 相似文献
2.
The Science Foundation Programme (SFP) at the University of KwaZulu Natal, Pietermaritzburg attempts to address past educational inequalities by providing disadvantaged matriculants with the skills, resources and self‐confidence needed to embark on their tertiary studies. Students entering the Programme typically adopt a surface approach to learning with emphasis being placed on high score achievement which results in a mark‐driven attitude towards assessment. Students also lack the metacognitive skills associated with a deep approach to learning. Within this mark‐driven culture, it is important to attempt to move students away from such a superficial approach to learning and assessment. Worldwide, self‐assessment practice has been gaining recognition, and it has been linked to the adoption of a deep approach to learning; self‐regulated learning and the development of metacognitive skills. In the biology module of the Programme, students are given two essay assignments, tasks that are routinely performed very poorly. In attempt to improve SFP students’ essay writing abilities, a self‐assessment scheme to accompany the essay tasks was instituted, hoping that this would get the students to engage with the assessment criteria. It was intended that students would not only fulfil the requirements of the task better, but also achieve the valuable skill of self‐assessment. The results provide overwhelming evidence that SFP students cannot accurately self‐assess. Their naivety and inexperience in fulfilling assessment criteria was also revealed. Overall, marks awarded by staff were significantly lower than those awarded by students, and there was no evidence to suggest that any one category of students based on academic ability were better able to self‐assess than another. Marker inconsistencies were revealed, but this was shown to have no effect on findings. In spite of these results, a case for pursuing self‐assessment is made and proposals for improving student self‐assessment practice in the SFP are suggested. 相似文献
3.
ELEANOR HAWE 《Assessment & Evaluation in Higher Education》2003,28(4):371-382
Graduates from initial teacher education institutions in New Zealand are assumed to be fit to take up positions as beginning teachers. To this end lecturers make judgements at various stages during the teacher education programme about the quality of student performance with regard to coursework and teaching practice. Findings from a field-based project at a large metropolitan college of education in New Zealand revealed that making such judgements was not a straightforward activity. In particular, there was a reluctance to award failing grades. The college's published guidelines referred to the passing and failing of courses and the programme as dependent on the quality of submitted work or demonstrated performance. The everyday discourse and observed practice of lecturers and student teachers suggested, however, that both groups construed a fail grade as a judgement of personal worth. This shift from judgements about performance to judgements about personal worth was associated with the utilisation of criteria other than those outlined in published documents. The use of 'other' criteria enabled positive judgements to be made about students who did not meet course requirements and/or whose work failed to meet the minimum standard. Lecturers thus appeared to be reluctant to act as gatekeepers to an initial beginning teacher position. 相似文献
4.
Peter J. Hay Doune Macdonald 《Assessment in Education: Principles, Policy & Practice》2008,15(2):153-168
This paper draws on semi‐structured interview data and participant observations of senior secondary Physical Education (PE) teachers and students at two school sites across 20 weeks of the school year. The data indicated that the teachers in this study made progressive judgements about students’ level of achievement across each unit of work without explicit or overt reference to the criteria and standards represented in the schools’ work programmes and in the Senior PE syllabus. The teachers’ justification for such an approach was that the criteria and standards had become for them sufficiently ‘internalised’. Determining students’ levels of achievement was for the teachers somewhat ‘intuitive’, being reliant on their memory of students’ performances, and influenced by the construct‐irrelevant affective characteristics of the students. It is argued in this paper that such construct‐irrelevance compromised the construct validity and possible inter‐rater reliability of the decisions made and advantaged some students and marginalised others on the basis of characteristics that were not specifically related to the learning expected from following the syllabus. The potential inequities of such an approach are discussed and suggestions are made for the consolidation of the validity and reliability of teachers’ judgements. 相似文献
5.
Marieke Van der Schaaf Liesbeth Baartman Frans Prins 《Assessment & Evaluation in Higher Education》2012,37(7):847-860
Student portfolios are increasingly used for assessing student competences in higher education, but results about the construct validity of portfolio assessment are mixed. A prerequisite for construct validity is that the portfolio assessment is based on relevant portfolio content. Assessment criteria, are often used to enhance this condition. This study aims to identify whether assessment criteria can improve content, argumentation and communication during teacher moderation while judging student portfolios. Six teachers scored 32 student portfolios in dyads with and without assessment criteria. Their judgement processes were qualitatively analysed. Results indicated that the quality of their judgement processes was low, since teachers based their judgements mainly on their own personal opinion and less on evidence found in the portfolio. Teachers barely paid attention to quality checks and easily agreed with each other. When teachers used assessment criteria, the quality of their judgements slightly improved. They based their judgements more on relevant evidence, used less personal experiences and more often checked the quality of their judgement processes. It is concluded that the quality of teacher portfolio judgement is low, and that the use of assessment criteria can enhance its quality. 相似文献
6.
试析NBPTS优秀教师认定的标准与程序 总被引：5，自引：0，他引：5
美国全国教学专业标准委员会(NBPTS)提出了"五项核心主张"作为优秀教师评定的基准,并具体地制定了教授各学科领域不同年龄阶段学生的优秀教师的评定标准,其优秀教师评定项目显示出若干特色:评价机构独立,实施体系完整,覆盖面广;评价依据着眼于实践,强调"业绩为本";评价程序公开,效果显著,影响深远. 相似文献
7.
高职院校学生价值观现状调查 总被引：1，自引：0，他引：1
通过对737名高职院校学生价值观情况的调查,结果表明：高职院校学生价值观由于性别、是否独生子女、家庭所在地、政治面貌、专业、年级等不同,在三个维度的不同因子上会呈现出差异,其中,性别、不同年级等因素对高职院校学生价值观影响较大,是否学生干部这一因素对高职院校学生价值观影响最小。 相似文献
8.
Self‐assessment is argued to be valuable educationally and is being advocated through policies for wider adoption within medical practice. However, students are often reluctant to self‐assess and little research has examined the reasons for this. This study explored the perceptions of trainees and postgraduates on assessment and self‐assessment of surgical skills. Data were collected through semi‐structured interviews conducted with six trainees and postgraduate students in Oral Surgery. They had previously been assessed, and self‐assessed themselves for the first time, while surgically removing a mandibular third molar tooth. Assessments were judged against both an objective checklist scale and a global rating scale. Eight themes were identified and trainees’ comments on these themes analysed. The themes identified were assessment and stress, pressure to over‐ or under‐score, the impact of self‐assessment on learning, reflection and performance, confidence and the necessity of preparation, acceptability of the scales and criteria used, feedback, and the acceptability of self‐assessment. In conclusion we need to instil in our trainees a culture whereby they feel capable of and comfortable making judgements about their own performance and giving and receiving constructive assessment from their peers. 相似文献
9.
10.
Assessment criteria: reflections on current practices 总被引：1，自引：3，他引：1
Harvey Woolf ? 《Assessment & Evaluation in Higher Education》2004,29(4):479-493
This article reviews the findings of a small‐scale investigation into the criteria used by a number of SACWG departments for assessing final‐year project modules in business and history and other written history assignments. The findings provide the basis for a broader discussion of the issues relating to the formulation and use of assessment criteria. Assessment entails academics making professional judgements about the standards and quality of students' work. However, for the educational value of the work entailed in developing assessment criteria to be fully realized, there needs to be a higher level of shared understanding than currently exists (among students, tutors and other stakeholders) of the language in which criteria are couched and the ways in which criteria are applied. 相似文献
11.
Zita Lysaght 《European Journal of Education》2023,58(1):51-66
In Ireland, the high-stakes Leaving Certificate Examination at the end of upper secondary education was abruptly cancelled in 2020 due to the Covid-19 pandemic. Instead, calculated grades were introduced, necessitating for the first time the involvement of secondary school teachers in the assessment of their own students for certification. This article reports on analysis of responses to an online survey with 713 respondents conducted in the autumn of 2020, focusing on teacher experiences of engagement in the process of calculated grades in their schools and how this might inform perceptions of their future roles as assessors. Among the key findings to emerge from re-analyses of these data are inter alia that, for some teachers, (1) negotiation of student grades with colleagues—particularly those at grade boundaries—caused them to question the professional judgements of peers; (2) release by the Department of Education and Skills of student ranks, in addition to grades, constituted a breach of trust because it ran contrary to what they understood had been agreed initially; and (3) living and working in small towns or rural communities in Ireland left them very vulnerable to disgruntled students and their families—resulting in the perception that trust in their professional judgements had been undermined. Hence, the conclusion that the success of Senior Cycle reform efforts is contingent on both rebuilding teachers' trust over time while also working, in the immediate term, with teachers interested in exploring further their roles in school-based assessment for certification purposes. 相似文献
12.
Overcoming the potential dilemma of awarding the same grade to a group of students for group work assignments, regardless of the contribution made by each group member, is a problem facing teachers who ask their students to work collaboratively together on assessed group tasks. In this paper, we report on the procedures to factor in the contributions of individual group members engaged in an integrated group project using peer assessment procedures. Our findings demonstrate that the method we used resulted in a substantially wider spread of marks being given to individual students. Almost every student was awarded a numerical score which was higher or lower than a simple group project mark would have been. When these numerical scores were converted into the final letter grades, approximately one-third of the students received a grade for the group project that was different from the grade that they would have received if the same grade had been awarded to all group members. Based on these preliminary findings we conclude that peer assessment can be usefully and meaningfully employed to factor individual contributions into the grades awarded to students engaged in collaborative group work. 相似文献
13.
Research has found that grades are the most valid instruments for predicting educational success. Why grades have better predictive validity than, for example, standardized tests is not yet fully understood. One possible explanation is that grades reflect not only subject-specific knowledge and skills but also individual differences in other aspects. The purpose was to investigate the relative importance of knowledge and skills and other aspects encapsulated in grades for the predictive validity of compulsory school grades for educational success in upper secondary school. Structural equation modelling was used. Participants were 9th-grade students from 3 birth cohorts, each comprising full populations of approximately 100,000 students. The results showed that the subject-specific factors and an additional common grade factor contributed to the predictive validity. Effects of gender and parents' education were found in the common grade factor, with girls and students with a lower educational background being advantaged. 相似文献
14.
What is happening when we assess,and how can we use our understanding of this to improve assessment?
David Baume Mantz Yorke Martin Coffey 《Assessment & Evaluation in Higher Education》2004,29(4):451-477
In an attempt to gain a fuller understanding of the basis of grading, ten assessors each assessed two portfolios drawn from the course archive which had been produced by participants on a course in teaching in higher education. Assessors gave a grade or judgement on each of a portfolio's 75 portfolio elements, reasons for each judgement they made, and recorded any alternative judgement they had considered. There were substantial differences between the judgements made during the study and those made when the portfolios were originally assessed. This article explores the differences between the original and experimental assessments, and then analyses reasons given by assessors for the judgements made. Beyond these particulars, the paper suggests some fundamental and problematic issues about the conduct and the reform of assessment, and offers a process which can be used to investigate and improve the quality, in particular the reliability, of any summative assessment. 相似文献
15.
A. Mark Langan C. Philip Wheater Emma M. Shaw Ben J. Haines W. Rod Cullen Jennefer C. Boyle 《Assessment & Evaluation in Higher Education》2005,30(1):21-34
Peer assessment provides a useful mechanism to develop many positive qualities in students studying in higher education (HE). Potential influences on peer‐awarded marks include student qualities such as gender, HE background (e.g. university affiliation) and participation in the development of the assessment criteria. Many studies that have investigated peer assessment have placed great emphasis on marks from a single tutor, or very few tutors, from a single university. This study examined grades awarded by 11 tutors (affiliated with four universities) to oral presentations delivered on a residential field course by second‐year undergraduate students from two universities studying environmental or biological disciplines. Student assessors awarded marks of fairly high precision (correlating strongly with tutor grades) but averaged 5% higher than their tutors (i.e. of only moderate accuracy). Marginally higher marks (circa 1.6%) were awarded by student assessors to speakers studying at the same university. Gender influences were detected as males tended to grade other male speakers very slightly more highly than female speakers. Marks from females were unaffected by speaker gender. Students who participated in the development of the assessment criteria did not achieve higher grades for their presentations. However, when these ‘participants’ were assessing, they awarded lower marks than their peers (i.e. closer to, but not as low as, those awarded by tutors). Lower marks were also awarded during the middle of sessions, possibly resulting from factors associated with motivation and attention of speakers and markers. Overall, the potential biases in marking by naive assessors examined in this study may influence the validity of marks generated by peer assessment schemes, but the experience of this type of assessment had positive effects on those involved. 相似文献
16.
17.
Jing-Ru Wang Shin-Feng Chen 《International Journal of Science and Mathematics Education》2016,14(3):373-389
This article reports on the development of an online dynamic approach for assessing and improving students’ reading comprehension of science texts—the dynamic assessment for reading comprehension of science text (DARCST). The DARCST blended assessment and response-specific instruction into a holistic learning task for grades 5 and 6 students. The DARCST, a layer-cake approach (interspersed responses and feedback) to assessment as learning, takes a graduated-prompts perspective on the criteria for reading comprehension of science text. The item response theory (IRT) analysis and analysis of variance (ANOVA) over an instructional period indicated that the DARCST was applicable for most students with a wide range of reading abilities. Based on the acceptable psychometrics, the DARCST appears to be appropriate for use in middle-years science programs where enhanced science reading is a goal. 相似文献
18.
Vicki Huang 《Assessment & Evaluation in Higher Education》2017,42(4):580-595
To the author’s knowledge, this is the first Australian study to empirically compare the use of a multiple-choice questionnaire (MCQ) with the use of a written assignment for interim, summative law school assessment. This study also surveyed the same student sample as to what types of assessments are preferred and why. In total, 182 undergraduate property law students participated in this study. Results showed that scores for the MCQ (assessing five topics) and assignment (assessing one topic) followed a similar distribution. This indicates that an MCQ does not necessarily skew students towards higher grades than an assignment. Results also showed significant but low correlations of test scores across instruments. When asked which instrument best assessed their knowledge of property law, students expressed a strong preference for an assignment over an MCQ or examination. Comments revealed a strong belief that, because lawyers write, law schools must assess legal writing – a skill not captured by MCQs. This study is important as many Australian law schools face increasing marking loads due to higher student numbers and compulsory mid-term assessments. This article endorses the use of MCQs but only as part of a diverse suite of law school assessment. 相似文献
19.
Jomon A. Paul Mona Sinha Justin D. Cochran 《Decision Sciences Journal of Innovative Education》2023,21(3):123-143
Critical thinking (CT) skills are essential to academic and professional success. Instruments to assess CT often rely on multiple-choice formats with inherent problems. This research presents two instruments for assessing CT, an essay and open-ended group-discussion format, which were implemented in an undergraduate business course at a large public university. The topics were intentionally chosen to be digitally-related (internet access and social media) since they raise complex issues, are applicable in many disciplines, and students are avid users, thereby making these instruments relevant, multidisciplinary, engaging, and multifaceted. These instruments may be adapted to enable educators to effectively assess undergraduate students’ ability to think critically. Qualitative analysis of the verbatim data with NVivo helps demonstrate the instruments’ efficacy in assessing CT, with (1) high-quality responses receiving high grades, and (2) overarching themes identified by content analysis, that coalesce into the three dimensions of social justice theory (distributive, procedural, and interactional), thus illustrating students’ consideration of complex fairness norms and societal needs. Excerpts of student responses are provided as illustrations of the indicators/evidence of critical thinking. Educators can use these instruments to first assess students’ CT skills, and then devise targeted interventions to improve the quality of students’ thought processes. 相似文献
20.
This exploratory study compares and contrasts two types of critical thinking techniques; one is a philosophical and the other an applied ethical analysis technique. The two techniques analyse an ethically challenging situation involving ICT that a recent media article raised to demonstrate their ability to develop the ethical analysis skills of ICT students and professionals. In particular the skill development focused on includes: being able to recognise ethical challenges and formulate coherent responses; distancing oneself from subjective judgements; developing ethical literacy; identifying stakeholders; and communicating ethical decisions made, to name a few. 相似文献