Predicting human judgments of essay quality in both integrated and independent second language writing samples: A comparison study     

Liang Guo  Scott A. Crossley  Danielle S. McNamara 《Assessing Writing》2013,18(3):218-238

This study explores whether linguistic features can predict second language writing proficiency in the Test of English as a Foreign Language (TOEFL iBT) integrated and independent writing tasks and, if so, whether there are differences and similarities in the two sets of predictive linguistic features. Linguistic features related to lexical sophistication, syntactic complexity, cohesion, and basic text information were investigated in relation to the writing scores for both integrated and independent samples. The results of this study show that linguistic features can be used to significantly predict essay scores in the integrated as well as the independent writing. When comparing across the two writing tasks, there are both similarities and differences in the two sets of predictive features. For instance, lexical sophistication was found to be a significant predictor for both tasks while features such as verbs in 3rd person singular form and semantic similarity were only significant predictors for the integrated task. These findings demonstrate that evaluation of the two writing tasks rely on similar and distinct features, and are at least partially assessed using different linguistic criteria. Implications of these findings for the assessment of second language (L2) writing are also discussed.  相似文献   

Impact of school inspections on improvement of schools—describing assumptions on causal mechanisms in six European countries   总被引：1，自引：0，他引：1  

M. C. M. Ehren  H. Altrichter  G. McNamara  J. O’Hara 《Educational Assessment, Evaluation and Accountability》2013,25(1):3-43

School inspection is used by most European education systems as a major instrument for controlling and promoting the quality of schools. Surprisingly, there is little research knowledge about how school inspections drive the improvement of schools and which types of approaches are most effective and cause the least unintended consequences. The study presented in this paper uses interviews with inspection officials and a document analysis to reconstruct the “program theories” (i.e. the assumptions on causal mechanisms, linking school inspections to their intended outcomes of improved teaching and learning) of Inspectorates of Education in six European countries. The results section of the paper starts with a summary of the commonalities and differences of these six national inspection models with respect to standards and thresholds used, to types of feedback and reporting, and to the sanctions, rewards and interventions applied to motivate schools to improve. Next, the intermediate processes through which these inspection models are expected to promote good education (e.g. through actions of stakeholders) are explained. In the concluding section, these assumptions are critically discussed in the light of research knowledge.  相似文献   

Skills, capabilities and inequalities at school entry in a disadvantaged community     

Orla Doyle  Louise McEntee  Kelly A. McNamara 《European Journal of Psychology of Education - EJPE》2012,27(1):133-154

Socioeconomic inequalities in children’s skills and capabilities begin early in life and can have detrimental effects on future success in school. The present study examined the relationships between school readiness and socioeconomic (SES) inequalities using teacher reports of the Short Early Development Instrument (Janus et al. 2005) in a disadvantaged urban community of Ireland. It specifically examined differences in skills within a low SES community in order to investigate the role of relative disadvantage on children’s development. SES differences across multiple domains of school readiness were examined using Monte Carlo permutation tests and seemingly unrelated regression models. The false discovery rate (Benjamini and Hochberg 1995) was used to control for multiple hypothesis testing. The results indicated that being from a relatively higher SES background does not act as a protective factor for children residing in a disadvantaged community for the majority of school readiness domains. This implies that the neighbourhood may play a role in children’s school readiness skills. These results suggest that school readiness interventions should target all children living in disadvantaged communities as each child may be at risk of poor school readiness.  相似文献   

Computer‐based scaffolding to facilitate students' development of expertise in academic writing     

Antje Proske  Susanne Narciss  Danielle S. McNamara 《Journal of Research in Reading》2012,35(2):136-152

Research on expert performance suggests that deliberate practice provides optimal opportunities for expertise development. This study examined whether the provision of computer‐based scaffolding (CBS) guiding deliberate practice facilitates students' development of writing expertise. A CBS environment escribo was designed to externally support expert writing activities, generate feedback and offer opportunities to practise corrected performance in academic writing. There were two testing times. First, the effects of practising writing with escribo were compared with the effects of a practice‐only situation without support. Second, a post‐test comprised composing an essay discussing an academic position without scaffolding. Results revealed that the escribo group at both testing times wrote essays of better comprehensibility than students in the practice‐only group. Furthermore, at both testing times the escribo group expended significantly more time on prewriting. These findings suggest that CBS guiding deliberate practice may be a promising means to facilitate the development of writing expertise.  相似文献   

Promoting deep learning in a teacher education programme through self- and peer-assessment and feedback     

Raymond Lynch  Patricia Mannix McNamara  Niall Seery 《欧洲师范教育杂志》2012,35(2):179-197

The incorporation of self- and peer-assessment and feedback has significant potential as a pedagogical strategy to promote deep learning in project based coursework. This study examined the impact of a deeper approach to learning on pre-service teachers’ critical thinking and metacognitive skills. It also examined the impact on student learning outcomes within a project based module with a significant design element. Forty-seven students participated in the pilot of an online peer feedback system. Results suggest that the quality of students’ reflections through peer feedback and overall satisfaction with the module remained high despite students’ citing a preference for instructor feedback. The data also indicate that the incorporation of self- and peer-assessment and feedback resulted in higher quality learning outcomes and enhanced critical thinking skills.  相似文献   

Placement-based learning and learner engagement: findings from a new university in the UK     

Timothy R.N. Murphy  Pilar Folgueiras Bertomeu  Patricia Mannix McNamara 《Irish Educational Studies》2016,35(1):17-34

This paper addresses the potential for engaged learning among final-year undergraduate Education Studies students at a new, post-1992. It discusses a case study analysis of a ‘Directed Experiential Learning’ (DEL) intervention in the final year of an education studies degree designed to engage and motivate students and emphasise the links between theory and practice for them. Implementation took place in 2012–2013 with a cohort of 37 students and quantitative and qualitative analysis was performed afterwards to investigate the perspectives of students (online questionnaire and interview with 2 students) and tutors (4 individual interviews) on the DEL approach applied. The study described should be of particular interest to those teaching on and designing third level education studies programmes as well as related disciplines that might participate in integrated working arrangements in practice (e.g. nursing, social care).  相似文献   

Multilevel training research in a federal agency: Methodological and operational considerations     

John R. McNamara 《Performance Improvement》1981,20(6):24-32

  相似文献