共查询到20条相似文献，搜索用时 46 毫秒
1.
Derek C. Briggs Maria Araceli Ruiz‐Primo Erin Furtak Lorrie Shepard Yue Yin 《Educational Measurement》2012,31(4):13-17
In a recent article published in EM:IP, Kingston and Nash report on the results of a meta‐analysis on the efficacy of formative assessment. They conclude that the average effect of formative assessment on student achievement is about .20 SD units. This would seem to dispel the myth that effects between .40 and .70 can be attributed to formative assessment. They also find that there is considerable variability in effect sizes across studies, and that only the content area in which the treatment is situated explains a significant proportion of study variability. However, there are issues in the meta‐analytic methodology employed by the authors that make their findings somewhat equivocal. This commentary focuses on four methodological concerns about the Kingston and Nash meta‐analysis: (1) the approach taken to select studies for inclusion, (2) the application of study inclusion criteria, (3) the extent to which the effect sizes being combined are biased, and (4) the relationship between effect size magnitude and characteristics of outcome measures. After examining these issues in the context of the Kingston and Nash review, it appears that considerable uncertainty remains about the effect that formative assessment practices have on student achievement. 相似文献
2.
Floating and sinking (FS) is a key topic in science education, both at primary and secondary levels. The interpretation of FS phenomena, however, is challenging due to the difficulty of the scientific concepts and explanatory models involved (e.g., density, buoyancy), along with students' everyday experiences, which conflict with scientific explanations. Consequently, many studies over the last few decades have investigated how FS could be taught effectively to students of different ages while utilizing multiple teaching approaches. This meta-analysis summarizes findings from 69 intervention studies on teaching FS conducted between 1977 and 2021. Over all studies, we estimated a mean effect size of g = 0.85 (95% CI = 0.71, 0.99). This large effect size demonstrates that, although FS is a challenging concept, teaching FS is effective even in elementary school. Moreover, in a moderator analysis, we investigate the effect of intervention characteristics, students' age, as well as study design, and assessment features on the mean study effect size. To analyze the effect of these moderator variables, we use a three-level hierarchical meta-regression model for dealing with multiple effect sizes from single studies. We found two intervention characteristics that explain variance in study effect sizes: longer lasting interventions result in larger effect sizes and interventions where hands-on experiments are applied are more effective than those utilizing virtual experiments. Furthermore, studies with a treatment-control group comparison have significantly smaller effect sizes than studies with a pre-post design. We discuss the implications of our findings regarding the moderator variables for effective teaching of FS and further research on FS. 相似文献
3.
Dylan Wiliam Christine Harrison Paul Black 《Assessment in Education: Principles, Policy & Practice》2004,11(1):49-65
While it is generally acknowledged that increased use of formative assessment (or assessment for learning) leads to higher quality learning, it is often claimed that the pressure in schools to improve the results achieved by students in externally‐set tests and examinations precludes its use. This paper reports on the achievement of secondary school students who worked in classrooms where teachers made time to develop formative assessment strategies. A total of 24 teachers (2 science and 2 mathematics teachers, in each of six schools in two LEAs) were supported over a six‐month period in exploring and planning their approach to formative assessment, and then, beginning in September 1999, the teachers put these plans into action with selected classes. In order to compute effect sizes, a measure of prior attainment and at least one comparison group was established for each class (typically either an equivalent class taught in the previous year by the same teacher, or a parallel class taught by another teacher). The mean effect size in favour of the intervention was 0.32. 相似文献
4.
Lindsay J. Flynn Xinhua Zheng H. Lee Swanson 《Learning disabilities research & practice》2012,27(1):21-32
This article synthesizes the experimental literature on reading interventions for upper elementary and middle school students identified with reading disabilities on norm‐referenced reading measures. Ten studies (12 independent samples) yielded 70 effect sizes on norm‐referenced reading measures with an aggregated mean of 0.41 (SE= .04) in favor of the experimental condition. Moderate effect sizes emerged on norm‐referenced measures of word identification (M= 0.41), decoding (M= 0.43), and comprehension (M= 0.73) and low effect sizes for fluency (M=–.29). Intervention outcomes did not significantly vary as a function of the reading skills measured, type of reading instruction, and/or variations in sample characteristics. Studies yielding low and relatively moderate effect sizes shared a number of instructional components. Overall, the magnitude of the results for experimental reading intervention studies for students with reading disabilities in the middle school age range was small to moderate. Implications of the study were discussed. 相似文献
5.
Robin S. Codding Matthew K. Burns Gracia Lukito 《Learning disabilities research & practice》2011,26(1):36-47
Mathematics fluency is a critical component of mathematics learning yet few attempts have been made to synthesize this research base. Seventeen single‐case design studies with 55 participants were reviewed using meta‐analytic procedures. A component analysis of practice elements was conducted and treatment intensity and feasibility were examined. Findings suggest that drill and practice with modeling produced the largest effect sizes. Treatments with more than 3 components yielded higher effect sizes than those with fewer than 3, and a combination of treatment agents lead to better outcomes than a single agent. Other findings pertaining to prebaseline assessment, treatment time, experimental design employed, and treatment setting are also discussed. 相似文献
6.
The purpose of this paper is to gain insight into the relationships between hands‐on experiences with formative assessment, students’ assessment preferences and their approaches to learning. The sample consisted of 108 university first‐year Bachelor’s students studying criminology. Data were obtained using the Revised two‐factor study process questionnaire (R‐SPQ‐2F) and the Assessment preferences inventory (API). The study shows that differences in assessment preferences are correlated with differences in approach to learning. Students’ preferences for assessment methods with higher‐order thinking tasks are significantly lower after actual experience with a formative assessment. Moreover, students also changed their approaches to learning after hands‐on experience with a formative mode of assessment. Surprisingly, this change evinced a more ‘surface approach’ to learning. Nevertheless, this is in line with other recent research findings. The paper ends with some possible explanations, and new directions for research are proposed. 相似文献
7.
The purpose of this pragmatic action research study was to explore our re‐conceptualization efforts in preparing pre‐service teachers to guide the inquiry process with formative assessment and subsequently use the understandings to improve our teacher preparation program. The process was guided by two questions: to what extent did course re‐conceptualization efforts lead to a more informed understanding of formative assessment by pre‐service teachers and did strategies enacted in the re‐conceptualized methods course foster or hinder pre‐service teachers' understanding of formative assessment? Data from this study support the following findings: (1) a substantial pre‐ to post‐methods course difference was realized in the pre‐service teachers' understanding of formative assessment; (2) explicit and contextualized approaches to formative assessment in the methods course led to increased understandings by pre‐service teachers; (3) an implicit approach led to improvements in course structure but did not foster pre‐service teachers' understanding of the reflexive nature of formative assessment; and (4) a field‐based case study on elementary science teaching both hindered and fostered our efforts with formative assessment. This study yields implications for pre‐service teacher education on formative assessment. To foster pre‐service teachers' knowledge and skills, we suggest explicit instruction on formative assessment combined with case studies, field experiences, and ongoing reflection. © 2009 Wiley Periodicals, Inc. J Res Sci Teach 47: 402–421, 2010 相似文献
8.
以大学英语课程教学为案例,通过行动研究,以考察形成性评价对学生学习态度、学习行为及结果的影响程度为目的。采用问卷调查、访谈、学生学习档案等工具采集数据。结果显示,形成性评价的应用确实能给学生的学习态度、动机及学习行为带来积极变化:大多数学生(70%以上)欢迎形成性评价在课堂教学中的应用;学生学习英语的信心更足、积极性更高;学生更愿意花更多时间在平时的学习过程中而非以往的考前突击应付、更注重培养和使用适合自己的学习策略;对学习成绩的提高也起到了良好的促进作用。 相似文献
9.
Stuart S. Yeh 《Educational Research Review》2009,4(1):7-15
The cost-effectiveness of class size reduction (CSR) was compared with the cost-effectiveness of rapid formative assessment, a promising alternative for raising student achievement. Drawing upon existing meta-analyses of the effects of student-teacher ratio, evaluations of CSR in Tennessee, California, and Wisconsin, and RAND cost estimates, CSR was found to be 124 times less cost effective than the implementation of systems that rapidly assess student progress in math and reading two to five times per week. Analysis of the results from California and Wisconsin suggest that the relative effectiveness of rapid formative assessment may be substantially underestimated. Further research regarding class size reduction is unlikely to be fruitful, and attention should be turned to rapid formative assessment and other more promising alternatives. 相似文献
10.
Genesis D. Arizmendi Jui‐Teng Li M. Lee Van Horn Stefania D. Petcu H. Lee Swanson 《Learning disabilities research & practice》2021,36(1):56-75
This meta‐analysis synthesized research on math performance outcomes for English learners (EL) as a function of language‐focused (math vocabulary) interventions. We included group and single‐subject design studies with children from kindergarten to 8th grade (3,766 students for group, 30 for single‐subject). Group studies yielded a mean Hedges’ g of 0.26 in favor of the interventions relative to the control conditions, whereas single‐subject studies yielded a mean Percentage of Non‐Overlapping Data of 81.01% and Phi coefficient of .66 relative to baseline. Although group studies yielded small effect sizes (ESs), we found significant moderators for grade level, intervention focus, and length of intervention. Single‐subject studies yielded higher ESs than group studies, and were considered generally effective, with a high ES. This finding was attributed to a direct focus on children with math difficulties and one‐to‐one instruction. The implications for practice and future research are discussed. 相似文献
11.
《British Educational Research Journal》2003,29(4):471-488
Two increasingly important strands in current educational thinking are reflected in growing interest amongst researchers, policy‐makers and qualification designers in formative assessment strategies that motivate learners and enhance their educational attainment. In addition, a body of research suggests that learners develop ‘learning careers’ from primary education, through the National Curriculum into post‐compulsory education and beyond. This article engages with this work in order to highlight some key factors in ‘learning careers’, particularly in relation to the impact of formative assessment practices. It aims to relate findings from research on formative assessment in primary and further education, carried out by the authors, to studies which use Bourdieu's notions of ‘habitus’, ‘field’, ‘cultural capital’ and ‘social capital’ to explore learning careers and learning identities in different sectors of education. The article evaluates whether the concept of ‘assessment careers’ illuminates a specific strand within young people's ‘learning careers’. In particular, it asks whether the concept might offer more precise insights about how practices produced by different assessment systems, particularly those purporting to promote formative assessment, affect learners' identities and dispositions for learning. 相似文献
12.
Birgit Schütze Elmar Souvignier Marcus Hasselhorn 《Zeitschrift für Erziehungswissenschaft》2018,21(4):697-715
Formative assessment is considered one of the most effective frameworks to foster learning. It is defined as assessment of student performance aimed at providing diagnostic information to improve teaching and learning. Basic characteristics of formative assessment are the clarification of learning goals, the diagnosis of individual performance, as well as the provision of feedback and individual differentiation based on the diagnostic information. The design of formative assessment varies from spontaneous on-the-fly assessment to planned and formalized curricular-embedded assessment. Studies support the positive effect of formative assessment on learning with its impact varying depending on the concrete implementation. Although there are developments in politics, science, and schools contributing to the implementation of formative assessment, transfer into practice remains challenging. The present paper describes the current state of research by defining and characterizing the construct, presenting empirical results on its efficacy, and by addressing developments and challenges associated with its implementation. 相似文献
13.
An assessment‐oriented design‐based research model was applied to existing inquiry‐oriented multimedia programs in astronomy, biology, and ecology. Building on emerging situative theories of assessment, the model extends prevailing views of formative assessment for learning by embedding “discursive” formative assessment more directly into the curriculum. Three twenty‐hour curricula were designed and aligned to content standards, and three levels of assessments were developed and used to assess and enhance learning for each curriculum. These assessments included three or four informal “activity‐oriented” quizzes and discursive formative feedback rubrics supporting collective discourse, a “curriculum‐oriented” examination of individual conceptual understanding, and a “standards‐oriented” test measuring aggregated achievement of targeted standards. After two design‐research cycles, worthwhile scientific argumentation and statistically significant gains were attained for two of the three packages on the exam and test. Achievement gains were comparable to or larger than those of students in comparison classrooms. Many existing innovations could be enhanced and evaluated in this fashion; designing these strategies directly into innovations could have an even greater impact on discourse, understanding, and achievement. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 1240–1270, 2012 相似文献
14.
AbstractTechnology-facilitated peer assessment is gaining increasing attention. However, evidence for the contribution of technology-facilitated peer assessment to learning achievements has not been investigated. The present meta-analysis integrated findings on the effects of technology-facilitated peer assessment based on two main elements: (1) technology-facilitated peer assessment, (2) the use of extra supporting strategies in technology-facilitated peer assessment. A total of 37 empirical studies published from 1999 to 2018 were selected and analysed. Results indicated that technology-facilitated peer assessment had a significant and medium effect on learning achievements with an overall mean effect size of 0.576. The use of extra supporting strategies in technology-facilitated peer assessment also produced a positive and medium effect on students’ learning achievements with an overall mean effect size of 0.543. Different moderator variables, such as task types, assessment modes, training for assessors, durations, grouping types and assessment methods were related to different effect sizes. The results together with the implications for both practice and research are discussed. 相似文献
15.
Among contemporary means of enhancing student learning, formative assessment is perhaps one of the most important and effective. While formative assessment ideas and practices have been shown to have a proven record enhancing student learning, these practices are slow to be fully integrated into teachers’ day-to-day classroom practices. This study describes a collaborative effort among university faculty and public school partners to train teachers in the skills and practices of formative assessment. Regarding teachers’ involvement in the formative assessment professional development, findings highlight that 1) teachers’ participation in the professional development efforts did strengthen their understanding of both general knowledge of formative assessment and the use of formative assessment practices, 2) teachers’ plans to use the strategies in the future were related to their understanding of these strategies, and 3) in-depth and comprehensive understanding of formative assessment practices were critical to concrete applications of such practices in their classrooms. With respect to the impact on student learning, an overall effect size of .41 was found for teachers who utilized a formative assessment strategy compared with district averages for similar learning objectives when the practices were not used. 相似文献
16.
17.
Yaacov Petscher 《Journal of Research in Reading》2010,33(4):335-355
A meta‐analysis of the relationship between attitudes in reading and achievement in reading was conducted to provide a statistical summary to the observed variability in the magnitude of previously reported effect sizes. A total of 32 studies, with a total sample size of 224,615 were used, and included a total of 118 effect sizes. A multi‐level approach was used in meta‐analysis to determine if variance in the magnitude of effect sizes could be partitioned to study (level 1) and moderator (level 2) levels by using a mixed model approach. Results from the meta‐analysis indicated that the mean strength of the relationship between reading attitudes and achievement is moderate (Zr=.32), while stronger for students in elementary school (Zr=.44) when compared with middle school students (Zr=.24). Findings related to selected moderator variables are discussed, with suggestions for future research. 相似文献
18.
Stephen Gorard 《International Journal of Research & Method in Education》2015,38(2):105-114
This paper revisits the use of effect sizes in the analysis of experimental and similar results, and reminds readers of the relative advantages of the mean absolute deviation as a measure of variation, as opposed to the more complex standard deviation. The mean absolute deviation is easier to use and understand, and more tolerant of extreme values. The paper then proposes the use of an easy to comprehend effect size based on the mean difference between treatment groups, divided by the mean absolute deviation of all scores. Using a simulation based on 1656 randomised controlled trials each with 100 cases, and a before and after design, the paper shows that the substantive findings from any such trial would be the same whether raw-score differences, a traditional effect size like Cohen's d, or the mean absolute deviation effect size is used. The same would be true for any comparison, whether for a trial or a simpler cross-sectional design. It seems that there is a clear choice over which effect size to use. The main advantage in using raw scores as an outcome measure is that they are easy to comprehend. However, they might be misleading and so perhaps require more judgement to interpret than traditional ‘effect’ sizes. Among the advantages of using the mean absolute deviation effect size are its relative simplicity, everyday meaning, and the lack of distortion of extreme scores caused by the squaring involved in computing the standard deviation. Given that working with absolute values is no longer the barrier to computation that it apparently was before the advent of digital calculators, there is a clear place for the mean absolute deviation effect size (termed ‘A’). 相似文献
19.
Investigating the effectiveness of instructional practices provides an evidence base to inform instructional decisions. Synthesizing research studies on instructional effectiveness provides an estimate of the generalizability of effectiveness across settings, along with an exploration of factors that may moderate the impact, which cannot be achieved within individual studies. This study sought to provide a synthesis of evidence-based instructional practices (EBIPs) particular to chemistry through meta-analysis. Ninety-nine studies were analyzed comprising a broader view of chemistry specific studies than past meta-analyses. The results showed that EBIPs feature a demonstrably positive impact on students' academic performance in chemistry, although assessment topic coverage and setting size emerged as relevant moderators of impact and prevented making definitive conclusions of the relative impact of each EBIP. In examining publication bias, an asymmetric distribution of studies based on standard error (SE) and effect size was found, indicative of potential publication bias. To explore the potential impact of bias, the trim and fill method was employed resulting in a range for the overall weighted effect size from 0.29 to 0.62. The study concludes that evidence-based instructional practices have demonstrated effectiveness even in consideration of potential publication bias, as the range of effect sizes remains positive, but highlights the continued need to publish null findings in the research literature. 相似文献
20.
ABSTRACTThis study investigates the relationship between students’ attitudes towards formative assessment and summative assessment and aims to enrich the understanding of formative and summative assessment from the students’ perspective. A total of 3,019 Hong Kong primary school students responded to a newly developed instrument. Overall, students reported positive instrumental yet negative affective attitudes towards formative and summative assessment. Girls had less negative affective attitudes towards formative assessment, but more positive instrumental attitudes towards formative and summative assessment than boys. Grade 4 students consistently scored higher than Grade 5 and Grade 6 students in assessment attitudes. The gender and grade differences were statistically significant, but had small effect size. Moreover, it was found that students’ affective and instrumental attitudes to formative assessment positively predicted students’ affective and instrumental attitudes to summative assessment. 相似文献