共查询到20条相似文献，搜索用时 744 毫秒
1.
Marsha Ing 《教育实用测度》2013,26(2):122-131
ABSTRACTDrawing inferences about the extent to which student performance reflects instructional opportunities relies on the premise that the measure of student performance is reflective of instructional opportunities. An instructional sensitivity framework suggests that some assessments are more sensitive to detecting differences in instructional opportunities compared to other assessments. This study applies an instructional sensitivity framework to compare student performance on two different mathematics achievement measures across five states and three grade levels. Results suggest a range of variation in student performance among teachers on the same mathematics achievement measure, variation between the two different mathematics achievement measures, and variation between grade levels within the same state. Findings highlight initial considerations for educators interested in selecting and evaluating measures of student performance that are reflective of instructional opportunities. 相似文献
2.
Morgan S. Polikoff 《Educational Measurement》2010,29(4):3-14
Standards-based reform, as codified by the No Child Left Behind Act, relies on the ability of assessments to accurately reflect the learning that takes place in U.S. classrooms. However, this property of assessments—their instructional sensitivity—is rarely, if ever, investigated by test developers, states, or researchers. In this paper, the literature on the psychometric property of instructional sensitivity is reviewed. Three categories of instructional sensitivity measures are identified—those relying on item or test scores only, those relying on item or test scores and teacher reports of instruction, and strictly judgmental methods. Each method identified in the literature is discussed alongside the evidence for its utility. Finally, recommendations are made as to the proper role of instructional sensitivity in the evaluation of assessments used under standards-based reform. 相似文献
3.
Maria Araceli Ruiz‐Primo Min Li Kellie Wills Michael Giamellaro Ming‐Chih Lan Hillary Mason Deanna Sands 《科学教学研究杂志》2012,49(6):691-712
The purpose of this article is to address a major gap in the instructional sensitivity literature on how to develop instructionally sensitive assessments. We propose an approach to developing and evaluating instructionally sensitive assessments in science and test this approach with one elementary life‐science module. The assessment we developed was administered to 125 students in seven classrooms. The development approach considered three dimensions of instructional sensitivity; that is, assessment items should: represent the curriculum content, reflect the quality of instruction, and have formative value for teaching. Focusing solely on the first dimension, representation of the curriculum content, this study was guided by the following research questions: (1) What science module characteristics can be systematically manipulated to develop items that prove to be instructionally sensitive? and (2) Are the instructionally sensitive assessments developed sufficiently valid to make inferences about the impact of instruction on students' performance? In this article, we describe our item development approach and provide empirical evidence to support validity arguments about the developed instructionally sensitive items. Results indicated that: (1) manipulations of the items at different proximities to vary their sensitivity were aligned with the rules for item development and also corresponded with pre‐to‐post gains; and (2) the items developed at different distances from the science module showed a pattern of pre‐to‐post gain consistent with their instructional sensitivity, that is, the closer the items were to the science module, the larger the observed gains and effect sizes. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 691–712, 2012 相似文献
4.
Students' perceptions of instructional quality have become an important information source for teachers' professional development. This requires knowledge of the structure of these perceptions, their validity, and generalizability. To this end, we conducted a study with 15,005 German 512 grade students from 690 classrooms in three different school types and three different grade levels. Assuming three basic dimensions of instructional quality with 7 facets, we investigated the factorial structure of students' perceptions with two-level confirmatory factor analyses as well as their generalizability with two-level measurement invariance analyses. Our results confirmed the postulated factorial structure and strict invariance across subject groups, school types, and grade levels. We confirmed the same structure in teachers' assessments of their instructional quality that were positively correlated with the students' assessments. As such, these findings shed light on the structure, validity, and generalizability of students’ perceptions of instructional quality. 相似文献
5.
William A. Firestone Jan Winter John Fitz 《Assessment in Education: Principles, Policy & Practice》2000,7(1):13-37
Recently, the state has used testing more extensively to influence instructional practice. But how much do assessments actually influence practice? To explore this issue, we observed middle-grade mathematics teachers in England and Wales with their highly aligned curriculum and assessment system and two US states with performance-based assessment systems promoting more thoughtful instruction. Maryland's tests had higher stakes attached to them than Maine's. Our observations suggest that testing policies can influence the content taught and promote certain kinds of teaching to the test but that basic instructional practices, like the kind of explanation teachers offer to students and the intellectual challenge of the work, are more difficult to influence. We suggest three hypotheses for the apparent stability in underlying teaching practice. First, some testing policies do not challenge those practices. Second, assessments that do challenge current practice may not be accompanied by adequate professional development to help teachers change practice. Finally, teachers' knowledge and beliefs about teaching mathematics are so deeply embedded that they are difficult to influence. 相似文献
6.
The purpose of this documentary account is twofold. First, we describe two strategic instructional assignments embedded in university courses at a large research institution in the United States that were designed to help teaching candidates move toward mastery. Second, we explicate candidates' performances on the assessments as well as evidence of the reliability of the assessments and scoring procedures. This case study provides evidence that advanced secondary teaching candidates are able to address instructional issues and engage in the kind of pedagogical reasoning more characteristic of experienced teachers. Further, this account indicates that despite some challenges, it is feasible for multiple course instructors in a research institution to implement and score reliable, valid embedded assessments. 相似文献
7.
David Niemi Jia Wang Diane H. Steinberg Eva L. Baker Haiwen Wang 《Educational Assessment》2013,18(3-4):215-237
Validation of assessments intended to improve instruction and learning should include evidence of instructional sensitivity. This study investigated the instructional sensitivity of a standards-based ninth-grade performance assessment that required students to write an essay about conflict in a literary work. Before administering the assessment, teachers of 886 ninth-grade students were randomly assigned to one of three instructional groups: literary analysis, organization of writing, and teacher-selected instruction. Despite the short duration of instruction (8 class periods), results support the instructional sensitivity of the assessment in two ways: Instruction on literary analysis significantly improved students' ability to analyze and describe conflicts in literature, and instruction on the organization of writing led to significantly higher scores on measures of coherence and organization. 相似文献
8.
Reform efforts have emphasized the need to support teachers' learning about reform‐oriented practices. Educative curriculum materials are one potential vehicle for promoting teacher learning about these practices. Educative curriculum materials include supports that are intended to promote both student and teacher learning. However, little is known about the extent to which existing curriculum materials provide support for teachers and the ways they can be improved. In this study, eight sets of high school biology curriculum materials were reviewed to determine their potential for promoting teacher learning. Design heuristics for educative curriculum materials were adapted for use as evaluation criteria. From this analysis, several themes emerged. First, the materials tended to provide support for teachers' subject matter knowledge and pedagogical content knowledge for students' ideas (e.g., misconceptions) but rarely for their pedagogical content knowledge of scientific inquiry. Second, the materials contained several implementation guidance supports but far fewer rationales for instructional decisions, which are an important feature of educative curriculum materials. Finally, the quality of support varied widely, differing in its degree of relevance, pedagogical helpfulness, and depth. The article concludes with recommendations for the redesign of existing curriculum materials. © 2009 Wiley Periodicals, Inc. J Res Sci Teach 46: 977–998, 2009 相似文献
9.
Wayne Camara 《Educational Measurement》2013,32(4):16-27
This article reviews the intended uses of these college‐ and career‐readiness assessments with the goal of articulating an appropriate validity argument to support such uses. These assessments differ fundamentally from today's state assessments employed for state accountability. Current assessments are used to determine if students have mastered the knowledge and skills articulated in state standards; content standards, performance levels, and student impact often differ across states. College‐ and career‐readiness assessments will be used to determine if students are prepared to succeed in postsecondary education. Do students have a high probability of academic success in college or career‐training programs? As with admissions, placement, and selection tests, the primary interpretations that will be made from test scores concern future performance. Statistical evidence between test scores and performance in postsecondary education will become an important form of evidence. A validation argument should first define the construct (college and career readiness) and then define appropriate criterion measures. This article reviews alternative definitions and measures of college and career readiness and contrasts traditional standard‐setting methods with empirically based approaches to support a validation argument. 相似文献
10.
Nader Wahbeh 《International Journal of Science Education》2013,35(3):425-466
This study (a) assessed the influence of an integrated nature of science (NOS) instructional intervention on inservice secondary science teachers' understandings, retention of those understandings, and their NOS instructional planning and practices; and (b) examined factors that mediated the translation of teachers' NOS understandings into practice. Nineteen teachers participated in an intensive, 6-week NOS course, which concluded with teachers developing plans to address NOS in their classrooms. Next, 6 participants were observed as they implemented their instructional plans. Data sources included pretest, posttest, and delayed-test NOS assessments, classroom observations, and several teacher-generated artifacts. The NOS course was effective in helping teachers develop informed NOS conceptions and retain those understandings 5 months after its conclusion. Teachers met with challenges and successes as they attempted to address NOS instructionally. The translation of NOS conceptions into practice was primarily mediated by the very nature of teachers' newly acquired NOS understandings, which were situated within the science contents, contexts, and experiences in which they were developed (i.e. the NOS course); thus, limiting participants' abilities to transfer their understandings into novel contexts and contents. The results helped build a model of the sources of science teachers' pedagogical content knowledge for teaching about NOS in content-rich contexts. 相似文献
11.
Mikyung Kim Wolf Danielle Guzman-Orth Alexis Lopez Katherine Castellano Igor Himelfarb Fred S. Tsutagawa 《Educational Assessment》2016,21(3):157-175
This article investigates ways to improve the assessment of English learner students' English language proficiency given the current movement of creating next-generation English language proficiency assessments in the Common Core era. In particular, this article discusses the integration of scaffolding strategies, which are prevalently utilized as an instructional strategy for English learner students, into the design of technology-enhanced assessment tasks. The article includes sample tasks and student responses to illustrate the design of scaffolding assessment tasks and their potential to increase the accuracy of measuring students' English language proficiency. We also explore possible scoring and psychometric models for the scaffolding tasks in large-scale standardized assessments. 相似文献
12.
Although there is a common understanding of instructional sensitivity, it lacks a common operationalization. Various approaches have been proposed, some focusing on item responses, others on test scores. As approaches often do not produce consistent results, previous research has created the impression that approaches to instructional sensitivity are noticeably fragmented. To counter this impression, we present an item response theory–based framework that can help us to understand similarities and differences between existing approaches. Using empirical data for illustration, this article identifies three perspectives on instructional sensitivity: One perspective views instructional sensitivity as the capacity to detect differences in students' stages of learning across points of time. A second perspective treats instructional sensitivity as the capacity to detect differences between groups that have received different instruction. For a third perspective, the previous two are combined to consider differences between both time points and groups. We discuss linking sensitivity indices to measures of instruction. 相似文献
13.
Maryl Gearhart Sam Nagashima Jennifer Pfotenhauer Shaunna Clark Cheryl Schwab Terry Vendlinski 《Educational Assessment》2013,18(3-4):237-263
This article reports findings on growth in 3 science teachers' expertise with interpretation of student work over 1 year of participation in a program. The program was designed to strengthen classroom assessment. Using a framework for classroom assessment expertise, we analyze patterns of teacher learning, and the roles of the professional program and the quality of the assessments provided with teachers' instructional materials. 相似文献
14.
Existing research indicates inconsistent or at best weak predictive effects of teacher knowledge on student achievement. Data from Germany were used to examine the relation between teachers' content and pedagogical content knowledge, their perception, interpretation, and decision-making skills, the instructional quality implemented in class, and students' learning progression in mathematics. Rather than direct effects of teacher knowledge on students, we hypothesized an effect chain with multiple mediation processes while controlling for school type and student background. Multi-level modeling with 3496 students from 154 classrooms revealed a mediating role of teachers' skills and their instructional quality for the relation between teacher knowledge and students' learning progress. Effect sizes were medium to strong, and the model explained a large amount of variance. No direct effects of teachers’ knowledge on student progress were found. We discuss our findings with respect to the teacher-competence-as-a-continuum model and with respect to future research. 相似文献
15.
《Pedagogies: An International Journal》2013,8(2):105-122
Today, pedagogical methods are primarily determined by the needs of nation states to prepare workers for the global economy. Nations have combined economic and educational planning into an educational security state where pedagogy is controlled through a system of assessments of students and teachers. Both teachers and students become subservient to an industrial–consumer paradigm that integrates education and economic planning. This educational model has prevailed over classical forms of education such as Confucianism, Islam, and Christianity and their concerns with creating a just and ethical society through the analysis and discussion of sacred and classical texts. It has also prevailed over progressive pedagogy designed to prepare students to reconstruct society. In the 21st century, national school systems have similar grades and promotion plans, instructional methods, curriculum organisation, and linkages between secondary and higher education. Most national school systems are organised to serve an industrial–consumer state. As later explained, the industrial–consumer state is premised on the idea that a good society involves economic growth resulting from increased production and consumption of goods. In the industrial–consumer state, education is organised to serve the goal of economic growth. The purpose of this article is to explain the globalisation of the common characteristics of national school systems and instructional methods and their potential consequences for human life. Despite the similarities of national school systems, there continues to exist classical and progressive pedagogies that are often in conflict with the goals of the industrial consumer state. These alternative pedagogies continue to play important roles in global educational discussions. 相似文献
16.
In the decade since alternate assessments based on alternate achievement standards (AA-AAS) were first required, special education teachers have had to develop content knowledge and pedagogical skills to teach academics to students with significant cognitive disabilities. The purpose of this study is to examine the impact that teachers' instructional decisions and beliefs about AA-AAS have on the academic achievement of students with significant cognitive disabilities. A survey of nearly 400 teachers across three states provided evidence of teachers' beliefs, as well as their instructional planning processes for students. Students' learning characteristics were also identified. Survey responses were analyzed in conjunction with students' 2010–2011 scores on their statewide AA-AAS. The results indicated that students with presymbolic communication systems had a lower likelihood of achieving proficiency in English language arts/reading and math than students with abstract symbolic communication. Students with concrete symbolic communication systems had lesser odds of proficiency in ELA/reading but not in math. Teachers who agreed that AA-AAS had an impact on instruction tended to have students with higher achievement proficiency. However, more negative views of the validity of AA-AAS scores were associated with greater odds of proficiency. 相似文献
17.
Since the publication of A Nation at Risk, some scholars have argued that a national curriculum and national testing are necessary to hold school personnel accountable for student achievement and, ultimately, to raise educational standards. The idea of developing a nationwide curriculum has been widely debated in the United States, where the traditions of local control and state responsibility are dominant. Thus, this article examines the relevance and feasibility of a uniform curriculum in physical education. A core curriculum for physical education has the potential to provide clear goals, coherent instructional guidelines, and relevant assessments aligned with designated program outcomes. A more advanced curricula framework with clear guidance for P-12 curricula and pedagogical practices could promote system-wide changes in school-based physical education. In contrast, the adoption of an overly rigid national curriculum would create a stifling educational context where cultural differences and local flexibility are not allowed. 相似文献
18.
19.
ABSTRACTThe purpose of this article is to explore how pedagogical visions inform our work as former classroom teachers and current teacher educators in rural and urban regions of the United States. Specifically, we explore the instructional decisions we make as we work to meet these visions in higher education. Teacher educators are charged with the task of fostering visionary teachers in today’s highly challenging educational landscape. We pose the question: How can teacher educators foster visionary beginning teachers without an examination of their visions for their practice? Using a self-study design, we examine the intersections of our pedagogical visions for teaching and the instructional actions we take to work toward our visions in higher education. Findings highlight specific instructional practices and strategies used to enact visions while providing a critical discussion of the lens of visioning within self-study research. 相似文献
20.
This article uses the framework of technological pedagogical content knowledge (TPACK; Mishra & Koehler, 2006) to analyze findings across projects from the U.S. Department of Education's Preparing Tomorrow's Teachers to Use Technology (PT3) initiative. Approaches such as mentoring methods course faculty, teachers, and creating technology-rich instructional materials were associated with increases in preservice teachers' technological knowledge and their frequency of technology-rich instruction during field experiences. Lastly, the authors provide implications and directions for future analyses of technology integration efforts. 相似文献