首页 | 本学科首页   官方微博 | 高级检索  
相似文献
 共查询到20条相似文献，搜索用时 703 毫秒
1.
Drawing valid inferences from modern measurement models is contingent upon a good fit of the data to the model. Violations of model‐data fit have numerous consequences, limiting the usefulness and applicability of the model. As Bayesian estimation is becoming more common, understanding the Bayesian approaches for evaluating model‐data fit models is critical. In this instructional module, Allison Ames and Aaron Myers provide an overview of Posterior Predictive Model Checking (PPMC), the most common Bayesian model‐data fit approach. Specifically, they review the conceptual foundation of Bayesian inference as well as PPMC and walk through the computational steps of PPMC using real‐life data examples from simple linear regression and item response theory analysis. They provide guidance for how to interpret PPMC results and discuss how to implement PPMC for other model(s) and data. The digital module contains sample data, SAS code, diagnostic quiz questions, data‐based activities, curated resources, and a glossary.  相似文献   

2.
In this ITEMS module, we introduce the generalized deterministic inputs, noisy “and” gate (G‐DINA) model, which is a general framework for specifying, estimating, and evaluating a wide variety of cognitive diagnosis models. The module contains a nontechnical introduction to diagnostic measurement, an introductory overview of the G‐DINA model, as well as common special cases, and a review of model‐data fit evaluation practices within this framework. We use the flexible GDINA R package, which is available for free within the R environment and provides a user‐friendly graphical interface in addition to the code‐driven layer. The digital module also contains videos of worked examples, solutions to data activity questions, curated resources, a glossary, and quizzes with diagnostic feedback.  相似文献   

3.
Although much research has been conducted on the psychometric properties of cognitive diagnostic models, they are only recently being used in operational settings to provide results to examinees and other stakeholders. Using this newer class of models in practice comes with a fresh challenge for diagnostic assessment developers: effectively reporting results and supporting end users to accurately interpret results. Achieving the goal of communicating results in a way that leads users of the assessment to make accurate interpretations requires a prerequisite step that cannot be taken for granted. The assessment developers must first accurately interpret results from a psychometric, or measurement, standpoint. Through this article, we seek to begin a discussion about reasonable interpretations of the results that classification‐based models provide about examinees. Interpretations from published research and ongoing practice show different—and sometimes conflicting—ways to interpret these results. This article seeks to formalize a comparison, critique, and discussion among the interpretations. Before beginning this discussion, we first present background on the results provided by classification‐based models regarding the examinees. We then structure our discussion around key questions an assessment development team needs to answer themselves prior to constructing reports and interpretative guides for end users of the assessment.  相似文献   

4.
The purpose of this study is to explore the reliability of a potentially more practical approach to direct writing assessment in the context of ESL writing. Traditional rubric rating (RR) is a common yet resource-intensive evaluation practice when performed reliably. This study compared the traditional rubric model of ESL writing assessment and many-facet Rasch modeling (MFRM) to comparative judgment (CJ), the new approach, which shows promising results in terms of reliability. We employed two groups of raters—novice and experienced—and used essays that had been previously double-rated, analyzed with MFRM, and selected with fit statistics. We compared the results of the novice and experienced groups against the initial ratings using raw scores, MFRM, and a modern form of CJ—randomly distributed comparative judgment (RDCJ). Results showed that the CJ approach, though not appropriate for all contexts, can be as reliable as RR while showing promise as a more practical approach. Additionally, CJ is easily transferable to novel assessment tasks while still providing context-specific scores. Results from this study will not only inform future studies but can help guide ESL programs in selecting a rating model best suited to their specific needs.  相似文献   

5.
The increased availability of computational modeling software has created opportunities for students to engage in scientific inquiry through constructing computer‐based models of scientific phenomena. However, despite the growing trend of integrating technology into science curricula, educators need to understand what aspects of these technologies promote student learning. This study used a multi‐method research approach involving both quantitative (Paper 1) and qualitative data (Paper 2) to examine student conceptual understanding of astronomical phenomena, relative to two different instructional experiences. Specifically, based on students' understandings of both spatial and declarative knowledge, we compared students who had constructed three‐dimensional computational models with students who had experienced traditional lecture‐based instruction. Quantitative analysis of pre‐interview and post‐interview data revealed that construction of three‐dimensional models best facilitated student understandings of spatially related astronomical concepts — whereas traditional instruction techniques best facilitated student understandings of fact‐oriented astronomical knowledge. This paper is the first in a two‐paper set that continues our line of research into whether problem‐based courses such as the Virtual Solar System course can be used as a viable alternative to traditional lecture‐based astronomy courses.  相似文献   

6.
Government‐sponsored student loans have emerged over the decades as a primary method of financing post‐secondary education across most North American jurisdictions. Despite this, the empirical literature examining the correlates of repayment difficulty and default in Canada has remained stagnant in recent years. This study taps into an underutilised data source—the 2013 National Graduates Survey—to examine the relationship between demographics, human capital, borrowing behaviour and other known predictors and repayment difficulty. Our logistic regression models demonstrate that disability status, geographic region and borrowing behaviour are correlated with loan default and repayment difficulty, while failing to verify the existence of other demographic effects routinely found in the existing literature. We discuss the implications of these findings, along with multiple avenues for further empirical work on this topic within Canada.  相似文献   

7.
At the junction of scientific research and practical experience, this article calls for attention to the topic of performance feedback. It clearly describes what good performance feedback is and analyzes the reasons why establishing feedback‐providing practices in modern organizations can be challenging. The authors suggest a simple three‐step model for giving fair performance feedback along with a series of steps leaders could take to become better at managing and developing their people. Organizational aspects of the role of feedback in talent management are also discussed.  相似文献   

8.
This study evaluates four growth prediction models—projection, student growth percentile, trajectory, and transition table—commonly used to forecast (and give schools credit for) middle school students' future proficiency. Analyses focused on vertically scaled summative mathematics assessments, and two performance standards conditions (high rigor and low rigor) were examined. Results suggest that, when “status plus growth” is the accountability metric a state uses to reward or sanction schools, growth prediction models offer value above and beyond status‐only accountability systems in most, but not all, circumstances. Predictive growth models offer little value beyond status‐only systems if the future target proficiency cut score is rigorous. Conversely, certain models (e.g., projection) provide substantial additional value when the future target cut score is relatively low. In general, growth prediction models' predictive value is limited by a lack of power to detect students who are truly on‐track. Limitations and policy implications are discussed, including the utility of growth projection models in assessment and accountability systems organized around ambitious college‐readiness goals.  相似文献   

9.
Radiology and radiologists are recognized as increasingly valuable resources for the teaching and learning of anatomy. State‐of‐the‐art radiology department workstations with industry‐standard software applications can provide exquisite demonstrations of anatomy, pathology, and more recently, physiology. Similar advances in personal computers and increasingly available software can allow anatomy departments and their students to build their own three‐dimensional virtual models. Appropriate selection of a data‐set, followed by processing and presentation are the key steps in creating virtual models. The construction, presentation, clinical application, and educational potential of postprocessed imaging techniques including multiplanar reformats, minimum intensity projections, segmentation, volume‐rendering, surface‐rendering, fly‐throughs, virtual endoscopy, angiography, and cine‐loops are reviewed using examples created with only a personal computer and freeware software. Although only static images are presented in this article, further material is available online within the electronic version of this article. Through the use of basic and advanced image reconstruction and also paying attention to optimized presentation and integration, anatomy courses can be strengthened with appropriate radiological material. There are several key advantages for the anatomy department, which is equipped with the ability to produce virtual models using radiology images: (1) Opportunities to present anatomy using state‐of‐the‐art technology as an adjunct to current practices, (2) a means to forge an improved relationship with the local radiology department, and (3) the ability to create material locally, which is integrated with the local curriculum avoiding the problem of information overload when using the internet or other commercially available resources. Anat Sci Educ 3:261–266, 2010. © 2010 American Association of Anatomists.  相似文献   

10.
From its inception, the field of Mind, Brain, and Education (MBE) has been conceived as an interdisciplinary science, and with good reason: The phenomena the field aims to understand often arise from interactions among multiple factors, span levels of analysis, and are context dependent. In this article, we argue that to reach its potential as an interdisciplinary science—and in order to explain such complex phenomena—MBE must be fundamentally organized around meaningful, discipline‐spanning questions, and the questions must determine tools and research methods (not the other way around). Using examples from three central questions in MBE—“who,”“when,” and “how”—we highlight the limits of single disciplines, and the value of a question‐driven interdisciplinary approach in MBE, with respect to questions that can be asked, the perspectives that can be considered, and the array of methods, tools, and models that can be made available. We believe that the future is bright for MBE, and that the field has a unique opportunity to provide meaningful answers to some of the most difficult questions in education today. However, realizing this potential depends on, as a first step, allowing the questions themselves to drive the field's work moving forward.  相似文献   

11.
Checklists have been widely used in the aviation industry ever since aircraft operations became more complex than any single pilot could reasonably remember. More recently, checklists have found their way into medicine, where cognitive function can be compromised by stress and fatigue. The use of checklists in medical education has rarely been reported, especially in the basic sciences. We explored whether the use of a checklist in the gross anatomy laboratory would improve learning outcomes, dissection quality, and students' satisfaction in the first-year Human Structure didactic block at Mayo Medical School. During the second half of a seven-week anatomy course, dissection teams were each day given a hardcopy checklist of the structures to be identified during that day's dissection. The first half of the course was considered the control, as students did not receive any checklists to utilize during dissection. The measured outcomes were scored on four practice practical examinations and four dissection quality assessments, two each from the first half (control) and second half of the course. A student satisfaction survey was distributed at the end of the course. Examination and dissection scores were analyzed for correlations between practice practical examination score and checklist use. Our data suggest that a daily hardcopy list of anatomical structures for active use in the gross anatomy laboratory increases practice practical examination scores and dissection quality. Students recommend the use of these checklists in future anatomy courses.  相似文献   

12.
The purpose of this project was to develop Web‐based learning modules that combine (1) animated 3D graphics; (2) 3D models that a student can manipulate independently; (3) passage of time in embryonic development; and (4) animated 2D graphics, including 2D cross‐sections that represent different “slices” of the embryo, and animate in parallel. These elements were presented in two tutorials, one depicting embryonic folding and the other showing development of the nervous system after neural tube formation. The goal was to enhance the traditional teaching format—lecture combined with printed diagrams, text, and existing computer animations—with customized, guided, Web‐based learning modules that surpassed existing resources. To assess module effectiveness, we compared quiz performance of control groups who attended lecture and did not use a supporting module, with study groups who used a module in addition to attending lecture. We also assessed our students' long‐term retention of the material, comparing classes who had used the module with students from a previous year that had not seen the module. Our data analysis suggests that students who used a module performed better than those given only traditional resources if they used the module after they were already somewhat familiar with the material. The findings suggest that our modules—and possibly computer‐assisted‐instruction modules in general—are more useful if used toward the later stages of learning, rather than as an initial resource. Furthermore, our data suggest that the animation aids in long‐term retention. Both medical students at the University of Cincinnati and medical faculty from across the country commented favorably on their experiences with the embryonic development modules. Anat Sci Ed 1:252–257, 2008. © 2008 American Association of Anatomists.  相似文献   

13.
Recent advances have enabled diagnostic classification models (DCMs) to accommodate longitudinal data. These longitudinal DCMs were developed to study how examinees change, or transition, between different attribute mastery statuses over time. This study examines using longitudinal DCMs as an approach to assessing growth and serves three purposes: (1) to define and evaluate two reliability measures to be used in the application of longitudinal DCMs; (2) through simulation, demonstrate that longitudinal DCM growth estimates have increased reliability compared to longitudinal item response theory models; and (3) through an empirical analysis, illustrate the practical and interpretive benefits of longitudinal DCMs. A discussion describes how longitudinal DCMs can be used as practical and reliable psychometric models when categorical and criterion‐referenced interpretations of growth are desired.  相似文献   

14.
School‐based practitioners are often called upon to provide assessment and recommendations for struggling students. These assessments often open doors to specialised services or interventions and provide opportunities for students to build competencies in areas of need. However, these assessments often fail to highlight the abilities of these students and instead focus on areas in need of remediation. The use of a more positive, or strengths‐based, approach to working with students is needed. Although strengths‐based assessment (SBA) is not a new concept, it is not routinely incorporated into school‐based assessment services. This article provides an overview of SBA and its benefits, along with empirically‐driven models that support the implementation of SBA in schools, and calls for a renewed focus on understanding students from a strengths‐based model. Examples of SBA measures and techniques are included, along with implications for practice for both students and psychologists.  相似文献   

15.
Key elements of the structure and function of models in mathematics and science are identified. These elements are used as a basis for discussing the development of model‐based reasoning. A microgenetic study examines the beginnings of model‐based reasoning in a pair of fourth‐ and fifth‐grade children who solved several problems about chance and probability. Results are reported in the form of a cognitive model of children's problem‐solving performance. The cognitive model explains a transition in children's reasoning from tacit reliance on empirical regularity to a form of model‐based reasoning. Several factors fostering change in children's thinking are identified, including the role of notations, peer interaction, and teacher assistance. We suggest that model‐based reasoning is a slowly‐developing capability that emerges only with proper contextual and social support and that future study should be carried out in classrooms, where these forms of assistance can also be part of the object of study.

Model‐based reasoning is a significant intellectual milestone because it bridges the worlds of personal, intuitive knowledge, on the one hand, and mathematical‐scientific theory, on the other. However, across disciplines, consensus is still forming about what model‐based reasoning comprises, and there is little knowledge about its ontogenetic origins or how it develops. We consider analogy as the core of modeling, because in model‐based reasoning a system in one domain is used to understand a system in another. To understand how models come to play a role in reasoning, it is important to initiate study of their origins. Accordingly, we report a microgenetic study examining the beginnings of model‐based reasoning in a pair of young children solving problems about chance and probability. In this study we are engaged in the enterprise of modeling the development of modeling. That is, we report our results in the form of a cognitive model of children's problem‐solving performance that explains a transition in reasoning from a tacit reliance on empirical regularity to a form of model‐based reasoning. It is important to note the two distinct meanings for the term model used in this article. The first describes how children come to understand and appropriate a system of reasoning exemplified in practices of modeling. The second describes a research tool, a model of human reasoning—specifically, how children in this study began to use models of probability to reason about uncertain events. In this report, we use the terms model or model‐based reasoning to refer to the former interpretation, whereas references to a cognitive model denote the simulation of children's thinking—in this case, implemented as a computer program.

Before describing the empirical work, we first identify some key elements of the structure and function of models. Next, these elements of modeling are used as the basis for generating some conjectures about the development of model‐based reasoning. We describe a task that we used as a window to understanding progression in student reasoning toward reliance on models as tools for thought. We present our rationale for developing cognitive models of student performance and explain some choices concerning the implementation of the cognitive model reported here. Finally, we turn to the children's performance on chance and probability tasks and explain how that performance illuminates both what children do not understand about models and the kinds of relevant knowledge that they are acquiring.  相似文献   

16.
A new entry in the testing lexicon is through‐course summative assessment, a system consisting of components administered periodically during the academic year. As defined in the Race to the Top program, these assessments are intended to yield a yearly summative score for accountability purposes. They must provide for both individual and group proficiency estimates and allow for the measurement of growth. They must accommodate students who vary in their patterns of curricular exposure. Because they are meant to provide actionable information to teachers they must be instructionally sensitive, so item‐operating characteristics can be expected to change relative to one another as a function of patterns of curricular exposure. This paper discusses methodology one can draw upon to tackle this ambitious collection of inferences. We consider a modeling framework that consists of an item response theory component and a population component, as in the National Assessment of Educational Progress, and show how performance and growth could be expressed in terms of expected performance on a market basket of tasks. We discuss conditions under which modeling simplifications might be possible and discuss studies that would be needed to fit models, estimate parameters, and evaluate data requirements.  相似文献   

17.
In this study, we explore an alternate mode for teaching and learning the dynamic, three‐dimensional (3D) relationships that are central to understanding astronomical concepts. To this end, we implemented an innovative undergraduate course in which we used inexpensive computer modeling tools. As the second of a two‐paper series, this report focuses on the qualitative differences of students' understandings of both spatial and declarative knowledge domains as reflected by their two distinct learning environments — a traditional astronomy classroom and an experimental astronomy course grounded in problem‐solving and modeling with dynamic, 3D, computational modeling software. We found that students who constructed 3D computational models tended to have a more scientifically sophisticated understanding of dynamic spatial relationships, whereas students in the traditional class developed more accurate understandings of the properties and general facts and figures regarding celestial bodies.  相似文献   

18.
Historically, research focusing on rater characteristics and rating contexts that enable the assignment of accurate ratings and research focusing on statistical indicators of accurate ratings has been conducted by separate communities of researchers. This study demonstrates how existing latent trait modeling procedures can identify groups of raters who may be of substantive interest to those studying the experiential, cognitive, and contextual aspects of ratings. We employ two data sources in our demonstration—simulated data and data from a large‐scale state‐wide writing assessment. We apply latent trait models to these data to identify examples of rater leniency, centrality, inaccuracy, and differential dimensionality; and we investigate the association between rater training procedures and the manifestation of rater effects in the real data.  相似文献   

19.
SodaConstructing knowledge through exploratoids   总被引：1，自引：0，他引：1  
In this article, we describe a preliminary study that integrates research on engineering design activities for K‐12 students with work on microworlds as learning tools. Here, we extend these bodies of research by exploring whether—and how—authentic recreations of engineering practices can help students develop conceptual understanding of physics. We focus on the design–build–test (DBT) cycle used by professional engineers in simulation‐based rapid modeling. In this experiment, middle‐school students worked for 10 hr during a single weekend to solve engineering design challenges using SodaConstructor, a Java‐based microworld, as a simulation environment. As a result of the experiment, students learned about center of mass. Our data further suggest that in the process of simulation‐based modeling, rapid iterations of the DBT cycle progressively linked students' interest in the design activities and understanding of the concept of center of mass. We suggest that these rapid iterations of the DBT cycle functioned as exploratoids: short fragments of exploratory action in a microworld that cumulatively develop interest in and understanding of important scientific concepts. © 2006 Wiley Periodicals, Inc. J Res Sci Teach  相似文献   

20.
Many universities are endeavoring to understand and reduce their greenhouse gas (GHG) emissions—or carbon footprints. Hard‐copy textbooks are (perhaps surprisingly) a large component of this footprint. Because they are “virtual,” electronic texts (e‐texts) are often considered environmentally superior to conventional hard‐copy texts. However, such claims lack thorough empirical validation. An effective tool for evaluating environmental impacts of products and services is lifecycle assessment (LCA). This article enumerates the steps in the lifecycles of conventional (hard copy) texts and e‐texts and it reports the potential GHG footprints of these activities. However, the actual footprint of most products and services depends on how individuals actually use them. Therefore, our second objective is to report survey results regarding actual student behaviors. Combining LCA and survey data, we estimate the GHG emissions of representative e‐texts and conventional texts; and we compare the two. This allows us to provide insight into the question, which alternative is best? Just as importantly, our analysis also identifies three levers that administrators, faculty and students can use to reduce text‐related GHG emissions.  相似文献   

设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号