共查询到20条相似文献，搜索用时 640 毫秒
1.
Derek C. Briggs 《教育实用测度》2013,26(2):89-118
Correlational evidence suggests that high school GPA is better than admission test scores in predicting first-year college GPA, although test scores have incremental predictive validity. The usefulness of a selection variable in making admission decisions depends in part on its predictive validity, but also on institutions’ selectivity and definition of success. Analyses of data from 192 institutions suggest that high school GPA is more useful than admission test scores in situations involving low selectivity in admissions and minimal to average academic performance in college. In contrast, test scores are more useful than high school GPA in situations involving high selectivity and high academic performance. In nearly all contexts, test scores have incremental usefulness beyond high school GPA. Moreover, high school GPA by test score interactions are important in predicting academic success. 相似文献
2.
Previous research notes the importance of understanding racial/ethnic differential prediction of college grades across multiple institutions. Institutional variation in selection indices is especially important given some states' laws governing public institutions' admissions decisions. This paper employed multilevel moderated multiple regression to study the variation of selection indices across 30 institutions and the accuracy of selection indices in predicting college grades for students of different racial/ethnic backgrounds. Several benefits of multilevel models for cross-institutional differential prediction studies were described and include: controlling for institutional differences in range restriction, providing reliability estimates of least squares estimates, and adjusting criterion scores for differences in coursework difficulty. The findings from this study provide evidence of institutional variation in selection indices, which challenges current laws aimed at standardizing them. Specifically, there was evidence that the predictor slope coefficients varied across institutions, in addition to the estimates that measured intercept differences for African and Asian American students. Across universities, the results mirrored previous findings: high school grade point average (GPA) differentially predicted grades for African Americans, SAT verbal scores differentially predict grades for Asian Americans, and SAT math scores were better predictors of Asian Americans' grades. 相似文献
3.
《Educational Assessment》2013,18(2):129-153
States are increasingly using test scores as part of the requirements for high school graduation or certification. In these circumstances, a battery of tests or, with writing, analytic traits are considered that usually cover different aspects of the state's content standards. Because pass or fail decisions are made affecting students' futures, the validity of standard-setting procedures and strategies is a major concern. Policymakers and legislators must decide which of these 2 standard-setting strategies to use for making pass or fail decisions for students seeking certification or for meeting a high school graduation requirement. The compensatory strategy focuses on total performance, summing scores across all tests in the battery. The conjunctive strategy requires passing performance for each test in the battery. This article reviews and evaluates compensatory and conjunctive standard-setting strategies. The rationales for each type are presented and discussed. Results from a study comparing the compensatory and conjunctive strategies for a state high school certification writing test provide insight into the problem of choosing either strategy. This article concludes with a set of recommendations for those who must decide which type of standard-setting strategy to use. 相似文献
4.
Data from the National Survey of Student Engagement (NSSE) collected across seven years were used to predict final, cumulative grade point averages (GPA). Cross‐product regression was used to explore the predictive abilities of the NSSE benchmark scores for freshmen (n = 2578) and seniors (n = 2293) collected in cross‐sectional cohorts. Hierarchical regression was also used with 127 longitudinal responses in students’ first and senior years of college. In the cross‐sectional analyses, Level of Academic Challenge emerged as a significant predictor of GPA for freshmen, whereas the Active and Collaborative Learning benchmark was a significant predictor for seniors; both effects were modest. The cross‐sectional data explained 22.6% of the variance with 18.2% of this variance accounted for by pre‐college control factors (American College Test score and high school GPA). For the analysis of longitudinal data, 31.3% of the variance was explained and 27.8% was attributed to the pre‐college indicators. No benchmark scores were significant predictors of GPA in the longitudinal data. Results suggest that cross‐sectional analyses can adequately detect modest effects on final GPA. In contrast, longitudinal models explain more variance, though they lack the power to reveal modest effects. This study suggests approaches for the responsible use of cross‐sectional and longitudinal data in educational research. 相似文献
5.
The prevalence of homeschooling in the United States is increasing. Yet little is known about how commonly used predictors of postsecondary academic performance (SAT, high school grade point average [HSGPA]) perform for homeschooled students. Postsecondary performance at 140 colleges and universities was analyzed comparing a sample of traditional students matched to a sample of 732 homeschooled students on four demographic variables, HSGPA, and SAT scores. The matched sample was drawn from 824,940 traditional students attending the same institutions as the homeschooled students, which permitted a very precise level of matching. This comparison did not show a difference in first‐year college GPA (FGPA) or retention between homeschooled and traditional students. SAT scores predicted FGPA and retention equally well for both groups, but HSGPA was a weaker predictor for the homeschooled group. These results suggest that, among college students, those who were homeschooled perform similarly to traditionally educated students matched on demographics and academic preparedness, but there are practical implications for college admissions in the use of HSGPA versus standardized test scores for homeschooled students. 相似文献
6.
E. David Thompson Bethany V. Bowling Ross E. Markle 《Research in Science Education》2018,48(1):151-163
Studies over the last 30 years have considered various factors related to student success in introductory biology courses. While much of the available literature suggests that the best predictors of success in a college course are prior college grade point average (GPA) and class attendance, faculty often require a valuable predictor of success in those courses wherein the majority of students are in the first semester and have no previous record of college GPA or attendance. In this study, we evaluated the efficacy of the ACT Mathematics subject exam and Lawson’s Classroom Test of Scientific Reasoning in predicting success in a major’s introductory biology course. A logistic regression was utilized to determine the effectiveness of a combination of scientific reasoning (SR) scores and ACT math (ACT-M) scores to predict student success. In summary, we found that the model—with both SR and ACT-M as significant predictors—could be an effective predictor of student success and thus could potentially be useful in practical decision making for the course, such as directing students to support services at an early point in the semester. 相似文献
7.
John P. Meriac 《Learning and individual differences》2012,22(4):549-553
In this study, work ethic was examined as a predictor of academic performance, compared with standardized test scores and high school grade point average (GPA). Academic performance was expanded to include student organizational citizenship behavior (OCB) and student counterproductive behavior, comprised of cheating and disengagement, in addition to college GPA. Results indicated that work ethic explained incremental variance in student OCB, cheating and disengagement beyond standardized test scores or high school GPA. However, work ethic did not explain incremental variance in college GPA. Specific work ethic dimensions were related to each outcome. These findings provide support for the importance of non-cognitive variables in academic contexts, particularly when considering an expanded performance domain. In addition, results provide additional validity evidence for the nature of work ethic as a multidimensional construct. 相似文献
8.
Susan S. Wood 《Community College Journal of Research & Practice》2013,37(5-6):361-368
Providing high-quality mathematics instruction in the classrooms of the future is essential to the development of educated citizens and a competent workforce. W hile this need is growing, the United States is facing a critical teacher shortage. An estimated two million teachers are needed, and this situation will only worsen in the next decade. An increasing number of prospective teachers begin their college experience at two-year colleges, and many future elementary and middle school teachers take all of their college-level mathematics and science coursework at these institutions. Two-year colleges must be integrally involved in teacher recruitment and preparation. The National Science Foundation report Investing in Tomorrow's Teachers recommends two-year college involvement in teacher preparation, including recruitment of prospective teachers; strengthened undergraduate courses; preteaching experiences; liaisons between two-year colleges and four-year institutions; and connections with business, industry, and professional societies. The American Mathematical Association of Two-Year Colleges (AMATYC) has several strong teacher preparation activities and related guidelines. One successful model for two-year college involvement is the National Science Foundation-funded collaboration between Reynolds Community College and other two-year and four-year institutions in the area that has produced new and redesigned courses and a Teaching Apprentice Program. An emphasis on preparing prospective teachers to take licensure testing in mathematics is addressed through another program. A statewide initiative of the Virginia Community College System has produced a set of policy recommendations developed via a statewide task force and colloquium. 相似文献
9.
This study examines the organizational characteristics of 51 higher education institutions in relationship to student performance and growth. The study first finds that organizational measures of mission, size, wealth, complexity, and selectivity are statistically represented by the 2-year versus 4-year college mission. Findings indicate that 2-year and 4-year campuses indeed do exert significantly different influences on undergraduate GPA and self-reported intellectual growth. Next, the study uses both OLS regression and HLM to examine these influences. High school percentile rank and college classroom experiences are better predictors of Cum GPA at 4-year institutions, while student effort is a better predictor of GPA at 2-year institutions. Whereas the most important predictors of Cum GPA include precollege measures such as high school percentile rank and SAT score, the most influential predictors of student intellectual growth are campus experiences including classroom vitality, peer support, student effort, commitment, and involvement. Controlling for all other variables, students at 2-year institutions receive higher grades, and students at 4-year campuses experience more growth. 相似文献
10.
Peter T. Koper Kenneth J. Sanney John B. Mitchell 《Assessment & Evaluation in Higher Education》2015,40(2):248-264
Recently published evidence of limited learning among American college students confirms the damage done when students, faculty and institutions pursue interests that conflict with the educational process. The ‘disengagement compact’ in which faculty tacitly trade lenient workloads and grading for higher student evaluation of teaching (SET) scores and fewer complaints from students does damage wherever it operates. The work of Johnson confirms the link between SET and grade inflation. We propose a modification of an earlier grade index, the Real Grade Point Average (GPA), and propose as well an index for SET scores, the Real SET, to make inflated grades and inflated SET scores more visible. Used by institutions, parts of institutions or individual faculty, Real GPA and Real SET would encourage and protect faculty and students who offer or seek out educational experiences that have not been deflected by greed, sloth or cowardice. 相似文献
11.
Elchanan Cohn Sharon Cohn Donald C. Balch James Bradley Jr. 《Economics of Education Review》2004,23(6):577
The primary purpose of the study is to assess the degree to which SAT scores, high-school GPA (HSGPA) and class rank predict success in college. Data collected from students enrolled in several sections of Principles of Economics at the University of South Carolina in 2000 and 2001 are used to study the relation between college GPA (the dependent variable) and high-school rank, HSGPA, and SAT scores (the key independent variables). We also investigate whether there are race–sex differences in the likelihood of success in college. Further, we study the degree to which students with varying backgrounds are likely to be eligible for statewide scholarships and to retain them after enrollment. 相似文献
12.
Mitchell D. Chester 《Educational Measurement》2003,22(2):32-41
The article presents a framework for combining multiple measures to reach high-stakes decisions. Criteria are identified for the employment of conjunctive, compensatory, and complementary approaches to combining measures. The framework is illustrated through the documentation of the School District of Philadelphia's initiative to employ multiple measures, including standardized test scores, to determine promotion decisions. The author demonstrates that the use of multiple measures itself does not necessarily improve the reliability and validity of the decisions. It is the logic by which the measures are combined that determines the accuracy and appropriateness of the decisions reached. 相似文献
13.
The outbreak of COVID-19 in 2020 inhibited face-to-face education and constrained exam taking. In many countries worldwide, high-stakes exams happening at the end of the school year determine college admissions. This paper investigates the impact of using historical data of school and high-stakes exams results to train a model to predict high-stakes exams given the available data in the Spring. The most transparent and accurate model turns out to be a linear regression model with high school GPA as the main predictor. Further analysis of the predictions reflect how high-stakes exams relate to GPA in high school for different subgroups in the population. Predicted scores slightly advantage females and low SES individuals, who perform relatively worse in high-stakes exams than in high school. Our preferred model accounts for about 50% of the out-of-sample variation in the high-stakes exam. On average, the student rank using predicted scores differs from the actual rank by almost 17 percentiles. This suggests that either high-stakes exams capture individual skills that are not measured by high school grades or that high-stakes exams are a noisy measure of the same skill. 相似文献
14.
Systematic Comparison of Decision Accuracy of Complex Compensatory Decision Rules Combining Multiple Tests in a Higher Education Context 
下载免费PDF全文
下载免费PDF全文 Iris E. Yocarini Samantha Bouwmeester Guus Smeets Lidia R. Arends 《Educational Measurement》2018,37(3):24-39
This real‐data‐guided simulation study systematically evaluated the decision accuracy of complex decision rules combining multiple tests within different realistic curricula. Specifically, complex decision rules combining conjunctive aspects and compensatory aspects were evaluated. A conjunctive aspect requires a minimum level of performance, whereas a compensatory aspect requires an average level of performance. Simulations were performed to obtain students' true and observed score distributions and to manipulate several factors relevant to a higher education curriculum in practice. The results showed that the decision accuracy depends on the conjunctive (required minimum grade) and compensatory (required grade point average) aspects and their combination. Overall, within a complex compensatory decision rule the false negative rate is lower and the false positive rate higher compared to a conjunctive decision rule. For a conjunctive decision rule the reverse is true. Which rule is more accurate also depends on the average test reliability, average test correlation, and the number of reexaminations. This comparison highlights the importance of evaluating decision accuracy in high‐stake decisions, considering both the specific rule as well as the selected measures. 相似文献
15.
MARIEKE F. VAN DER SCHAAF KAREL M. STOKKING NICO VERLOOP 《Assessment & Evaluation in Higher Education》2003,28(4):395-410
There is a need for assessment of teachers' competencies fostered by a growing attention given to accountability and quality improvement. Important questions are how good the demonstrated competencies of teachers should be for a satisfying assessment and how the different competencies should be weighted. Using a policy capturing method, in two rounds, nine stakeholders developed performance standards (or cut-off scores) for teacher assessment on eight criteria (or content standards) that resulted from an earlier study. Between the rounds, the panellists held a structured group discussion. Policy capturing proved to be a clear and useful method generating consistent judgements that can be described according to both a compensatory model and a conjunctive model. From the first to the second round, the consistency increased. However, while the panellists agreed to a substantial degree on the performance standards, they disagreed on the weights to be assigned to the criteria. 相似文献
16.
A paradigm shift toward evidence-based clinical practice: Developing a performance assessment 总被引：1，自引：0，他引：1
Nancy Wentworth Lynnette B. Erickson Barbara Lawrence J. Aaron Popham Byran Korth 《Studies in Educational Evaluation》2009,35(1):16-20
The Clinical Practice Assessment System (CPAS), developed in response to teacher preparation program accreditation requirements, represents a paradigm shift of one university toward data-based decision-making in teacher education programs. The new assessment system is a scale aligned with INTASC Standards, which allows for observation and evaluation of teacher candidate performance over time to show growth from novice to high level proficiency. This article describes the creation of the CPAS and examines results from its implementation in early childhood, elementary, and secondary programs in both early and capstone clinical experiences. Three years of implementation experiences have informed decisions on supervisory practices, program offerings and requirements, alignment of course outcomes, and understanding of strengths and weaknesses of individual licensure programs. 相似文献
17.
Marlene Sprouse Alissa R. King 《Community College Journal of Research & Practice》2013,37(12):985-998
There is a likely community college teacher shortage on the horizon. Thus, community colleges not only need to focus on hiring quality instructors who emphasize teaching excellence, but institutions need to invest time and resources developing quality faculty plans to address faculty needs and provide adequate faculty development programs. When Iowa's community college licensure law was repealed in 2003, 15 area community colleges were left with the task of developing their own quality faculty plans. The Quality Faculty Plan design and one-year implementation is assessed. 相似文献
18.
We investigate the relationship between teacher licensure test scores and student test achievement and high school course-taking. We focus on three subject/grade combinations—middle school math, ninth-grade algebra and geometry, and ninth-grade biology—and find evidence that a teacher's basic skills test scores are modestly predictive of student achievement in middle school math and highly predictive of student achievement in high school biology. A teacher's subject-specific licensure test scores are a consistent and statistically significant predictor of student achievement only in high school biology. Finally, we find little evidence that students assigned to middle school teachers with higher basic-skills test scores are more likely to take advanced math and science courses in high school. 相似文献
19.
One potentially useful multivariate procedure somewhat overlooked in admissions marketing efforts is a linear compensatory model presented by Cook and Zallocco (1983). This model defines an individual's attitude about a particular college or university as the importance the individual attaches to a specific attribute of the school, and the belief that the institution under consideration possesses that attribute. In this study we extend the model by investigating the importance of applicants' attitudes about competitor institutions, and by controlling for demographic and ability factors that may affect attitudes. Our research demonstrates that attitudes have a significant, positive relationship to enrollment decisions. As well, we incorporate an attitude difference measure that contrasts applicants' attitudes about one institution compared to admissions competitors. Addition of this variable to the prediction equation substantially improved our ability to forecast an applicant's matriculation decision.An earlier version of this paper was presented at the Association for Institutional Research 1989 Annual Forum. 相似文献
20.
The purpose of the present study was to determine if a nonrational model of decision-making was used by college administrators in three typical areas of college operations. Were the value positions taken by three college constituency groups (faculty, students, community board) on problems in curriculum, student affairs, and personnel influencing decisions made by administrative groups? In a simulation study, information describing a mythical community college was prepared, using the dimensions of the management-information system CAMPUS (Comprehensive Analytical Methods for Planning in University Systems). Three simulated problems within the hypothetical community college setting were administered to teams of decision makers each composed of three junior college administrators. Junior college administrators did not use the nonrational model in reaching group or individual decisions in the three simulated problem areas. Administrators did not respond in a significant manner to the influence of college constituency groups in reaching decisions. The type of problem being considered (curriculum, student affairs, and personnel) was a significant factor in determining decision alternatives selected by administrators. Both the rational and nonrational models of decision-making as used in this study appear inadequate to explain administrative decisions. It is tenable to posit that decision-making is influenced at least as much by previously learned responses of the decision-makers, and it may need to be considered as an important element in any model of decision-making. 相似文献