共查询到20条相似文献，搜索用时 31 毫秒
1.
We identify literature that argues the process of creating knowledge‐based system is often imbalanced. In most knowledge‐based systems, development is often technology‐driven instead of requirement‐driven. Therefore, we argue designers must recognize that evaluation is a critical link in the application of requirement‐driven development models because it provides the information that keeps the iterative developmental process on track. In this study we took a closer look at the decision‐making in the design of a complex performance system in a non‐profit organization. The purpose was to gain insights into the roles and functions of evaluation during the process of building a performance support system. This study adopted an exploratory case study as its inquiry method. Findings suggested that effective communication is as important a function to evaluation as is decision‐making, and that the implementation of evaluation seldom follows the textbook guidelines. That is, evaluation practice is a patchwork history of the designers' knowledge and experience. Further, neither complexity nor the informality of the evaluation protocols seems to influence the quality of decision‐making. 相似文献
2.
Francis Lopez‐Real 《Assessment & Evaluation in Higher Education》1999,24(1):67-79
This paper discusses the problem of discriminating between individual contributions in the assessment of group projects. It is argued that peer assessment is a necessary element of any proposed structure but that the use of any ‘weighting‐factor’ system is contrary to the philosophy underpinning collaborative groupwork. A structure that separates the process and product elements of the assessment is described and a set of generic criteria for the process peer assessment identified. This structure was implemented with a group of students at Hong Kong University and evaluated using questionnaires and in‐depth interviews. The paper discusses the results of this evaluation and in particular identifies the need for ‘benchmarking’ when using the criteria and also the problematic nature of the ‘insider‐outsider’ syndrome as an important cultural factor. 相似文献
3.
A comparison of mean scores for the first cohort of GCSE pupils with the last cohort of CSE/GCE pupils in one comprehensive school on a variety of measures of self‐perception and self‐evaluation fails to show any more than marginal differences. Correlations between examination performances and the self‐report measures were almost identical for the two sets of examinations. The most parsimonious interpretation would be that the changes in the examination system had not resulted in any changes in pupils. 相似文献
4.
One way to manage marking error, in a large‐scale educational testing context, is to establish a mechanism through which appeals can be lodged. While, at one level, this seems to offer a straightforward technical solution to the problem of marking error, it can also result in unintended consequences, with political, social or educational ramifications. It is therefore important to monitor the operation of any appeal system, to determine how effectively it meets its objectives. The present paper was based on an evaluation of the system which operates for National Curriculum testing in England. Four underlying objectives were identified: the measurement objective, the political objective, the educational objective and the psychological objective. Although there is reason to believe that such goals can be achieved through appeal systems, there are major threats to achieving them, many of which appear to be inevitable. These threats are examined within the paper and implications for policy and practice are explored. 相似文献
5.
P. Spooren D. Mortelmans J. Denekens 《Assessment & Evaluation in Higher Education》2007,32(6):667-679
Students' evaluation of teaching skills has been an important yet controversial tool in the improvement of teaching quality during the last few decades. When searching for an apt student questionnaire to measure instructional skills, it appeared that most existing questionnaires the authors were able to collect are based on a single‐item type of evaluation. Additionally, most of these instruments lack a theoretical foundation and hardly any instrument was tested with modern tests for reliability and validity. The authors managed to create a 31‐item instrument which comprises 10 Likert scales and is based on both the educational theory and empirical data. In this article, they present the different steps in constructing the instrument and discuss its reliability and validity. The results of this study underline the value of the use of a scaling technique in students' evaluation of teacher performance. 相似文献
6.
Jane Carter 《Literacy》2020,54(1):49-57
The phonics screening check (PSC) was introduced in England in 2012 for children in Year 1. There have been criticisms in relation to its reliability and appropriateness as an assessment tool for early reading although supporters of the PSC see it as a valuable tool in securing progress in reading. The DfE‐funded evaluation concluded, however, that it “did not find any evidence of improvements in pupils' literacy performance, or in progress, that could be clearly attributed to the introduction of the PSC”. This article reports some of the findings from a doctoral study that sought to illuminate the voices of those most affected by the PSC: children in Year 1 and their teachers. The study used an illuminative evaluation methodology (Kushner, 2017) and focused on a range of schools in a large city, selected for their diversity in relation to attainment data (PSC and reading) and socio‐economic status. The findings demonstrate the negative backwash from the assessment process which has influenced the way that phonics is taught and so raises some questions for teachers and policy‐makers about the approach to the teaching of early reading in the light of the PSC. 相似文献
7.
This paper reports the design, implementation, and evaluation of a teleseminar on instructional design (ID) and computer‐mediated communication (CMC) for the purposes of staff development at The University of Southern Queensland, Toowoomba, Australia. Participation was open to any staff with an involvement or interest in distance education. This study was motivated by the following research questions: Is CMC a viable medium for the professional development of staff in distance education? Does the nature of moderation of CMC‐based discussions influence the nature of contributions from subscribers? Do participants use different strategies (interactive, cognitive, and metacognitive) in CMC‐based discussions? To address these questions a teleseminar was instituted with a focus on the issues of ID and CMC. CMC‐based moderation techniques were used to manage the discussion. Both qualitative and quantitative evaluation tools were used to measure the outcomes of the teleseminar. Results of these evaluation data show that CMC proved to be a viable medium for the professional development of staff, that the moderation strategies influenced the nature of contributions from the subscribers, and that participants used a range of strategies to manage the discussion and their participation in it. 相似文献
8.
Kam Cheong Li 《Open Learning》2013,28(2):213-216
The success of any open and distance learning course depends on how well it is designed, executed, and evaluated. Evaluation of a course not only demonstrates its strengths, but also points out any inherent shortcomings in the course. This is why course evaluation constitutes an important function in an open and distance learning system. The present paper aims to evaluate a distance education course ‘Instruction in higher education’ from the Postgraduate Diploma in Higher Education (PGDHE) offered by the Indira Gandhi National Open University (IGNOU), India. Feedback on this course was obtained from 230 respondents with the help of a structured questionnaire. The data collected from students were analysed using percentages. Findings from the study provide an understanding of the operation of the different components of the course. While the majority of the respondents were satisfied with self‐instructional materials, assignments, the extended contact programme, and delivery mechanisms, a sizeable number of respondents were dissatisfied with academic counselling, and the use of audio‐video programmes. Generally, the respondents provided useful feedback and suggestions which will help the faculty in course revision. 相似文献
9.
Patrick Ainley 《British Journal of Sociology of Education》2008,29(2):213-223
Unlike most papers on education and ecology, this one is not concerned with the content of education but its organisation as a system and hence its purpose or finality. The central contention of the paper, which takes English education and training (or ‘learning’) as a case in point, is that in a new market‐state formation the pursuit of short‐term goals is tied to the global free‐market economy over which any attempt at democratic control has been relinquished. At a time when humanity worldwide faces increasing change in the ecology that sustains it, this is considered to be ‘ecocidally insane’ and the opposite of any sort of learning from experience to alter behaviour in the future. The re‐regulated new global market is seen in conclusion as a crisis response to the end of the previous Keynesian welfare nation‐state formation. As such, it is argued to be unsustainable in any sense. 相似文献
10.
Kathryn M. Fischer Wilhelmina C. Savenye Howard J. Sullivan 《Performance Improvement Quarterly》2002,15(1):11-24
This article describes a formative evaluation of a one‐day introductory computer‐based training (CBT) course for a new on‐line financial and purchasing system at a large public university. The purposes of the evaluation were to evaluate the effectiveness of the training and to identify appropriate revisions and incorporate them into the training program. Participants were 78 university employees who were likely future users of the financial and purchasing system. The mean score on an on‐line performance posttest that simulated real‐work tasks was 94%, and the mean on a 40‐item knowledge posttest covering the CBT content was 74%. Learner attitudes toward the course were positive, averaging 4.4 on a 5‐point scale. Formative evaluation of the program resulted in revisions that had the potential to improve its effectiveness and provided evidence of the value of ongoing formative evaluation of workplace training. 相似文献
11.
Lyndal Taylor 《Assessment & Evaluation in Higher Education》1994,19(2):109-122
Essential to the improvement of teaching effectiveness is evaluation. Evaluation can take many forms, but any process directly involves the teacher. Self‐evaluation is a process whereby teachers collect the data on their own teaching effectiveness and analyse the information to consider improvement to that teaching. This process can be undertaken in a number of ways. However, the unique benefit of self‐evaluation is the close involvement of teachers in the consideration of the effectiveness of their own teaching. This article considers different methods of self‐evaluation and suggests a technique that has been found to be successful. 相似文献
12.
Stan Zakrzewski Christine Steven Chris Ricketts 《Assessment & Evaluation in Higher Education》2009,34(4):439-454
There are three purposes for evaluation: evaluation for action to aid the decision making process, evaluation for understanding to further enhance enlightenment and evaluation for control to ensure compliance to standards. This article argues that the primary function of evaluation in the ‘Catherine Wheel’ computer‐based assessment (CBA) cyclic model is evaluation for action and secondary functions are evaluation for understanding and control. By studying segment and cyclic dependencies, conducting a risk analysis and identifying key stakeholders it is possible to identify where action evaluation has the most effect, what is required to be evaluated, who will perform the action and how it will be controlled. Each segment and cycle in the CBA model must therefore be monitored and the observations made must have meaning for the elimination or reduction of pedagogic, operational, technical non web‐based, web‐based and financial risks. It is important to consider stakeholders because they have differing views on what is most important in the evaluation process and inevitably will be involved in the evaluation process itself. CBA system stakeholders include management, academic, support and administrative staff together with external verifiers and students. The information gained from these stakeholders provides quality enhancement and assurance and forms the basis for change. 相似文献
13.
This article reports the findings of a mixed‐method evaluation of a pilot educational programme undertaken with six to seven year olds in a sample of primary schools in England with the aim of increasing their awareness of and respect for diversity through theatre, workshops and related teacher‐led classroom activities. The qualitative feedback from the teachers involved was extremely positive and encouraging and an analysis of the actual impact of the pilot programme on the children’s attitudes and awareness, using an experimental design, demonstrated some positive effects. In particular, the programme was found to increase the children’s general awareness of diversity and their ability to recognize instances of exclusion. While not a planned objective of the pilot programme, the evaluation also examined whether it had any effects on the children’s attitudes to specific differences, in this particular case racial differences. Interestingly, however, no evidence was found of any change in the children’s racial attitudes. With this in mind the article suggests that there is a need to distinguish between the general and specific effects of such educational programmes. The article considers the implications of this for future work in the area and also stresses the need to begin undertaking more thorough and rigorous evaluations of such initiatives. 相似文献
14.
Summaries English The present work is an attempt to contribute to the field of evaluation of the affective domain in socially‐oriented innovative science and technology curricula. The main concern of such curricula is the long‐term development of the student's personality in terms of decision‐making capability, attitudes, intellectual power, and social involvement. Since it appears that the realistic choice in the evaluation of such curricula is between ‘no measures’ (subjective judgements) and ‘imperfect proxies’, it is proposed to concentrate on finding adequate (and agreeable) measures to evaluate the long‐range intended (but also the unintended) effects of the programmes in hand, and only then to switch to evaluate the effectiveness of the curriculum in achieving these effects (i.e. the educational objectives) in the affective domain. Selected ideas with respect to the above are ‘translated’ here into manageable and applicable procedures within the science class, taking into consideration the ‘local realism of constraints’ within which every science teacher performs. The development of feasible methods for measurement of curricular outcomes in the affective and affective‐cognitive domains is a precondition for future summative evaluation of socio‐technologically oriented science and technology curricula. Contending with the moral and value‐judgement components of any future science curriculum is therefore the inescapable task ahead. 相似文献
15.
This article describes a mixed‐methods needs assessment, or developmental evaluation, that was conducted for the providers and stakeholders of Oklahoma's community‐based organizations (CBOs). The needs assessment, which was the first phase in developing training on outcome monitoring for their HIV prevention programs, relied on three evaluation approaches: Behavioral‐objectives, participatory, and empowerment. This article describes the background for the needs assessment, the needs assessment process, and the lessons learned. When dealing with such a complex issue as HIV prevention where multiple goals must be achieved for success, a mixed‐methods approach to needs assessment may better capture real‐world needs. Furthermore, it may increase acceptance of the needs assessment findings and conclusions by the diverse groups that have a stake in the evaluation. However, as this study exemplified, implementing and reporting a mixed‐methods needs assessment that is based on differing evaluation approaches is complex, challenging, and resource intensive. This study can contribute to theory building for mixed‐methods evaluation. 相似文献
16.
17.
While self‐evaluation leads to valuable results in some schools, it appears that in other schools this is true only to a lesser extent or not at all. This raises the question of how differences in the results of self‐evaluations can be explained. This study looks at to what extent the results of self‐evaluation are determined by the way in which self‐evaluation is conducted, by characteristics relating to the general functioning of the school and by the support which schools enjoy. One thousand seven hundred and eighty‐six school principals and team members from 96 schools (primary and secondary) were surveyed by means of a written questionnaire. The data collected were then analysed using multi‐level structural equation modelling. The results provide strong empirical evidence that “attitude with regard to self‐evaluation”, “self‐evaluation as a policy action” and “self‐evaluation as an act of research” are powerful predictors of the quality of self‐evaluations. 相似文献
18.
This article describes the results of a study into the utility of the SVI model, a model in which internal and external evaluation are balanced. The model consists of three phases: school self‐evaluation, visitation and inspection. Under the guidance of school consultants, 27 Dutch primary schools have built up two years of experience with the SVI model. The results show that the school leaders developed a positive attitude towards school self‐evaluation and visitation. They found that both self‐evaluation and visitation have improved their insight into the quality of the school. However, a content analysis of the school self‐evaluation reports shows that the school self‐evaluations are often of low quality. For example, it appeared that most of the self‐evaluation reports do not provide answers to questions the schools have formulated at the beginning of the self‐evaluation. Moreover, the teams of critical friends and the inspectors concluded that the school self‐evaluations do have many shortcomings. Based on these results, we conclude that school self‐evaluation is a very difficult task for most schools. It is therefore crucial that schools receive external support and that they build up experience with school self‐evaluations over a period of years. 相似文献
19.
Nicola J. Yeates 《Learning, Media and Technology》1983,9(3):179-182
The Telesoftware and Education Project, which was set up in 1980 by the BBC, the IBA and Brighton Polytechnic, demonstrated the feasibility of using broadcast transmissions to distribute computer programs as teletext pages, to be downloaded (i.e. recorded) onto a microcomputer in school. The success of the project led to the setting up of a Telesoftware and Primary Education Project, to distribute software to the area of education in which programming expertise is least often available. Telesoftware is not only a means of distributing stand‐alone software but can also be coupled with schools’ broadcasts and can read relevant information from any page of teletext, providing an educational television ‘package’. The project provides a link between schools and programmers and functions as a pre‐ and post‐broadcast evaluation team. The initial feedback from schools has been very positive and it is hoped that the broadcasting of high quality, relevant telesoftware will be a useful TV service in the future. 相似文献
20.
Paul Hart Marlene Taylor Ian Robottom 《Assessment & Evaluation in Higher Education》1994,19(3):201-214
The purpose of this paper is to problematize the notion of participatory enquiry as a legitimate form of educational evaluation. Using a case study of a new teacher education program the authors describe how they negotiated and enacted an alternative evaluation methodology within a traditional context. The evaluation process was intended to actively engage faculty members and students, as well as representatives of the educational system and the broader community, in self‐reflection and self‐evaluation of their own program. The authors then attempt to turn the methodology back on itself by critically analyzing their own participatory process in terms of a number of dilemmas that arose during the three‐year course of the evaluation. These dilemmas were addressed directly as political issues of method as a means of eliciting discussion and debate about the appropriateness of various forms of enquiry in the assessment and evaluation of higher education. 相似文献