【作者】 陈畅；

【导师】 陈士俊；

【作者基本信息】 天津大学 ， 管理科学与工程， 2010， 博士

【摘要】 高考是高利害性考试,其重要性是不言而喻的。但长期以来,高考命题质量不断受到社会各界质疑,其公信力受到严重挑战。要保证高考命题质量,首先要解决高考命题评价问题。即谁来评,怎么评,评什么的问题。高考作为一种教育服务,其命题服务质量应由服务对象进行评价。但目前的评价,只有考试部门提供的、由考后数据形成的质量报告,属于内部评价而缺少服务对象的评价,是不完整的,因而难以回应社会的质疑。为此,本文从高考是教育服务的理念出发,将高考命题质量评价纳入服务质量评价体系进行研究。引入顾客满意度理论,将高考命题服务的对象即“顾客”定位为考生、高校、中学。考虑到目前高考制度设计下,高校既没有对命题提出实际需求也没有参与命题设计,只是在使用考试结果。故本文暂选择考生与中学两者作为高考命题的“顾客”参与评价。本文在对已有理论文献与国、内外实践经验综述的基础上,提出了在顾客满意度视阈下进行高考命题质量评价的理论构想。分析了该评价理论所蕴涵的,以前评价所不具备的服务、合作、适合的价值理念。运用系统分析的方法详细论证了该评价理论的合理性,进而从顾客满意度和传统效度理论分析出发,论述了该评价理论的理论根源,从而揭示了该评价理论的机理与价值。在评价理论研究的基础上,本文针对中学、考生对高考命题质量感知途径及角度的差异,采取了不同的方案设计。对中学教师评价采取了建立结构方程模型的方法,并运用PLS估计方法对模型进行拟合;对考生评价则采用系统分析、因子分析方法,建立了结构化调查量表。针对方案设计,本文通过三个实证研究进行验证。其中中学教师评价结构方程模型通过《考试说明》和“高考命题质量”评价数据进行拟合、校验,表明结构方程效果良好;考生通过对“作答高考试卷主观感受”评价数据进行校验,表明调查量表效果良好。实证研究同时产生出以前评价所缺乏的顾客评价意见,有效地弥补了高考命题质量评价的盲点。最后,本文针对这些顾客评价意见进行了分析,提出了相应对策。更多还原

【Abstract】 The College Entrance Examination, being a high-stake testing system, is undoubtedly of great importance. However, the recent years have heard constant critical voices toward the quality of the test papers, which strongly challenges the creditability of the examination itself. To guarantee the quality of the College Entrance Examination (CEE) papers, the issue of establishing a evaluation system should be firstly addressed. To put it another way, we have to be clear that who, how and what to evaluate in this system. As a kind of educational service, the quality of the CEE papers should be evaluated by those who use the service. But the present evaluation, which mainly takes the form of data analysis report done by the testing authorities themselves, is nothing but an internal one. Due to its lack of the evaluation from the people for whom it’s intended, this kind of evaluation is partial and difficult to avoid the criticism of the public.Starting from the clarification of the concept that the College Entrance Examination is a form of educational service, this dissertation makes a study of the quality evaluation system for the CEE papers by using the approach from the service quality evaluation system. With the introduction of the theory of clients’satisfaction, the author analyzes the people who accept this kind of service, namely, the examinees, the universities or colleges and the high schools. In view of the fact that the universities and colleges only play the role of using the testing results, instead of providing their specific requirements on the examination papers or participating in the tests development process within the existing mechanism, this dissertation will only takes into account the examinees and the high schools as its service objects to evaluate the quality of the CEE papers.Based on the review of the existing literature and the practices home and abroad, the present author proposes his framework of evaluating the quality of the CEE papers from the perspective of gaining the satisfaction of its clients. Using the system analysis approach, the paper analyzes the unique concept embodied in this evaluation framework, i. e. service, cooperation and being appropriate and illustrates its rationale. Then drawing on the theory of clients’satisfaction and the traditional theory of testing validity, the paper elaborates the theoretical foundation of this framework and shows its working mechanism as well as its values.Considering the difference between high school teachers and the examinees in perceiving the quality of the CEE papers, this thesis designs different projects following the illustration of the proposed framework. For the high school teachers, a Structural Equation Modeling (SEM) is constructed and the Partial Least Square (PLS) approach is adopted in order to fit it. For the evaluation from the examinees, a scale for the structural survey is formulated with the methods of system analysis and componential analysis. In order to validate the above designs, three empirical studies are conducted. First the Test Specifications and the Statistical Reports of the CEE Papers are used to fit and validate the SEM of high school teachers’evaluation, which indicates that the SEM functions well. Then the validation process of the data from the survey of the examinee’s feelings toward the papers shows that the scale also works well. Moreover, these studies produce the clients’evaluation of the CEE papers, which fills the blank in the previous evaluation model. With the analysis of the clients’evaluation, the thesis concludes itself by putting forward some related strategies and solutions.更多还原