Improving Educational Evaluation and Quality in China

Lead Research Organisation: University of Bristol
Department Name: Education

Abstract

Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.

Publications

10 25 50
publication icon
Chunrong Ren (Author) (2009) _____________ in China examinations

publication icon
Goldstein H (2008) Reflections on the international comparative surveys debate in Assessment in Education: Principles, Policy & Practice

publication icon
Muñoz-Chereau B (2015) Educational effectiveness in Chilean secondary education: comparing different 'value added' approaches to evaluate schools in Assessment in Education: Principles, Policy & Practice

publication icon
Peng W (2014) Emerging perceptions of teacher quality and teacher development in China in International Journal of Educational Development

publication icon
Sally Thomas (Author) (2012) Research on Value Added Evaluation of School Effectiveness in Educational Research, National Institute for Educational Sciences, Beijing

publication icon
Sally Thomas (Author) (2009) Assessment of educational quality in China

publication icon
Thomas S (2008) International comparative studies of achievement - re-examining the issues and impacts in Assessment in Education: Principles, Policy & Practice

 
Description Study 1: Measuring school effectiveness:

The optimal "value added" model for estimating Chinese senior secondary school effects (identified using standard statistical criteria) adjusted for factors outside the control of schools including student's prior attainment, individual background characteristics and school context. Some explanatory variables found to be statistically significant may be unique to China (eg family residence status) and some unexpected results were found (eg mobile phone ownership indicated a negative relationship and parents agricultural employment indicated a positive relationship with students examination performance) highlighting regional differences in China and in comparison to developed countries. Across the three local education authorities (LEAs) investigated these models explained 43%-57% of the total variance in students Higher Education (HE) entrance examination total scores. Of the remaining unexplained variance 5-15% was attributable to differences between schools, slightly higher than equivalent UK findings, and statistically significant differences within LEAs in terms of schools' "value added" measures were found. However the impact of school context varied considerably between LEAs (explaining 7%-33% of school variance), as did the impact of additional school input/process variables, indicating a greater influence of these factors on school performance in some regions. Evidence of differential within school effects for different curriculum subjects and student groups (eg by prior attainment) were also found, although the strength of evidence varied across LEAs suggesting that local policies and practices may play an important role, and that a range of "value added" measures are required to fully evaluate school effectiveness in China. Further research is planned to extend and clarify these findings over four student cohorts and in relation to improving teacher development and quality (see ESRC award RES-167-25-0428).



Study 2: Definitions of educational quality and approaches to school evaluation:

Stakeholder perceptions of educational quality can be understood in terms of outcomes, context, inputs and processes, reflecting typical western school effectiveness models, but also emphasise the particular importance of equity especially with regard to reducing east/west and rural/urban differences. Moreover, valued student outcomes seem relatively broader than elsewhere due to the recent national education policy reform to promote students all-round development and the enduring influence of Confucius philosophy promoting scholarship. Nevertheless, many stakeholders recognise that in practice raw examination achievement remains the critical indicator of educational quality, which subsequently influences teaching practices and this is unlikely to change without Higher Education entrance and examination system reform. School and teacher evaluation methods in China are typically seen by some stakeholders as unscientific, locally and variably regulated and also not sufficiently focused on school improvement. A few examples of schools adapting and using "value added" approaches informally were identified although it was recognised that further guidance and training is needed for policy makers, practitioners and public to understand the "value added" concept and statistical methods. It was widely acknowledged that "Value Added" measures would provide an important and welcome addition to current school evaluation and self-evaluation systems in China, although there is a need to adapt methods to local priorities (students' all-round development) and be aware of methodological limitations.
Exploitation Route This study provides a pilot for ways in which the evaluation of educational quality and school effectiveness could be improved in China and elsewhere.

Educational policy makers and practitioners could use the value added methods presented, alongside other types of evidence, to develop and improve systems of school self evaluation and accountability.
Sectors Education

URL http://ieeqc.bristol.ac.uk
 
Description Enhancing the Impact of ITDEQC and IEEQC ESRC/DFID funded projects
Amount £20,000 (GBP)
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 09/2016 
End 03/2018
 
Description Research partnership between National Institute for Education Sciences Beijing and School of Education University of Bristol 
Organisation Government of China
Department National Institute of Education Sciences
Country China 
Sector Academic/University 
PI Contribution Conducted joint research projects funded by British Council Beijing and ESRC DFID/ESRC IAA
Collaborator Contribution Conducted joint research projects funded by British Council Beijing and ESRC DFID/ESRC IAA
Impact see outcomes from IEEQC and ITDEQC projects
 
Description Diverse perspectives on, and the role of a multilevel modelling approach to education quality in China 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact Seminar presentation for International and Comparative Studies center at Graduate School of Education, University of Bristol
Year(s) Of Engagement Activity 2009
 
Description Fairer access to quality schools 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Invited article written by Prof Sally Thomas for China Daily on 4th July 2012. China Daily is the largest circulation English language print newspaper in China.

China Daily
Year(s) Of Engagement Activity 2012
URL http://www.chinadaily.com.cn/cndy/2012-07/04/content_15546894.htm
 
Description Fairer access to quality schools 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Invited article written by Prof Sally Thomas for China Daily on 4th July 2012. China Daily is the largest circulation English language print newspaper in China.

China Daily
Year(s) Of Engagement Activity 2012
URL http://www.chinadaily.com.cn/cndy/2012-07/04/content_15546894.htm
 
Description IEEQC : examples of value added methods to evaluation school performance in UK 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Seminar for academics, educational policy makers and practitioners at the Beijing Academy of Educational Sciences
Year(s) Of Engagement Activity 2009
 
Description IEEQC local dissemination conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Three separate IEEQC local dissemination conferences were held in collaboration with each of the three Local Education Authorites (LEAs) participating in the IEEQC project. Attended by local officials as well as head and deputy head teachers from schools participating in the study. 50-100+ delegates for each event. Confidential LEA specific findings from IEEQC study were presented and followed up by circulation of IEEQC summary report (in Chinese). IEEQC summary report has also been submitted for publication in Educational Research (high impact Chinese journal).
Year(s) Of Engagement Activity 2012
 
Description IEEQC local dissemination conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Three separate IEEQC local dissemination conferences were held in collaboration with each of the three Local Education Authorites (LEAs) participating in the IEEQC project. Attended by local officials as well as head and deputy head teachers from schools participating in the study. 50-100+ delegates for each event. Confidential LEA specific findings from IEEQC study were presented and followed up by circulation of IEEQC summary report (in Chinese). IEEQC summary report has also been submitted for publication in Educational Research (high impact Chinese journal).
Year(s) Of Engagement Activity 2012
URL http://www.bristol.ac.uk/education/research/sites/ieeqc/activities.html
 
Description IEEQC local dissemination conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Three separate IEEQC local dissemination conferences were held in collaboration with each of the three Local Education Authorites (LEAs) participating in the IEEQC project. Attended by local officials as well as head and deputy head teachers from schools participating in the study. 50-100+ delegates for each event. Confidential LEA specific findings from IEEQC study were presented and followed up by circulation of IEEQC summary report (in Chinese). IEEQC summary report has also been submitted for publication in Educational Research (high impact Chinese journal).
Year(s) Of Engagement Activity 2012
URL http://www.bristol.ac.uk/education/research/sites/ieeqc/activities.html
 
Description IEEQC project : examples of value added methods to evaluation school performance in UK 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact Invited lecture for staff and postgraduate students at School of Psychology, Beijing Normal University. 50+ participants
Year(s) Of Engagement Activity 2011
 
Description IEEQC project national dissemination conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact IEEQC national dissemination conference organised by National Institute for Educational Sciences (NIES formerly CNIER) in collaboration with Beijing Examination Board and chaired by IEEQC China coordinator Mr Jianzhong Li. Programme comprises 10 presentations: (1) speech of the deputy president of Beijing Examination Board, Mr Tiejun Zhang; (2) speech of the director of Office of National Education Inspectorate, Ministry of Education, Mr Lishuang Cui; (3) 'Introduction to Methods to Evaluate Educational Quality and Improvement in China' by Prof Sally Thomas; (4) 'Findings of IEEQC qualitative study' by Dr Xiangrong Wu and Ms Zhong Zhang; (5) 'Findings of IEEQC quantitative study' by Dr Wen-Jung Peng and Ms Chunrong Ren; (6) 'Comparative study on teacher evaluation indicator systems' by Prof Hechuan Sun, Shenyang Normal University; (7) 'The establishment of monitoring system of compulsory education in China' by Director Fan Liu, Centre for Educational Evaluation Research, CNIER; (8) 'Evaluation on study ability in Child-friendly schools' by Prof Yong-hong Cai, Beijing Normal University; (9) 'Analysis and use of exam data for improving educational teaching quality' by Mr Xiutao Ding, deputy director of Admission Office, Beijing Exam Board; and (10) launch of new ESRC/DFID project 'Improving Teacher Development and Educational Quality in China' (ITDEQC) by Prof Sally Thomas.

Presentations in English and Chinese
Year(s) Of Engagement Activity 2012
URL http://www.bristol.ac.uk/education/research/sites/ieeqc/activities.html
 
Description IEEQC project national dissemination conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact IEEQC national dissemination conference organised by National Institute for Educational Sciences (NIES formerly CNIER) in collaboration with Beijing Examination Board and chaired by IEEQC China coordinator Mr Jianzhong Li. Programme comprises 10 presentations: (1) speech of the deputy president of Beijing Examination Board, Mr Tiejun Zhang; (2) speech of the director of Office of National Education Inspectorate, Ministry of Education, Mr Lishuang Cui; (3) 'Introduction to Methods to Evaluate Educational Quality and Improvement in China' by Prof Sally Thomas; (4) 'Findings of IEEQC qualitative study' by Dr Xiangrong Wu and Ms Zhong Zhang; (5) 'Findings of IEEQC quantitative study' by Dr Wen-Jung Peng and Ms Chunrong Ren; (6) 'Comparative study on teacher evaluation indicator systems' by Prof Hechuan Sun, Shenyang Normal University; (7) 'The establishment of monitoring system of compulsory education in China' by Director Fan Liu, Centre for Educational Evaluation Research, CNIER; (8) 'Evaluation on study ability in Child-friendly schools' by Prof Yong-hong Cai, Beijing Normal University; (9) 'Analysis and use of exam data for improving educational teaching quality' by Mr Xiutao Ding, deputy director of Admission Office, Beijing Exam Board; and (10) launch of new ESRC/DFID project 'Improving Teacher Development and Educational Quality in China' (ITDEQC) by Prof Sally Thomas. Presentations in English and Chinese
Year(s) Of Engagement Activity 2012
 
Description Improving education quality in rural areas 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Invited opinion article written by Prof Sally Thomas for 'China daily' on 23rd November 2011. China Daily is the largest circulation English language newspaper in China

China daily
Year(s) Of Engagement Activity 2012
URL http://www.chinadaily.com.cn/opinion/2011-11/22/content_14138188.htm
 
Description Improving educational evaluation and quality in China 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Participants in your research or patient groups
Results and Impact Summary Presentation for RCUK. Round Table Presentation by Mr Jianzhong Li IEEQC project lead researcher. Organised by Research Councils UK, China Office and attended by Chris Godwin, director of RCUK China Office and Chris Whitty, Chief Scientific Adviser, DfID. Participants included current and potential award holders of ESRC/DFID research programme.

Section not completed
Year(s) Of Engagement Activity 2010
 
Description Improving educational evaluation and teacher development in China 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact Presentation as part of public lecture series, Festival of Education, Graduate School of Education, University of Bristol. Overview and discussion of IEEQC and ITDEQC project aims and findings.
Year(s) Of Engagement Activity 2011
 
Description Introduction to improving educational evaluation and quality in China 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Seminar for educational policy makers and practitioners at Yuxi Municipal Education Bureau, Yuannan Province, China
Year(s) Of Engagement Activity 2011
 
Description Launch of IEEQC project 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact China Education Daily News article about launch of IEEQC project

China education daily
Year(s) Of Engagement Activity 2012
 
Description Teacher development and educational evaluation in China 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact National Institute for Educational Sciences (NIES formerly CNIER)/Ministry of Education joint seminar in Beijing: 5 speeches and papers i) Chair and opening remarks by Prof Jianfeng Liu, Vice-president of NIES; ii) the Monitoring and Evaluation System of Basic Education in China by Mr Lishuang Cui, Director of Office of Educational Quality Monitoring Inspectorate, MOE; iii) Introduction of IEEQC and ITDEQC projects by Prof Sally Thomas; iv) Overview of Evidence from IEEQC and ITDEQC projects by Dr Wen-Jung Peng; and v) the Current State of Teacher Professional Development in Beijing Haidian District by Mr Xinglin Yan from Educational Research Institute of Beijing Haidian District.

Presentations in Chinese and English.
Year(s) Of Engagement Activity 2012
 
Description Teacher development and educational quality in China, Africa and UK 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Joint international seminar with CTER (Beijing Normal University), INRULED (UNESCO), and NIES/University of Bristol ITDEQC project
Year(s) Of Engagement Activity 2012
 
Description The IEEQC project launch seminar 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact The IEEQC project launch seminar introducing the research project to policy makers, practitioners and academics. 50+ participants

Presentation by Prof Sally Thomas and Dr Wen-Jung Peng.

Disscussants included Mr. Chris Godwin, Director of Research Councils UK office in Beijing; Prof. Zhang Jingbin, Dean of Faculty of Education, Beijing Capital Normal University; Mr. Huang Weimin, Headteacher of No.39 High School, Xi'an City; Dr Tian Hui, Deputy President, CNIER; Director Liu Fang, Director of Center for Inspection and Evaluation and concurrently Center for Basic Education, CNIERhe introduction and background research related to the IEEQC project in China National Institute of Educational Research (CNIER), Beijing.
Year(s) Of Engagement Activity 2008
 
Description The importance of quality education 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Invited article on education quality in China Daily - largest circulation English Language newspaper in China

China daily
Year(s) Of Engagement Activity 2012
URL http://www.chinadaily.com.cn/opinion/2010-07/15/content_10108431.htm
 
Description University of Bristol Research Briefing No. 23 Improving Educational Evaluation and Teacher Development in China 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact University of Bristol Research Briefing No. 23 Improving Educational Evaluation and Teacher Development in China - summary of findings from ITDEQC and IEEQC projects
Year(s) Of Engagement Activity 2016
URL http://www.bristol.ac.uk/media-library/sites/education/documents/research-briefings/research-briefin...