Improving Educational Evaluation and Quality in China
Lead Research Organisation:
University of Bristol
Department Name: Education
Abstract
Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.
People |
ORCID iD |
| Sally Thomas (Principal Investigator) | |
| Wen-Jung Peng (Co-Investigator) |
Publications
Chunrong Ren (Author)
(2009)
_____________
in China examinations
Goldstein H
(2008)
Reflections on the international comparative surveys debate
in Assessment in Education: Principles, Policy & Practice
Muñoz-Chereau B
(2015)
Educational effectiveness in Chilean secondary education: comparing different 'value added' approaches to evaluate schools
in Assessment in Education: Principles, Policy & Practice
Peng W
(2014)
Emerging perceptions of teacher quality and teacher development in China
in International Journal of Educational Development
Sally Thomas (Author)
(2011)
Using value added feedback for accountability and school improvement purposes
Sally Thomas (Author)
(2011)
Improving educational evaluation and teacher development in China
Sally Thomas (Author)
(2010)
Measuring educational quality in China : concepts and evidence
Sally Thomas (Author)
(2011)
Exploring educational quality across three regions in China
Sally Thomas (Author)
(2012)
Improving educational evaluation and teacher development : using value added measures of school performance in China
Sally Thomas (Author)
(2010)
Exploring the range and extent of senior secondary school effectiveness across three regions in mainland China
| Description | Study 1: Measuring school effectiveness: The optimal "value added" model for estimating Chinese senior secondary school effects (identified using standard statistical criteria) adjusted for factors outside the control of schools including student's prior attainment, individual background characteristics and school context. Some explanatory variables found to be statistically significant may be unique to China (eg family residence status) and some unexpected results were found (eg mobile phone ownership indicated a negative relationship and parents agricultural employment indicated a positive relationship with students examination performance) highlighting regional differences in China and in comparison to developed countries. Across the three local education authorities (LEAs) investigated these models explained 43%-57% of the total variance in students Higher Education (HE) entrance examination total scores. Of the remaining unexplained variance 5-15% was attributable to differences between schools, slightly higher than equivalent UK findings, and statistically significant differences within LEAs in terms of schools' "value added" measures were found. However the impact of school context varied considerably between LEAs (explaining 7%-33% of school variance), as did the impact of additional school input/process variables, indicating a greater influence of these factors on school performance in some regions. Evidence of differential within school effects for different curriculum subjects and student groups (eg by prior attainment) were also found, although the strength of evidence varied across LEAs suggesting that local policies and practices may play an important role, and that a range of "value added" measures are required to fully evaluate school effectiveness in China. Further research is planned to extend and clarify these findings over four student cohorts and in relation to improving teacher development and quality (see ESRC award RES-167-25-0428). Study 2: Definitions of educational quality and approaches to school evaluation: Stakeholder perceptions of educational quality can be understood in terms of outcomes, context, inputs and processes, reflecting typical western school effectiveness models, but also emphasise the particular importance of equity especially with regard to reducing east/west and rural/urban differences. Moreover, valued student outcomes seem relatively broader than elsewhere due to the recent national education policy reform to promote students all-round development and the enduring influence of Confucius philosophy promoting scholarship. Nevertheless, many stakeholders recognise that in practice raw examination achievement remains the critical indicator of educational quality, which subsequently influences teaching practices and this is unlikely to change without Higher Education entrance and examination system reform. School and teacher evaluation methods in China are typically seen by some stakeholders as unscientific, locally and variably regulated and also not sufficiently focused on school improvement. A few examples of schools adapting and using "value added" approaches informally were identified although it was recognised that further guidance and training is needed for policy makers, practitioners and public to understand the "value added" concept and statistical methods. It was widely acknowledged that "Value Added" measures would provide an important and welcome addition to current school evaluation and self-evaluation systems in China, although there is a need to adapt methods to local priorities (students' all-round development) and be aware of methodological limitations. |
| Exploitation Route | This study provides a pilot for ways in which the evaluation of educational quality and school effectiveness could be improved in China and elsewhere. Educational policy makers and practitioners could use the value added methods presented, alongside other types of evidence, to develop and improve systems of school self evaluation and accountability. |
| Sectors | Education |
| URL | http://ieeqc.bristol.ac.uk |
| Description | Enhancing the Impact of ITDEQC and IEEQC ESRC/DFID funded projects |
| Amount | £20,000 (GBP) |
| Organisation | Economic and Social Research Council |
| Sector | Public |
| Country | United Kingdom |
| Start | 08/2016 |
| End | 03/2018 |
| Description | Research partnership between National Institute for Education Sciences Beijing and School of Education University of Bristol |
| Organisation | Government of China |
| Department | National Institute of Education Sciences |
| Country | China |
| Sector | Academic/University |
| PI Contribution | Conducted joint research projects funded by British Council Beijing and ESRC DFID/ESRC IAA |
| Collaborator Contribution | Conducted joint research projects funded by British Council Beijing and ESRC DFID/ESRC IAA |
| Impact | see outcomes from IEEQC and ITDEQC projects |
| Description | Diverse perspectives on, and the role of a multilevel modelling approach to education quality in China |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Postgraduate students |
| Results and Impact | Seminar presentation for International and Comparative Studies center at Graduate School of Education, University of Bristol |
| Year(s) Of Engagement Activity | 2009 |
| Description | Fairer access to quality schools |
| Form Of Engagement Activity | A magazine, newsletter or online publication |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Media (as a channel to the public) |
| Results and Impact | Invited article written by Prof Sally Thomas for China Daily on 4th July 2012. China Daily is the largest circulation English language print newspaper in China. China Daily |
| Year(s) Of Engagement Activity | 2012 |
| URL | http://www.chinadaily.com.cn/cndy/2012-07/04/content_15546894.htm |
| Description | Fairer access to quality schools |
| Form Of Engagement Activity | A magazine, newsletter or online publication |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Media (as a channel to the public) |
| Results and Impact | Invited article written by Prof Sally Thomas for China Daily on 4th July 2012. China Daily is the largest circulation English language print newspaper in China. China Daily |
| Year(s) Of Engagement Activity | 2012 |
| URL | http://www.chinadaily.com.cn/cndy/2012-07/04/content_15546894.htm |
| Description | IEEQC : examples of value added methods to evaluation school performance in UK |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Professional Practitioners |
| Results and Impact | Seminar for academics, educational policy makers and practitioners at the Beijing Academy of Educational Sciences |
| Year(s) Of Engagement Activity | 2009 |
| Description | IEEQC local dissemination conference |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | Three separate IEEQC local dissemination conferences were held in collaboration with each of the three Local Education Authorites (LEAs) participating in the IEEQC project. Attended by local officials as well as head and deputy head teachers from schools participating in the study. 50-100+ delegates for each event. Confidential LEA specific findings from IEEQC study were presented and followed up by circulation of IEEQC summary report (in Chinese). IEEQC summary report has also been submitted for publication in Educational Research (high impact Chinese journal). |
| Year(s) Of Engagement Activity | 2012 |
| URL | http://www.bristol.ac.uk/education/research/sites/ieeqc/activities.html |
| Description | IEEQC local dissemination conference |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | Three separate IEEQC local dissemination conferences were held in collaboration with each of the three Local Education Authorites (LEAs) participating in the IEEQC project. Attended by local officials as well as head and deputy head teachers from schools participating in the study. 50-100+ delegates for each event. Confidential LEA specific findings from IEEQC study were presented and followed up by circulation of IEEQC summary report (in Chinese). IEEQC summary report has also been submitted for publication in Educational Research (high impact Chinese journal). |
| Year(s) Of Engagement Activity | 2012 |
| URL | http://www.bristol.ac.uk/education/research/sites/ieeqc/activities.html |
| Description | IEEQC local dissemination conference |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Professional Practitioners |
| Results and Impact | Three separate IEEQC local dissemination conferences were held in collaboration with each of the three Local Education Authorites (LEAs) participating in the IEEQC project. Attended by local officials as well as head and deputy head teachers from schools participating in the study. 50-100+ delegates for each event. Confidential LEA specific findings from IEEQC study were presented and followed up by circulation of IEEQC summary report (in Chinese). IEEQC summary report has also been submitted for publication in Educational Research (high impact Chinese journal). |
| Year(s) Of Engagement Activity | 2012 |
| Description | IEEQC project : examples of value added methods to evaluation school performance in UK |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Postgraduate students |
| Results and Impact | Invited lecture for staff and postgraduate students at School of Psychology, Beijing Normal University. 50+ participants |
| Year(s) Of Engagement Activity | 2011 |
| Description | IEEQC project national dissemination conference |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | IEEQC national dissemination conference organised by National Institute for Educational Sciences (NIES formerly CNIER) in collaboration with Beijing Examination Board and chaired by IEEQC China coordinator Mr Jianzhong Li. Programme comprises 10 presentations: (1) speech of the deputy president of Beijing Examination Board, Mr Tiejun Zhang; (2) speech of the director of Office of National Education Inspectorate, Ministry of Education, Mr Lishuang Cui; (3) 'Introduction to Methods to Evaluate Educational Quality and Improvement in China' by Prof Sally Thomas; (4) 'Findings of IEEQC qualitative study' by Dr Xiangrong Wu and Ms Zhong Zhang; (5) 'Findings of IEEQC quantitative study' by Dr Wen-Jung Peng and Ms Chunrong Ren; (6) 'Comparative study on teacher evaluation indicator systems' by Prof Hechuan Sun, Shenyang Normal University; (7) 'The establishment of monitoring system of compulsory education in China' by Director Fan Liu, Centre for Educational Evaluation Research, CNIER; (8) 'Evaluation on study ability in Child-friendly schools' by Prof Yong-hong Cai, Beijing Normal University; (9) 'Analysis and use of exam data for improving educational teaching quality' by Mr Xiutao Ding, deputy director of Admission Office, Beijing Exam Board; and (10) launch of new ESRC/DFID project 'Improving Teacher Development and Educational Quality in China' (ITDEQC) by Prof Sally Thomas. Presentations in English and Chinese |
| Year(s) Of Engagement Activity | 2012 |
| URL | http://www.bristol.ac.uk/education/research/sites/ieeqc/activities.html |
| Description | IEEQC project national dissemination conference |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | IEEQC national dissemination conference organised by National Institute for Educational Sciences (NIES formerly CNIER) in collaboration with Beijing Examination Board and chaired by IEEQC China coordinator Mr Jianzhong Li. Programme comprises 10 presentations: (1) speech of the deputy president of Beijing Examination Board, Mr Tiejun Zhang; (2) speech of the director of Office of National Education Inspectorate, Ministry of Education, Mr Lishuang Cui; (3) 'Introduction to Methods to Evaluate Educational Quality and Improvement in China' by Prof Sally Thomas; (4) 'Findings of IEEQC qualitative study' by Dr Xiangrong Wu and Ms Zhong Zhang; (5) 'Findings of IEEQC quantitative study' by Dr Wen-Jung Peng and Ms Chunrong Ren; (6) 'Comparative study on teacher evaluation indicator systems' by Prof Hechuan Sun, Shenyang Normal University; (7) 'The establishment of monitoring system of compulsory education in China' by Director Fan Liu, Centre for Educational Evaluation Research, CNIER; (8) 'Evaluation on study ability in Child-friendly schools' by Prof Yong-hong Cai, Beijing Normal University; (9) 'Analysis and use of exam data for improving educational teaching quality' by Mr Xiutao Ding, deputy director of Admission Office, Beijing Exam Board; and (10) launch of new ESRC/DFID project 'Improving Teacher Development and Educational Quality in China' (ITDEQC) by Prof Sally Thomas. Presentations in English and Chinese |
| Year(s) Of Engagement Activity | 2012 |
| Description | Improving education quality in rural areas |
| Form Of Engagement Activity | A magazine, newsletter or online publication |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Media (as a channel to the public) |
| Results and Impact | Invited opinion article written by Prof Sally Thomas for 'China daily' on 23rd November 2011. China Daily is the largest circulation English language newspaper in China China daily |
| Year(s) Of Engagement Activity | 2012 |
| URL | http://www.chinadaily.com.cn/opinion/2011-11/22/content_14138188.htm |
| Description | Improving educational evaluation and quality in China |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Participants in your research or patient groups |
| Results and Impact | Summary Presentation for RCUK. Round Table Presentation by Mr Jianzhong Li IEEQC project lead researcher. Organised by Research Councils UK, China Office and attended by Chris Godwin, director of RCUK China Office and Chris Whitty, Chief Scientific Adviser, DfID. Participants included current and potential award holders of ESRC/DFID research programme. Section not completed |
| Year(s) Of Engagement Activity | 2010 |
| Description | Improving educational evaluation and teacher development in China |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Public/other audiences |
| Results and Impact | Presentation as part of public lecture series, Festival of Education, Graduate School of Education, University of Bristol. Overview and discussion of IEEQC and ITDEQC project aims and findings. |
| Year(s) Of Engagement Activity | 2011 |
| Description | Introduction to improving educational evaluation and quality in China |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Professional Practitioners |
| Results and Impact | Seminar for educational policy makers and practitioners at Yuxi Municipal Education Bureau, Yuannan Province, China |
| Year(s) Of Engagement Activity | 2011 |
| Description | Launch of IEEQC project |
| Form Of Engagement Activity | A magazine, newsletter or online publication |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Media (as a channel to the public) |
| Results and Impact | China Education Daily News article about launch of IEEQC project China education daily |
| Year(s) Of Engagement Activity | 2012 |
| Description | Teacher development and educational evaluation in China |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | National Institute for Educational Sciences (NIES formerly CNIER)/Ministry of Education joint seminar in Beijing: 5 speeches and papers i) Chair and opening remarks by Prof Jianfeng Liu, Vice-president of NIES; ii) the Monitoring and Evaluation System of Basic Education in China by Mr Lishuang Cui, Director of Office of Educational Quality Monitoring Inspectorate, MOE; iii) Introduction of IEEQC and ITDEQC projects by Prof Sally Thomas; iv) Overview of Evidence from IEEQC and ITDEQC projects by Dr Wen-Jung Peng; and v) the Current State of Teacher Professional Development in Beijing Haidian District by Mr Xinglin Yan from Educational Research Institute of Beijing Haidian District. Presentations in Chinese and English. |
| Year(s) Of Engagement Activity | 2012 |
| Description | Teacher development and educational quality in China, Africa and UK |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Policymakers/politicians |
| Results and Impact | Joint international seminar with CTER (Beijing Normal University), INRULED (UNESCO), and NIES/University of Bristol ITDEQC project |
| Year(s) Of Engagement Activity | 2012 |
| Description | The IEEQC project launch seminar |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Policymakers/politicians |
| Results and Impact | The IEEQC project launch seminar introducing the research project to policy makers, practitioners and academics. 50+ participants Presentation by Prof Sally Thomas and Dr Wen-Jung Peng. Disscussants included Mr. Chris Godwin, Director of Research Councils UK office in Beijing; Prof. Zhang Jingbin, Dean of Faculty of Education, Beijing Capital Normal University; Mr. Huang Weimin, Headteacher of No.39 High School, Xi'an City; Dr Tian Hui, Deputy President, CNIER; Director Liu Fang, Director of Center for Inspection and Evaluation and concurrently Center for Basic Education, CNIERhe introduction and background research related to the IEEQC project in China National Institute of Educational Research (CNIER), Beijing. |
| Year(s) Of Engagement Activity | 2008 |
| Description | The importance of quality education |
| Form Of Engagement Activity | A magazine, newsletter or online publication |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Media (as a channel to the public) |
| Results and Impact | Invited article on education quality in China Daily - largest circulation English Language newspaper in China China daily |
| Year(s) Of Engagement Activity | 2012 |
| URL | http://www.chinadaily.com.cn/opinion/2010-07/15/content_10108431.htm |
| Description | University of Bristol Research Briefing No. 23 Improving Educational Evaluation and Teacher Development in China |
| Form Of Engagement Activity | A magazine, newsletter or online publication |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | University of Bristol Research Briefing No. 23 Improving Educational Evaluation and Teacher Development in China - summary of findings from ITDEQC and IEEQC projects |
| Year(s) Of Engagement Activity | 2016 |
| URL | http://www.bristol.ac.uk/media-library/sites/education/documents/research-briefings/research-briefin... |