Wage and Employment Dynamics - Phase 3 (WED3)
Lead Research Organisation:
University of the West of England
Abstract
Many OECD countries have been utilising linked administrative data sources to understand their labour markets for many years, allowing them to gain a deep understanding of labour market dynamics. The UK has fallen behind due to the lack of an integrated view on the whole of an individual's labour market interactions.
The ADR UK funded projects Wage and Employment Dynamics Phase 1 and Phase 2 (WED1 and WED2) sought to address this by combining ONS survey data from the Annual Survey of Hours and Earnings (ASHE) with business data, Census 2011 data, and administrative earnings data from HMRC. The aim of WED Phase 3 (WED3) is to add to previous WED projects, creating a sustainable, integrated, documented set of datasets prepared for research, linked by a wage and employment spine (WED) held by ONS.
This has the potential to fundamentally transform GB research and policy analysis across a vast range of topics. Public benefit is maximised through the provision of high-quality information on the datasets themselves (metadata) and training for accredited researchers. Alongside the creation of data infrastructure, the project will generate its own research findings of direct interest to policy makers, to demonstrate that the data creation provides research value.
WED1 created an improved, quality-assured and reweighted ASHE, and linked to the Census 2011 and Inter-Departmental Business Register. WED2 is in the process of linking in HMRC Self-Assessment and PAYE data, so that a complete picture of the working life can be gained.
WED3 will integrate the Migrant Worker Scan (MWS). By linking this dataset, the project aims to ensure that the information on individual personal characteristics remains current (Census 2021). It will also enable researchers to gain a richer understanding the experience and impact of migrant workers in the workforce (MWS).
The proposed work under WED3 will enable the benefits of the WED1 and WED2 to be fully realised, enabling researchers to better understand and improve current policy challenges, such as in-work poverty, the Gender/Ethnic, and the impact of the National Minimum Wage. The creation of these new links will bypass limitations created by solely analysing individual datasets, thereby enabling researchers to broaden their scope and understanding of the labour market in Great Britain.
In line with ADR UK's priorities, the WED team are actively engaging with the public and organisations that represent them to understand their interests and concerns in relation to using public sector data for research purposes. The WED team has set up a governance structure of three stakeholder groups (government, academic and public) to ensure the needs of all parties are met, and to ensure that the public sector data used in the project is used ethically and responsibly. This structure also enables groups to shape research, maximising the public benefit of administrative data research.
We have strong support for WED3 from data owners (e.g. HMRC, HESA), project partners (Low Pay Commission) and strategic data users (e.g. HM Treasury and Bank of England), evidenced by signed letters of support. The project will place the UK amongst leading nations when it comes to understanding the dynamics of their labour market; and this will help inform policy, ultimately leading to improvement in the lives of its citizens.
The ADR UK funded projects Wage and Employment Dynamics Phase 1 and Phase 2 (WED1 and WED2) sought to address this by combining ONS survey data from the Annual Survey of Hours and Earnings (ASHE) with business data, Census 2011 data, and administrative earnings data from HMRC. The aim of WED Phase 3 (WED3) is to add to previous WED projects, creating a sustainable, integrated, documented set of datasets prepared for research, linked by a wage and employment spine (WED) held by ONS.
This has the potential to fundamentally transform GB research and policy analysis across a vast range of topics. Public benefit is maximised through the provision of high-quality information on the datasets themselves (metadata) and training for accredited researchers. Alongside the creation of data infrastructure, the project will generate its own research findings of direct interest to policy makers, to demonstrate that the data creation provides research value.
WED1 created an improved, quality-assured and reweighted ASHE, and linked to the Census 2011 and Inter-Departmental Business Register. WED2 is in the process of linking in HMRC Self-Assessment and PAYE data, so that a complete picture of the working life can be gained.
WED3 will integrate the Migrant Worker Scan (MWS). By linking this dataset, the project aims to ensure that the information on individual personal characteristics remains current (Census 2021). It will also enable researchers to gain a richer understanding the experience and impact of migrant workers in the workforce (MWS).
The proposed work under WED3 will enable the benefits of the WED1 and WED2 to be fully realised, enabling researchers to better understand and improve current policy challenges, such as in-work poverty, the Gender/Ethnic, and the impact of the National Minimum Wage. The creation of these new links will bypass limitations created by solely analysing individual datasets, thereby enabling researchers to broaden their scope and understanding of the labour market in Great Britain.
In line with ADR UK's priorities, the WED team are actively engaging with the public and organisations that represent them to understand their interests and concerns in relation to using public sector data for research purposes. The WED team has set up a governance structure of three stakeholder groups (government, academic and public) to ensure the needs of all parties are met, and to ensure that the public sector data used in the project is used ethically and responsibly. This structure also enables groups to shape research, maximising the public benefit of administrative data research.
We have strong support for WED3 from data owners (e.g. HMRC, HESA), project partners (Low Pay Commission) and strategic data users (e.g. HM Treasury and Bank of England), evidenced by signed letters of support. The project will place the UK amongst leading nations when it comes to understanding the dynamics of their labour market; and this will help inform policy, ultimately leading to improvement in the lives of its citizens.
| Description | Creation of the ASHE-MWS Dataset One of the most significant outcomes of this project is the creation and curation of the ASHE-Migrant Workers Scan (ASHE-MWS) dataset. By linking ASHE, a well-established survey on wages and earnings, with HMRC's Migrant Workers Scan (MWS), which records National Insurance registrations of non-UK nationals, we have created a valuable resource for understanding the labour market experiences of migrant workers. This linkage provides a richer and more comprehensive picture of migrant earnings and employment trajectories over time. It enables researchers to examine how wages evolve after arrival in the UK, how migrant workers move between jobs and sectors, and how their earnings compare with UK-born workers. For policymakers and researchers, this dataset represents an important public good that strengthens evidence-based decision-making. It allows more robust analysis of issues such as wage inequality, labour market integration, regional employment patterns, and the effects of policy changes affecting migrant workers. By improving the evidence base on how migrant workers progress in the labour market, the dataset supports better-informed strategies for economic growth, productivity, and social inclusion. User documentation The ASHE-MWS dataset has been fully developed, curated, and are now held as flagship datasets by ADR UK. Its establishment as a national research asset ensures long-term accessibility for researchers across academia, government, and the public sector. In order to promote and support their use the WED team have produced a number of documents including the MWS user guide, data dictionaries, metadata, other quality assurance papers Stakeholder Support The project has curated a research community composed of a diversity of academic, government and public stakeholders. We have created the WED project KnowledgeHub, a knowledge sharing platform designed for peer-to-peer collaboration for users of the WED datasets; established a Community of Interest with profiles of data users on the WED website, establishing connections between them and other researchers; and have set up regular meetings with new data users to guide their research. We have held quarterly stakeholder meetings to discuss the project's progress, and the most recent meeting was devoted to platforming new data users, connecting them with important stakeholders, such as those working with HMRC and other data users, and established mechanisms for keeping the community informed of research advances. We also support a number of ESRC funded PhD's and ADR UK funded research fellows to use these ADR UK flagship datasets, producing insights into policy relevant areas, including the disability wage gap, inequality-driven skills gaps, and job to job mobility. |
| Exploitation Route | The WED stakeholder group network has become a significant part of the project's success. It contains academic, government and public representatives, each with direct links to one another. The stakeholder group meetings have been especially fruitful, allowing researchers to connect with policy makers to ensure priorities are aligned. In the latest meeting we platformed new data users, allowing new connections to be made. As these meetings have been so useful, it has been decided that the meetings will continue, and the stakeholder group will be maintained going forward, allowing new research collaborations to be made. Further, the WED team have secured funding for a fifth phase of the WED project, in which additional years of HMRC data will be made available to create a longitudinal linkage. This will further the usefulness of the existing linkage by keeping the data recent and relevant to both academic and policy stakeholders. |
| Sectors | Government Democracy and Justice |
| URL | https://www.wagedynamics.com/ashe-mws/ |
| Description | The Wage and Employment (WED) project is having a significant economic and societal impact as it has produced, documented and released linked administrative datasets which are available as a "public good". These datasets are now being used by several academic and government researchers, informing both policy and academic debate. The WED project has released the ASHE (Annual survey of Hours and Earnings) - Migrant Worker Scan (MWS) linked dataset, which is available via the Office for National Statistics' Secure Research Service (SRS). The ASHE-MWS linked data are supported with documentation which includes quick start guides and full variable listing. In addition to releasing the dataset as a public good, a number of publications which showcase the affordances of the dataset have been produced, including one which explores wage progression and labour market integration of migrant workers in the UK, and one which explores the differences in labour market outcomes between immigrant and UK-born employees. Further, the WED team created three stakeholder groups (Academic; Government; and Public) to oversee the project and inform research priorities, and have undertaken a programme of promotion. Members of the Government Stakeholder group include HM Treasury, Bank of England and the Department of Work and Pensions. Promotion of the outputs was mainly through academic and policy conferences, as well as specially tailored events. The events included the following: Work, Pensions and Labour Economics Study Group (WPEG) Conference (2024) Work, Pensions and Labour Economics Study Group Special Session (2025) Economic Statistics Centre of Excellence (ESCoE) Conference (2024) ONS Earnings Symposium (2025) Colloquium on Personnel Economics Conference (CoPE) (2024, 2025) Low Pay Commission Research Symposium (2024) ADR Research Innovation Workshop (2024) Royal Economic Society Conference (2025) Pint of Science (2025) ONS Research Excellence Series (2024, 2025) ESRC Southwest Regional Engagement Event (2025) ONS Research Capability Event (2025) Royal Statistical Society Conference (2025) LPC Research symposium (2025) |
| First Year Of Impact | 2025 |
| Impact Types | Economic Policy & public services |
| Description | ADR UK research fellowships 2022 |
| Amount | £113,590 (GBP) |
| Funding ID | ES/Y001184/1 |
| Organisation | Economic and Social Research Council |
| Sector | Public |
| Country | United Kingdom |
| Start | 08/2023 |
| End | 02/2025 |
| Description | Future Data Services Senior Strategic Fellowship |
| Amount | £73,200 (GBP) |
| Funding ID | ES/X001288/1 |
| Organisation | Economic and Social Research Council |
| Sector | Public |
| Country | United Kingdom |
| Start | 05/2022 |
| End | 05/2024 |
| Description | Low Pay Commission |
| Organisation | Low Pay Commission |
| Country | United Kingdom |
| Sector | Private |
| PI Contribution | We are working to support LPC researchers. |
| Collaborator Contribution | LPC have made an in-kind contribution of dedicating research time to the WED project. |
| Impact | Project has just started, so no outputs to report at this stage. |
| Start Year | 2022 |
| Description | ADR UK Linkage Steering Group |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | The ADR UK Linkage Steering group considers ways to help deliver the strategic objectives of ADR UK's research strategy - we report progress in relation to all three WED projects. |
| Year(s) Of Engagement Activity | 2022 |
| Description | Academic Stakeholder Group |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | A group of seven academics who contribute to governance and setting strategy for the WED project. |
| Year(s) Of Engagement Activity | 2022 |
| URL | http://www.wagedynamics.com |
| Description | Data Research, Access and Governance Network research Group |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | Local |
| Primary Audience | Professional Practitioners |
| Results and Impact | Introduced the work of the WED programme to the DRAGoN research Group at UWE |
| Year(s) Of Engagement Activity | 2023 |
| Description | Government Stakeholder Group |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Policymakers/politicians |
| Results and Impact | Representatives from nine government/policy departments (i.e. Bank of England, DWP, DfE, BEIS, HM Treasury, Government Equalities Office, Low Pay Commission, ONS and Welsh Government |
| Year(s) Of Engagement Activity | 2022 |
| URL | http://www.wagedynamics.com |
| Description | Institute of Fiscal Studies |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | IFS hosted a WED event to explore ways in which the WED datasets could inform the work of the IFS. |
| Year(s) Of Engagement Activity | 2022 |
| Description | Joseph Rowntree Foundation Funding Call |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Policymakers/politicians |
| Results and Impact | Following exploratory discussions, JRF presented at two WED workshops which were set up to promote the use of the WED datasets. they focussed on the WED 2 datasets, as it allowed researchers to focus on within year income volatility. |
| Year(s) Of Engagement Activity | 2022 |
| Description | Migration Advisory Committee |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Policymakers/politicians |
| Results and Impact | Following initial meetings with the secretariat of the Migration Advisory Committee, a representative presented at the WED Workshop to promote research ideas using the WED3 dataset. |
| Year(s) Of Engagement Activity | 2022 |
| Description | National Institute of Economic and Social Research |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | NIESR hosted an event promoting the WED project. |
| Year(s) Of Engagement Activity | 2022 |
| Description | Presentation to Health Foundation |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Third sector organisations |
| Results and Impact | Presentation on new and upcoming ASHE linked data assets to around 15 participants from the Health Foundation and its REAL Supply Unit, prompting discussion about how these data can be used for evidence-based policy making around the challenges facing the health and social care workforce. |
| Year(s) Of Engagement Activity | 2025 |
| Description | Public Engagement Strategic Group |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Third sector organisations |
| Results and Impact | A group of six organisations to oversee and build trust in the project. |
| Year(s) Of Engagement Activity | 2022 |
| URL | http://www.wagedynamics.com |
| Description | Public Engagement Strategy Group Meeting |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Professional Practitioners |
| Results and Impact | Met with 5 Public Engagement Strategy Group members to better understand their research needs . |
| Year(s) Of Engagement Activity | 2024 |
| Description | WED Training Event - Understanding and using the WED Code |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | Practical training session to inform potential users of the WED dataset how to work with the WED code. |
| Year(s) Of Engagement Activity | 2022 |
| URL | http://www.wagedynamics.com |
| Description | WED Workshop - University of Sheffield |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | A workshop hosted by the University of Sheffield to bring together the academic and policy community to explore how the WED datasets could be used to answer policy questions. |
| Year(s) Of Engagement Activity | 2022 |
| URL | http://www.wagedynamics.com |
| Description | Wed Workshop - Bank of England |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | A workshop hosted by the Bank of England to bring together the academic and policy community to explore how the WED datasets could be used to answer policy questions. |
| Year(s) Of Engagement Activity | 2022 |
| URL | http://www.wagedynamics.com |
