Evaluation of Research and Development (R&D) Expenditures, Firm Survival, Firm Growth and Employment: UK Evidence in the OECD Context

Lead Research Organisation: University of Greenwich
Department Name: Business School

Abstract

The latest strategy paper by the Department for Business Innovation and Skills states that innovation is the "main pathway to sustainable economic growth, higher real incomes and greater wellbeing in the long run" (BIS, 2011). Similar assessments are made in the latest consultation document published by HM Treasury in June 2011. The latter also indicates that the government is committed to maintain the R&D Tax Credits scheme and make it more accessible to small firms and start-ups.

These policy initiatives are unfolding against a background of tighter credit markets in the wake of the financial crisis. Recent surveys indicate that company managers and R&D directors tend to be more strategic in their decisions concerning innovation processes and portfolios. Fiscal constraints caused by the crisis have also led to higher public and government expectations that public spending priorities should be justified on the basis of beneficial outcomes.

Given this environment, it is essential to strengthen the evidence base on how incentive schemes affect R&D expenditures by firms, how R&D effort may affect firm survival and performance, how these effects vary between UK firms and industries, how the UK evidence compares with synthesized OECD evidence. The proposed research aims to address these questions in three stages.

In stage 1, we conduct meta-analysis to establish whether or not R&D expenditures are effective in stimulating growth and employment. The evidence base for meta-analysis will consist of estimates reported by all empirical studies that investigate the effects of firm-level innovation on firm survival, growth and employment in OECD countries from 1990 to2012. The meta-analysis will enable us to synthesize the overall effect, while accounting for the sources of variation between primary findings, firm/industry characteristics, study design characteristics, and period/geographical dimensions. It will also enable us to compare the findings form UK data with the synthesized evidence based on data from OECD countries.

In stage 2, we will investigate the effects of R&D Tax Credits on firms' R&D expenditures. Unlike the existing literature that estimates cost elasticities of R&D expenditures, we will use matching difference-in-difference methods to investigate the effects of the incentive scheme on R&D efforts of beneficiary ('treated') firms relative to others ('un-treated'). It will also allow for establishing whether it has 'picked up winners' by inducing already R&D-active firms to make more use of the incentive. The findings will have significant implications for public policy and for public perceptions and expectations-formation.

In stage 3, we investigate the effects of R&D expenditures on firm performance in terms of survival, growth and employment creation. To investigate UK firm survival, we use hazard rate models to estimate the probability of firms going out of business over time. To investigate the effects of R&D expenditures on growth and employment creation, we use dynamic panel-data methods that allow for consistent estimation. In all performance estimations, we will control for firm, location, and industry characteristics that are included in the existing literature; but also liquidity constraints that are not investigated in the wake of the recent credit crunch.

Overall, the proposed research is about finding out what works or does not in the overall policy cycle of R&D and firm performance - from policy intervention through intermediate target to ultimate target. It is also about finding out what explains success or failure - and how the UK evidence compares to the synthesized OECD evidence. Therefore, our findings will strengthen the evidence base for evidence-informed public policy and the existing literature.

Planned Impact

Beneficiaries

While developing this project, we have consulted with six representatives of potential stakeholders. Our aim was to elicit their views on how the research question can be made policy- and practice-relevant and what aspects of the innovation-performance relationship should be prioritized for investigation. The stakeholders we have consulted are:

Public sector: The Department for Business, Innovation and Skills (BIS); and the Office for National Statistics (ONS).

Private sector: The Confederation of British Industry (CBI); and the Northern Trust Corporation.

Third sector: National Endowment for Science, Technology and the Arts (NESTA); and the Secure Data Service of UK Data Archive (SDS).

Consultations with our stakeholders have enabled us to identify other potential stakeholders, which include: The Technology Strategy Board (UK), the Trades Union Congress (TUC), the South East England Development Agency (SEEDA); and the Europe INNOVA unit of DG-Enterprise of the European Commission.

This experience led us to adopt a snow-balling approach to maximising stakeholder engagement. The approach is informed by the systematic review methodology and consists of expanding the stakeholder engagement as the research project unfolds. The expansion will be driven partly by recommendations from existing stakeholders and partly through discovery of new organisations or entities as we gather more information about the stakeholder landscape. We will keep a record of the snow-balling process and report the number of stakeholders we engaged over time.

The snow-balling exercise will also benefit from inputs by members of the Project Advisory Board. The latter will include representatives from BIS, ONS, SDS, and NESTA; and two academic peers: Professor Sushanta Mallick of Queen Mary, London and Professor Tom Stanley of Hendrix College in the US.


Benefits

The proposed research will benefit a wide range of stakeholders, including the general public. This is due to the nature of the research topic, which has significant implications for jobs, welfare, firm competitiveness, quality of life, and effective public policy. The potential benefits are explained below.

R&D Tax Credits is a public policy intervention based on the premise that innovation has positive externalities. This quality justifies subsidization because the level of R&D effort by firms may remain less than optimal if it is determined by market forces only.

Our policy evaluation analysis will enable us to establish whether the scheme leads to higher R&D effort by comparable firms or it does tend to 'pick-up winners'. In other words, does it address the externality problem? Or, does it just induce firms that already spend more on R&D to use the scheme more heavily than others? The answer to this question has significant implications for welfare-maximization objective of the public policy.

In addition, our research will shed light on whether the R&D effort affects wealth and job creation; and how this effect may vary between firms, industries, types of R&D expenditures, geographical regions and liquidity constraints exacerbated by the recent credit crunch. These findings will enhance the scope for better-informed decision making by policy makers, employees, institutions specialized in the economics and management of innovation, financial institutions, and investors.

With enhanced information on the innovation-performance relationship, policy-makers will be able to fine-tune the policy to maximise welfare; employees will form better expectations about innovation's effect on employment and wages; research and advocacy organisations will be able to extend their research into controversial issues; and the cost of capital for R&D expenditures will be less distorted by asymmetric information between firms and financial institutions/investors.

Publications

10 25 50
 
Description We addressed four research questions on research and development (R&D) investment and firm performance:

1. Does public support for R&D investment encourage firms to increase the level of privately-funded R&D effort?
2. Does R&D intensity increase firm survival rates?
3. What are the effects of R&D intensity on employment creation?
4. What are the effects of knowledge (R&D) capital on firm productivity?

Innovative modeling and adherence to best practice in microeconometric research enabled us to make two contributions to existing knowledge.

First, we found that the relationship between subsidies, R&D effort and firm performance follows curvilinear rather than linear patterns. Specifically, we found that matched funding from UK government is associated with increased R&D effort on average, but the level of additionality declines as the recipient firms' R&D intensity increases. The pattern is similar with respect to firm survival and employment creation too: From low levels of R&D intensity to begin with, an increase in R&D intensity leads to increase in survival rates and employment creation, but the effect tapers off and becomes negative as R&D intensity increases.

Secondly, we found that the 'average effect' reported in most of the existing literature on R&D investment and firm performance conceals a high degree of heterogeneity among firms. We found significant evidence of heterogeneity in the following areas:

a. The effect of knowledge (R&D) capital on productivity is relatively larger among firms within: (i) industries with above-median concentration levels; and (ii) technology classes that are science-based, specialised and scale-intensive.
b. R&D intensity has a positive but decelerating effect on full-time jobs for R&D personnel (scientists and technicians); but the effect on full-time non-R&D jobs is negative but the adverse effect is decelerating.
c. R&D intensity has a positive but decelerating effect on overall part-time employment; but the rate of part-time job creation is higher for female employment compared to male employment.
d. Finally, the effect of R&D intensity on survival is mediated through the level of market concentration in the firm's industry.

Given the indications of non-linear patterns and heterogeneity indicated above, the average and monotonic effect-size estimate reported in most of the literature may have limited applicability as a guide for policy and practice.


The rich datasets we assembled have strong potential for use in addressing new research questions related to firm dynamics, employment generation and growth. One such question concerns the effects of the recent financial crisis on the type of firms that enter and exit with respect to R&D intensity, size and growth rates. The second is about the fall in labour productivity during the recent crisis and the persistence of lower productivity levels thereafter. The third question relates to evolution of firm size distribution and the relationship between firm size and growth. These questions address issues of high policy relevance, including: (i) whether the persistence of low labour productivity has been due to changes in utilisation of labour or knowledge capital or both; (ii) whether small and medium-sized enterprises (SMEs) are significant contributors to growth and employment creation.
Exploitation Route Our findings indicate that selection for R&D support tends to favour R&D-intensive and high-growth firms rather than those with higher levels of employment. However, the relationship between these firm characteristics and the probability of receiving R&D support is non-linear. This is a sign of good practice, indicating that the selection process does not rely on one-dimensional bets. However, it also raises questions about the relative weights used and whether the trade-offs dimensions (e.g., between R&D intensity and employment) are justified by the level of additionality. These policy issues can be discussed fruitfully with inputs from our stakeholders at the Department for Business, Innovation and Skills (BIS) and Innovate UK.

In addition, our work tallies with data-linking and productivity research with which the Office of National Statistics (ONS) is involved nationally and internationally. ONS experts are keenly interested in our findings and in how they can be taken further in ONS or joint work.

Finally, our findings are also highly relevant for academic researchers involved in microdata analysis. Non-linearities and heterogeneity in microdata are well-known issues but with little or no treatment. Our proposed modelling and estimation methods are highly likely to encourage a rigorous debate.
Sectors Digital/Communication/Information Technologies (including Software),Education,Manufacturing, including Industrial Biotechology,Pharmaceuticals and Medical Biotechnology

URL https://peg.primeeconomics.org/policybriefs/supporting-business-r-and-d
 
Description Our project (ES/K004824/1) was completed at the end of December 2014. In June 2015 we held a workshop that brought together academics and other research users from the Department for Business Innovation and Skills (BIS), the Office of National Statistics (ONS) and the UK's Innovation Agency (Innovate UK). Professor Jonathan Haskel (Royal Economic Society and Imperial College) and Mark Franklin (ONS - Office of the Chief Economic Adviser) stated that the data we have deposited with UKDS reflects best practice in data linkage. The datasets (3) are rich in content and offer significant scope for use in further research on R&D investment, productivity and firm dynamics (exit and entry) at the industry level. Robin Wilson (Head Technologist - Innovate UK), David Legg (Strategy and Planning Economist - Innovate UK) and Edward Woolley (Head of Innovation Analysis - BIS) indicated that our findings on the relationship between R&D subsidies and the firm's privately-funded R&D investment provide food for thought. The lack of additionality effects we reported, if remain robust to further checks, may require a re-think in the design of the direct R&D grant policy. We have conducted further robustness checks and will report the findings again to colleagues from BIS and Innovate UK on 16 February 2016. In that workshop, we agreed to provide all the material in advance, review the findings (which confirms absence of additionality effects), and discuss potential implications for policy and practice. We also expect to have inputs from BIS and Innovate UK on current government thinking about the R&D grant regime, which may be replaced with a mixture of grants and loans (see Financial Times http://www.ft.com/cms/s/0/310e1be8-7b0f-11e5-a1fe-567b37f80b64.html#axzz3uZip0hCe). We hope to have an evidence-based input into the policy debate on this issue. Our paper on the effect of subsidies on privately-funded R&D investment was chosen as the best conference paper for excellence in research at the Advances in Business-Related Scientific Research Conference on 15 October 2015 in Rome. The conference was attended by academics, business people and business analysts. Professor Mehmet Ugur was invited as a keynote speaker to the Global Congress of Knowledge Economy on 14 November 2015 to present our findings on the relationship between R&D investment and firm productivity in the UK. The Congress was held in Qing Dao (China) and brought together internationally renowned researchers, business leaders and innovation analysts. Our project has led to publication of 16 articles, 6 of which are published in journals in the top 5%-10% of the Scientific Journal Ranking (SJR). As a result of these high-profile publications, our findings have been adopted as a policy brief published by Progressive Economics Group at https://peg.primeeconomics.org/policybriefs/supporting-business-r-and-d This policy brief is submitted to the Shadow Chancellor John McDonnell as an input for policy debate within the Labour Party. We have 2 more papers in the review process in top 5% journals - one the learning effects of R&D in the presence of firm age and size diversity; and one on heterogeneity in the effect of public subsidies on privately-funded R&D effect. Our work on public support for R&D has attracted the interest of Research Professional - an on-line news portal run by Research Fortnight. I have commented on UK tax credit reform introduced in the the UK's 2021 budget. The coverage can be accessed at: https://researchprofessionalnews.com/rr-news-uk-politics-2021-10-uk-tax-credit-reform-receives-mixed-response/ Our paper titled "Information asymmetry, risk aversion and R&D subsidies: Effect-size heterogeneity and policy conundrums" has been presented at the Royal Economic Society annual conference in September 2021. Following the presentation, the paper was covered in a news article on the Research Professional website. The piece can be accessed at: https://www.researchprofessional.com/0/rr/news/uk/innovation/2021/4/Study--Government-subsidies-for-private-R-D-may-miss-their-mark.html In summary: the pathways to impact are evolving in accordance with our commitments in the application. The time frame for material impact is expected to be around 3 years; at the end of which we expect to contribute to evidence-based policy and practice.
Sector Digital/Communication/Information Technologies (including Software),Manufacturing, including Industrial Biotechology
Impact Types Policy & public services

 
Description Method development in Meta-Analysis II
Geographic Reach Asia 
Policy Influence Type Influenced training of practitioners or researchers
Impact Prof Ugur delivered a series of workshops on meta-analysis as an evidence synthesis methodology. The workshops were delivered at Pamukkale University (Turkey) Summer School in Economics and Economterics. The workshops benefited academics and PhD candidates - from social sciences, economics and medicine.
URL http://www.pau.edu.tr/iktisat/tr/haber/ekonomi-yaz-seminerleri-eys-2015
 
Description Method development in meta-analysis
Geographic Reach Asia 
Policy Influence Type Influenced training of practitioners or researchers
Impact Prof Ugur delivered a series of workshops on meta-analysis as an evidence synthesis methodology. The workshops were delivered at Pamukkale University (Turkey) Summer School in Economics and Economterics. The workshops benefited academics and PhD candidates.
URL http://eys.pau.edu.tr/index.php/eys-dersleri
 
Title Meta-analysis research tool 
Description Mehmet Ugur has delivered a series of lectures on meta-analysis in economics and social sciences. A dataset and stata Do file is made available for established researchers and PhD students to run meta-analysis estimations. The dataset and the Stata DO file is available through Greenwich Centre for Political Economy (GPERC) 
Type Of Material Improvements to research infrastructure 
Year Produced 2016 
Provided To Others? Yes  
Impact No measurable impact yet. 
URL http://www.gre.ac.uk/business/research/centres/gperc/pubreports/greenwich-papers-in-political-econom...
 
Title Research and Development Expenditures and Subsidies, Firm Productivity, Employment Creation and Survival, 1997-2012: Secure Access 
Description We have constructed 3 rich datasets by merging Business Expenditures on Research and Development (BERD), Business Structure Database (BSD) and Annual Respondents Database (ARD) / Annual Business Survey (ABS). The datasets are available for researchers viad UK Data Service (UKDS) Secure Access. The added value of the datasets include construction of physical and R&D capital stocks. The datasets can be asily updated after 2012. 
Type Of Material Database/Collection of data 
Year Produced 2015 
Provided To Others? Yes  
Impact Use of the datasets is through UKDS secure access. We have not received any statistics about use yet. 
URL https://www.ukdataservice.ac.uk/services/outputxml?id=7716&formatName=EndNoteXmlCitation
 
Description Innovation, firm dynamics and productivity: Workshop and Journal special issue 
Organisation Catholic University of the Sacred Heart
Country Italy 
Sector Academic/University 
PI Contribution I and Professor Marco Vivarelli organised a one-day workshop at the University of Greenwich, titlled: "Innovation, firm dynamics, employment and growth: New developments in modeling and estimation". The workshop was held on 21 June 2019. The workshop consisted of 14 papers, followed by reviewer comments and discussion. The workshop led to selection of 7 articles, submitted as a sepcial issue project to Economics of Innovation and New Teacnology (EINT). The review process has been completed and the special issue has been published in 2020. have contributed to article selection for and editing of the special issue of Economics of Innovation and New Technology
Collaborator Contribution Our partners has contributed to the organisation of the workshop at Greenwich and to the review process that led to the publication of the EINT special issue.
Impact One-day workshop titled "Innovation, firm dynamics, employment and growth: New developments in modeling and estimation". The workshop was held on 21 June 2019 at the University of Greenwich. Special issue of Economics of Innovation and New Technology. Special issue title: "Innovation, firm dynamics and productivity".
Start Year 2019
 
Description Policy implementation horizon for R&D instruments 
Organisation Autonomous University of Barcelona (UAB)
Country Spain 
Sector Academic/University 
PI Contribution Sharing research results on the effects of public subsidies on firms' private R&D investment. Discussing the UK public funding regime, the heterogenous nature of the additionality/substitution effects by year, firm type and industry type. Brainstorming on why the effect also differs between UK and EU subsidies, with the latter being more likely to be associated with additionality. Experience sharing with respect to policy impact evaluation methods.
Collaborator Contribution Ricard E. Masana (visiting scholar from UAB) is currently working on how policymakers decide where to invest public funds to promote R&D-related investment. He has worked mostly with data from the European Structural and Investment Funds; and has established correlations with variables such as firm performance, private funds for R&D, and territorial dimensions. Dr Mansana will share experience with respect to their research findings on designing effective R&D policy instruments, including conception, design, implementation, and performance measurement.
Impact New collaboration. Outcomes are expected in September 2017.
Start Year 2017
 
Description R&D and Firm Productivity in India 
Organisation Indian Institute of Technology Madras
Country India 
Sector Academic/University 
PI Contribution Mehmet Ugur will act as co-author and consultant in a project that will investigate the effects of R&D on productivity of Indian firms. He will draw on the experience of working with firm-level data obtained during the research on ESRC project.
Collaborator Contribution The partners will collect the data, build the dataset and run preliminary analysis.
Impact No output yet. However, the dataset has been built - with 19.130 firm/year observations from 1999-2014.
Start Year 2015
 
Description R&D and Firm Productivity in India 
Organisation Monash University
Country Australia 
Sector Academic/University 
PI Contribution Mehmet Ugur will act as co-author and consultant in a project that will investigate the effects of R&D on productivity of Indian firms. He will draw on the experience of working with firm-level data obtained during the research on ESRC project.
Collaborator Contribution The partners will collect the data, build the dataset and run preliminary analysis.
Impact No output yet. However, the dataset has been built - with 19.130 firm/year observations from 1999-2014.
Start Year 2015
 
Description Effects of Innovation on Employment: A Meta-Analysis of Firms and Industry Evidence 
Form Of Engagement Activity Scientific meeting (conference/symposium etc.)
Part Of Official Scheme? No
Type Of Presentation paper presentation
Geographic Reach International
Primary Audience Participants in your research and patient groups
Results and Impact Our presentation has attarcted interest because of policy relevance of the subject and due to methodological innovation in estimating the meta-regression. The presentation was made at the 2014 Colloquium of the Meta-Analysis of Economics Research Network (MAER-Net) held at the University of Athens, Greece. We presented the meta-analysis results based on 567 effect-size estimates reported by 34 primary studies. Results indicate that the effect of innovation on employment is small and there is evidence of skill bias in favour of skilled labour employment. Finally, we find that the effect of innovation on employment is stronger when the evidence is based on OECD data in general; and on UK and US data in particular.

Following the presentation, we have received invitation for collaboration in meta-analysis projects aiming to investigate the effecst of government expenditures on growth; and the relationship between country income and military expenditures.
Year(s) Of Engagement Activity 2014
URL http://innovation-uk.cepgr.org/activities
 
Description Effects of R_and_D on Labour Productivity and Output: A Meta-Analysis of Evidence on OECD Firms and Industries 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Participants in your research and patient groups
Results and Impact The evidence synthesis indicated that R_and_D investment has a positive effect on firm/industry productivity and is associated with positive rates of return. However the productivity and rates-of-return effects we estimated from all published research (64 primary studies reporting 1262 estimates) are lower than what is reported in narrative reviews. We also identified a range of moderating factors that explain the variation among reported estimates. Moderating factors with significant effects on variation in the evidence base include: (i) measurement of inputs and output; (ii) model specifications; (iii) estimation methods; (iv) levels of analysis; (v) countries covered; and (vi) publication type among others.

With respect to UK, the meta-analysis results indicate that studies investigating the effects of R_and_D investment on productivity and rates of return in UK firms do not report systematically different estimates compared to other studies investigating firms/industries in other OECD countries.


After our presentation, we have had a series of discussions with academics at Staffordshire University and the Norwegian School of Economics on meta-analysis of R_and_D subsidies and R_and_D effort; and on meta-analysis of R_and_D and rates of return.
Year(s) Of Engagement Activity 2013
URL http://innovation-uk.cepgr.org/activities
 
Description Evaluation of R&D expenditures, firm survival, firm growth and employment: UK evidence in OECD context: Project summary and methodology 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Participants in your research and patient groups
Results and Impact We presented the project methodology, the expected research output in terms of publications, the project timetable and the impact strategy. After the presentation, we received feedback and enaged with various participants. The feedback and following discussions enabled us to refien our methodology so that we take account of spill overs and compare firm-level findings with more aggregate findings ta the industry/sector level.

The main impact of this presenattion was to induce interest in secondary data analysis and use of business databses.
Year(s) Of Engagement Activity 2013
URL http://innovation-uk.cepgr.org/activities
 
Description Evaluation of R_and_D expenditures, firm survival, firm growth and employment: UK evidence in OECD context 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact We presented the four methods we use to analyse the determinants and consequences of R_and_D investment for UK firms and industries. The methods consist of: (i) difference-in-difference methodology to estimate the effects of the R_and_D subsidies on R_and_D effort of UK firms; (ii) survival methodology to estimate the effects of R_and_D expenditures on firm survival; (iii) panel-data estimation methods to estimate the effect of R_and_D on firm productivity growth and employment creation; and (iv) meta-analysis methods to synthesize the existing research findings on the relationship between R_and_D effort, firm productivity and employment creation. We also shared our experience in using and merging business databases compiled by the ONS, including the Annual Respondents Database (ARD), the Business Expenditire on Research and Development (BERD), and the Business Structure Databse (BSD).

Our presentation has created interest in the use of micro-level business data.
Year(s) Of Engagement Activity 2013
URL http://innovation-uk.cepgr.org/activities
 
Description R_and_D Expenditures and Firm Survival: UK Evidence 1998-2012 
Form Of Engagement Activity Scientific meeting (conference/symposium etc.)
Part Of Official Scheme? No
Type Of Presentation paper presentation
Geographic Reach National
Primary Audience Participants in your research and patient groups
Results and Impact In June and July 2014, we made two presentations at the Cluster Event at the National Institute of Economic and Social Research (NIESR) and at the Research Methods Festival in Oxford. At these events, we presented our preliminary findings on the relationship between R_and_D expenditures and firm survival. The findings are based on merged ONS data from the Annual Respondents Database (ARD) and the Business Expenditure on Research and Development (BERD). Our findings indicate the presence of a creative destruction dynamic in the R_and_D-survival relationship. At low levels of R&D intensity, higher levels of R_and_D expenditures increases survival rates but the effect becomes negative as the level of R_and_D intensity increases beyond a threshold. Further evidence in support of creative destruction was observed when investigated the survival rates in different technology classes. Firm survival rates in R_and_D-intensive and science-based technology classes tend to be lower compared to others with relatively lower R_and_D-intensity. Finally, we have also reported that the creative destruction dynamic is less prevalent among firms in the technology class characterised by large production scales.

The finding of creative destruction dynamics sparked interest in our work. We are invited to present again once we have the final results.
Year(s) Of Engagement Activity 2014
URL http://www.ncrm.ac.uk/RMF2014/programme/session.php?id=A5