Locally stationary Energy Time Series (LETS)
Lead Research Organisation:
University of Bristol
Department Name: Mathematics
Abstract
It is difficult to think of any aspect of everyday life which does not rely in some way on energy supply and use. Behind every energy source is a complex network of stakeholders ensuring a reliable supply from generation through to distribution and use. In recent years, there has been an increasing focus on low carbon energy & renewables and also increasing marketisation, reorganisation and privatisation in the sector, particularly with large utilities.Time series analysis is a statistical cornerstone, of vital importance to many energy related challenges. For example, short-term wind speed forecasting is key for utilities aggregating many sources of supply, as is predicting the future energy use of groups of customers. Time series analysis is also critical to the planning of proposed wind farms to see if the predicted wind power is likely to be efficient and reliable. Over the last decade, the nature of time series encountered by stakeholders has changed. In the past, series were assumed to be stationary (i.e. that their statistical properties did not change over time). Much of what is now experienced is non-stationary. This becomes ever clearer as increasing flows of high-quality data enable new models to be proposed, studied and considered.Compare, for example, wind and gas-fired power. Wind is intermittent and not controllable. Gas powered stations, by comparison, are highly controllable and can produce almost constant power. Incorporating large quantities of wind power into the grid can be problematic as there can be sustained periods without wind, or periods of highly variable wind. Another issue is increasing marketisation: across Europe people are now able to purchase power from a variety of suppliers and modes of supply, distributors supply to different, fragmented parts of the market. Consequently, data collected on consumers or generators is less stable and much less stationary than in previous years.Our proposal addresses this new world of non-stationarity head-on. For several years our team has been at the forefront of developments in non-stationary time series: introducing new classes and using them in new and innovative ways. Our proposal will develop novel techniques to revolutionize the way that such time series are analyzed and hence be of considerable use to our industrial partners and the energy industry more widely. For example, we shall investigate and develop new methods for (i) handling more than one non-stationary series simultaneously; (ii) identifying appropriate sampling rates for series and whether any series have been compromised by inappropriate sampling rates; (iii) dealing with the common problem of data dropouts and irregularly spaced time series but still obtain meaningful insights; (iv) improved methods for forecasting and enabling predictions of one time series from another; (v) improving robust measures of uncertainty of our estimates. Even small improvements in any of these quantitative areas can lead to massive financial, environmental and reliability benefits of value to our partners and society more generally. We intend to create a step-change in the methods and procedures used by energy stakeholders by moving to the non-stationary world.
Planned Impact
**Who will benefit?** This research programme will generate considerable impact for a wide range of academic and non-academic beneficiaries, principal among whom are: a) The Energy community including academia and industry; b) Our collaborating industrial and academic partners as listed in section 1 of the Case for Support; c) The statistical research community, particularly in the area of locally stationary methods; d) The project personnel: the PDRAs and PhD students; e) Recruiters of doctoral graduates in statistics; f) Society in general. **How will they benefit?** New techniques: (a, b, f) The research undertaken by this proposal will develop a number of exciting new statistical techniques which will be disseminated to our partners and the energy community more widely. Our methods are intended to result in more efficient and cost-effective ways of marshalling precious resources, by making better predictions and reducing the impact of intermittency. These benefits will flow through to Society in terms of a cheaper, cleaner, more sustainable and reliable energy supply. Targeted Knowledge Exchange: (b) Significant further benefit will accrue to beneficiary group (b) through their partnership on this project. The supporting letters from Shell and GL Garrad Hassan give examples of how understanding in the areas of aliasing and locally stationary time series are vital for the longer-term development of their businesses. Through workshops and engagement sessions with our partner organisations (EDF, Garrad Hassan, Nuon and Shell) we will seek to extend the impact of this research across the sector (c). Generic Knowledge Exchange: (c) Our intention is to develop methods which are of considerable interest to the academic community both in statistics and the energy fields. As well as the traditional routes of journal publication, workshops and conferences we shall develop open-source R software that embodies our techniques: these will benefit the academic community and beyond. Further, we shall utilize our advisory group to promulgate our techniques to a wider audience where appropriate and where they see fit, allowing us to plug-in to the international community through an innovative route. Developing good people: (d). The project personnel will themselves benefit from a supportive training, research and development environment, given the opportunity to create new techniques and see them employed in a productive and worthwhile setting, given the opportunity to work with industry on learning new challenges and a team-based approach to solving them, and be ideally positioned to seek future employment in a field/industry of such great importance to society. Contributing to the future supply of people: (all) This proposal will secure an increase in the number and quality of post-doctoral and PhD researchers in statistics with appropriate training to make an impact in the area of energy. In particular, the renewable energy sector is a comparatively new, highly instrumented industry. Data monitoring and modelling are all pervasive within this sector. Given its data-rich character it is perhaps surprising to read in the letters of support how few statistically trained researchers work in this area. As Jonathan (Shell) describes The number of suitably qualified doctoral and post-doctoral statisticians with the skills and passion in this area are relatively low , but as Landberg (GL Garrad Hassan) concludes we believe the proposal will go a long way to helping raise the profile of the renewable energy sector as an application area for statistics researchers within the UK. Beneficiaries (a,b,c,e) will consequently be able to recruit outstanding scientists equipped with the knowledge and skill-set to prosper in this sector. Beneficiary (c) will also benefit from the training of career young researchers in Statistics, a key STEM discipline which is in skills shortage.
Organisations
Publications
Cardinali A
(2013)
Costationarity of Locally Stationary Time Series Using costat
in Journal of Statistical Software
Cardinali A
(2018)
Practical powerful wavelet packet tests for second-order stationarity
in Applied and Computational Harmonic Analysis
Eckley I
(2018)
A test for the absence of aliasing or local white noise in locally stationary wavelet time series
in Biometrika
Eckley I
(2014)
Spectral correction for locally stationary Shannon wavelet processes
in Electronic Journal of Statistics
Killick R
(2020)
The local partial autocorrelation function and some applications
in Electronic Journal of Statistics
Knight M
(2011)
Spectral estimation for locally stationary time series with missing observations
in Statistics and Computing
Nason G
(2015)
Bayesian Wavelet Shrinkage of the Haar-Fisz Transformed Wavelet Periodogram.
in PloS one
Nason G
(2014)
White noise testing using wavelets
in Stat
Nason G
(2013)
A Test for Second-Order Stationarity and Approximate Confidence Intervals for Localized Autocovariances for Locally Stationary Time Series
in Journal of the Royal Statistical Society Series B: Statistical Methodology
Nason G
(2014)
Multiscale variance stabilization via maximum likelihood
in Biometrika
Description | This grant developed new methodology for the modelling and analysis of data using locally stationary time series. This included new ways of assessing the sampling rate (and detecting the absence of aliasing) to new methods for forecasting locally stationary time series. The grant also developed a number of postdocs who have gone onto academic positions |
Exploitation Route | The results of this research can be applied to many important applied time series problems. |
Sectors | Aerospace Defence and Marine Agriculture Food and Drink Chemicals Communities and Social Services/Policy Construction Creative Economy Digital/Communication/Information Technologies (including Software) Education Electronics Energy Environment Financial Services and Management Consultancy Healthcare Leisure Activities including Sports Recreation and Tourism Government Democracy and Justice Manufacturing including Industrial Biotechology Culture Heritage Museums and Collections Pharmaceu |
Description | The grant contributed to six software packages which are hosted on the popular freeware software repository CRAN. As of Mar 2018 (for which data is available) the software received the following numbers of downloads: adlift (17.6k), costat (14k), locits (12.1k), nlt (9.7k), hwwntest (7.1) and BootWPTOS (1.1k). The outputs have, so far, attracted over 200 citations (Google scholar) including articles relating to MRI imaging, energy markets, cloud computing, joint stiffness, texture analysis, economics, complexity science, neurophysiology, psychology, biology, water research and turbulence and many more. |
First Year Of Impact | 2013 |
Sector | Digital/Communication/Information Technologies (including Software),Energy,Healthcare |
Impact Types | Cultural Societal Economic |
Description | EPSRC Established Career Fellowship |
Amount | £901,902 (GBP) |
Funding ID | EP/K020951/1 |
Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
Sector | Public |
Country | United Kingdom |
Start | 03/2013 |
End | 03/2018 |
Title | BootWPTOS |
Description | Test Stationarity using Bootstrap Wavelet Packet Tests |
Type Of Technology | Software |
Year Produced | 2016 |
Open Source License? | Yes |
Impact | N/A |
URL | https://cran.r-project.org/web/packages/BootWPTOS/index.html |
Title | adlift |
Description | Adaptive wavelet transforms for signal denoising |
Type Of Technology | Software |
Year Produced | 2012 |
Open Source License? | Yes |
Impact | Early days yet |
URL | http://cran.r-project.org/web/packages/adlift/index.html |
Title | costat |
Description | Computes localized autocovariance and searches for stationary solutions to bivariate time series |
Type Of Technology | Software |
Year Produced | 2012 |
Open Source License? | Yes |
Impact | Early days yet |
URL | http://cran.r-project.org/web/packages/costat/index.html |
Title | hwwntest |
Description | Freeware R software to carry out tests of global white noise |
Type Of Technology | Software |
Year Produced | 2015 |
Open Source License? | Yes |
Impact | Software |
URL | https://cran.r-project.org/web/packages/hwwntest/index.html |
Title | locits |
Description | New test of second-order stationarity and confidence intervals for localized autocovariance |
Type Of Technology | Software |
Year Produced | 2013 |
Open Source License? | Yes |
Impact | Several users in economics and other areas |
URL | http://cran.r-project.org/web/packages/locits/index.html |
Title | nlt |
Description | The nondecimated lifting transform and applications to denoising irregular data |
Type Of Technology | Software |
Year Produced | 2012 |
Open Source License? | Yes |
Impact | Early days |
URL | http://cran.r-project.org/web/packages/nlt/index.html |
Description | Invited Talk, CMStatistics 2015 International Conference |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | CMStatistics 2015, 8th International Conference of the ERCIM Working Group on Computational and Methodological Statistics on 'Robust and Efficient Regression', Senate House, University of London, by GPN |
Year(s) Of Engagement Activity | 2015 |
Description | Invited Talk: Centre International de Recontres Mathematiques, Luminy, France |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Policymakers/politicians |
Results and Impact | Invited Talk by GPN |
Year(s) Of Engagement Activity | 2016 |
URL | http://library.cirm-math.fr/ListRecord.htm?list=request&table=3&idinlist=0&NumReq=112&cluster_1=naso... |