Analytical Middleware for Informed Distribution Networks (AMIDiNe)

Lead Research Organisation: University of Strathclyde
Department Name: Electronic and Electrical Engineering

Abstract

The programme of research that constitutes AMIDiNe will devise analytics that link point measurement to whole system to address the increasingly problematic management of electrical load on distribution networks as the UK transitions to a low carbon energy system. Traditionally, distribution networks had no observability and power flowed from large generation plant to be consumed by customers in this 'last mile'. Now, and even more so in future, those customers are generators themselves and the large generators that once supplied them have been supplanted by intermittent renewables. This scenario has left the GB energy system in position where it is servicing smaller demands at a regional or national level but faces abrupt changes in the face of weather and group changes in load behaviour, therefore it needs to be more informed on the behaviour of distribution networks. The UK government's initiative to roll out Smart Meters across the UK by 2020 has the potential to illuminate the true nature of electricity demand at the distribution and below levels which could be used to inform network operation and planning. Increasing availability of Smart Meter data through the Data Communications Company has the potential to address this but only when placed within the context of analytical and physical models of the wider power system - unlike many recent 'Big Data' applications of machine learning, power systems applications encounter lower coverage of exemplars, feature well understood system relations but poorly understood behaviour in the face of uncertainty in established power system models.

AMIDiNe sets out its analytics objectives in 3 interrelated areas, those of understanding how to incorporate analytics into existing network modelling strategies, how go from individual to group demand behavioural anticipation and the inverse problem: how to understand the constituent elements of demand aggregated to a common measurement point.

Current research broadly involving Smart Metering focuses on speculative developments of future energy delivery networks and energy management strategies. Whether the objective is to provide customer analytics or automate domestic load control, the primary issue lies with understanding then acting on these data streams. Challenges that are presented by customer meter advance data include forecasting and prediction of consumption, classification or segmentation by customer behaviour group, disambiguating deferrable from non-deferrable loads and identifying changes in end use behaviour.

Moving from a distribution network with enhanced visibility to augmenting an already 'smart' transmission system will need understanding of how lower resolution and possibly incomplete representations of the distribution network(s) can inform more efficient operation and planning for the transmission network in terms of control and generation capacity within the context of their existing models. Improving various distribution network functions such as distribution system state estimation, condition monitoring and service restoration is envisaged to utilise analytics to extrapolate from the current frequency of data, building on successful machine learning techniques already used in other domains. Strategic investment decisions for network infrastructure components can be made on the back of this improved information availability. These decisions could be deferred or brought forward in accordance with perceived threats to resilience posed by overloaded legacy plant in rural communities or in highly urbanised environments; similarly, operational challenges presented by renewable penetrations could be re-assessed according to their actual behaviour and its relation to network voltage and emergent protection configuration constraints.

Planned Impact

The GB power system is transitioning to new operating models to address decarbonisation and resilience challenges at a rate not seen in generations. AMIDiNe is focused on developing the analytical tools that will enhance the understanding of localised demand and generation characteristics on distribution network behaviour to DNOs as they transition to Distribution System Operators (DSO), and to the Transmission System Operator (TSO) as it deals with the transition away from the traditional generation and load operating model of the past. For Distribution Network Operators the increasing penetrations of distributed generation have presented a challenge to installing and maintaining the regional down to neighbourhood levels of network - setting demand behaviour models in the context of power system models will assist in informing actual impacts on network performance and the resulting control strategies required. From the perspective of control with new technology, energy storage operators would benefit from understanding how to identify and anticipate the emerging opportunities in providing grid services at distribution level. AMIDiNe partners are well placed in the industry to propagate these innovations through to enhance their respective operational practices and those of their clients.

AMIDiNe will work with network SSEN to both build understanding of the requirements of analytics for a DSO and for a transmission and distribution network owner facing increasing challenges to its assets from low carbon technologies gaining them understanding of hierarchical and grouped load which will be beneficial as they approach the need to interface more with distribution level players. Drax will benefit from understanding how industrial and commercial loads are evolving, the LCTs 'behind the meter' that are influencing these and the opportunities for flexibility that can be presented to the system operator. Power systems have data available to them in increasing volumes, but this is disparate and can really only be leveraged to its full potential when used in conjunction with other data and domain knowledge. Working with The CountingLab will enable them to continue to introduce powerful analytical tools with greater reflection of the changing environment to their energy sector clients, while Bellrock will be able to demonstrate how diverse data streams unified through their Lumen(TM) platform can provide enhanced operational situational awareness when leveraged with advanced analytics.

Publications

10 25 50
 
Description Analytical tools have been developed that allow the prediction of electricity demand from unmetered customers in a neighbourhood or community, using the portion of customers who do have Smart Meters. This is very useful as it provides network companies with a better estimate of the capacity remaining on a network that can be used to accommodate heat pumps or electric vehicle chargers without digging up roads to install cabling with greater capacity.

Additionally, software has been developed that allows back office data pertaining to the positions of cables on streets to be automatically converted into power system simulation models. Given the volumes of data network companies hold on this 'last mile' of infrastructure, automating this is a step towards analysing the effects of changing load behaviour at scale.
Exploitation Route This could be implemented by our SME partners analytics platform for Distribution Network companies to assess the 'last mile' of their networks. If implemented on a Cloud platform this could enable the network companies to regularly assess and quantify which of the thousands of community network assets could be challenged by uptake of low carbon technologies. The analytics also have potential use cases in a Distribution System Operator control room - a follow on project is currently running to develop demonstrator versions of these for evaluation by industry partners.
Sectors Energy

URL http://www.amidine.net
 
Description Provided SME Bellrock Technology with illustrative use cases of power system models in their Lumen software platform. Currently, work from AMIDiNe WP1 is informing SSEN on what data driven strategy for network loss identification is possible given their current information systems and data streams. There is a possibility of convergence of the two outputs in a practical, low TRL implementation for SSEN. Outputs from AMIDiNe WP1 and WP3 are informing (from January 2022) a low to mid TRL demonstration project funded by UKPN, SSEN and SPEN via the PNDC core research themes. These outputs are being demonstrated using the Bellrock Lumen platform. Outputs from AMIDiNe WP1 informed a successful submission (starts March 2022) for the Strategic Innovation Fund (SIF) with ScottishPower and NGESO on distribution network digital twins.
First Year Of Impact 2021
Sector Energy
Impact Types Economic

 
Description Future Control Room NIA project
Amount £445,000 (GBP)
Funding ID NIA_SSEN_0053 
Organisation Scottish and Southern Energy (SSE) 
Sector Private
Country United Kingdom
Start 01/2021 
End 04/2022
 
Description Ofgem Strategic Innovation Fund - Digital Twin for Distribution Networks (EN-twin-e)
Amount £50,935 (GBP)
Organisation Scottish Power Ltd 
Sector Private
Country United Kingdom
Start 03/2022 
End 05/2022
 
Description Ofgem Strategic Innovation Fund EN-Twin-e - ScottishPower Transmission (other partners: NGESO, Digital Catapult)
Amount £143,480 (GBP)
Organisation Ofgem Office of Gas and Electricity Markets 
Sector Public
Country United Kingdom
Start 03/2022 
End 05/2022
 
Description Power Networks Demonstration Centre Core Programme (SSEN, UKPN, SPEN) - Intelligent Control System Module Demonstrators
Amount £129,305 (GBP)
Organisation Scottish and Southern Energy (SSE) 
Sector Private
Country United Kingdom
Start 11/2021 
End 07/2022
 
Description Bellrock Technology Demonstration Platform 
Organisation Bellrock Ltd
Country United Kingdom 
Sector Private 
PI Contribution The AMIDiNe project has provided models and use cases for demonstration of platform product capability for Bellrock.
Collaborator Contribution Bellrock Technology Ltd have provided licenses for their Lumen platform that allows data analytics to be rapidly moved to an operational environment. Additionally, they have provided training and ongoing technical support.
Impact The outcomes are technical - these entail the deployment of AMIDiNe models on Bellrock's Lumen(TM) platform for ongoing demonstration.
Start Year 2019
 
Description Commercial building consumption data 
Organisation Drax Group
Country United Kingdom 
Sector Private 
PI Contribution The team will utilise advanced analytic techniques on the data provided to outline analysis of the overall consumption by Drax Energy customers.
Collaborator Contribution Drax has previously provided energy consumption data from ~12k non-domestic properties. as part of further collaboration, they will provide the same data for a further 350k properties.
Impact Academic publications analysing earlier data release have been produced.
Start Year 2010
 
Description SSEN Network Performance and Demand Analysis 
Organisation Scottish and Southern Energy (SSE)
Country United Kingdom 
Sector Private 
PI Contribution AMIDiNe outputs have informed SSEN how they can use Smart Meter data on their unmonitored low voltage distribution networks to inform how much headroom remains to accommodate increases in load. This is particularly important in rural areas where monitoring is limited and premises may be off the domestic gas grid - thermally sensitive loads such as heat pumps could produce a winter peak which can overload an underspecified network. The data analysis tools that AMIDiNe has produced allow this to be assessed with no additional monitoring deployed.
Collaborator Contribution Scottish and Southern Energy Networks (SSEN) provided network data from their information systems that allowed AMIDiNe to create power system models that reflected particular areas of network. SSEN also provided operational data that allowed these models to be driven under realistic scenarios. The combination of the two has allowed AMIDiNe to work on models for hierarchical load forecasting, phase balancing and state estimation, taking into account the effect the network (and its legacy idiosyncrasies) will have on the models. Additionally, SSEN provides steer for work package technical activities.
Impact This collaboration is purely technical. The outputs are analysis of network operating scenarios or models for predicting particular operating conditions of power networks given environmental conditions and/or historical load behaviours. These are demonstrating to SSEN how their existing data can be repurposed to understand future requirements on their networks.
 
Title IFEEL 
Description This Python package, Interpretable Feature Extraction of Electricity Loads (IFEEL), aims to help energy data analysts to readily extract interpretable features from daily electricity profiles. The extracted features can be applied for further feature-based machine learning purposes, including feature-based PCA, clustering, classification, and regression. Two types of load profile features, including 13 global features (GFs) and 8 peak-period features (PFs), can be extracted by using this package. Detailed descriptions of all features can be found in Ref [1] or the Demo file in the installed IFEEL package. GFs are extracted based on raw time-series data, while PFs are extracted based on symbolic representation of time series data. GFs and PFs can be obtained by using IFEEL.ifeel_extraction.feature_global and IFEEL.ifeel_extraction.feature_peak_period, respectively. For fast peak-period feature extraction, Symbolic Aggregate approXimation (SAX) representation is first used to transform the time-series numerical patterns into alphabetical words. The feature transformation process is performed by calling IFEEL.ifeel_transformation.feature_transformation. More details about SAX approach can be found in Ref [2] and Ref [3]. [1] Hu M, Ge D, Telford R, Stephen B, Wallom, D. Classification and characterization of intra-day load curves of PV and Non-PV households using interpretable feature extraction and feature-based clustering. (In preparation) [2] Lin J, Keogh E, Wei L, Lonardi S. Experiencing SAX: a novel symbolic representation of time series. Data Mining and Knowledge Discovery. 2007;15:107-44. [3] Keogh E, Lin J, Fu A. HOT SAX: efficiently finding the most unusual time series subsequence. 5TH IEEE International Conference on Data Mining (ICDM'05). 2005. p8. 
Type Of Technology Software 
Year Produced 2020 
Open Source License? Yes  
Impact The following paper has been prepared using outputs from this software: Hu M, Ge D, Telford R, Stephen B, Wallom, D. Classification and characterization of intra-day load curves of PV and Non-PV households using interpretable feature extraction and feature-based clustering. (In preparation) 
URL https://www.amidine.net
 
Title PHOtoVoltAic FindER 
Description "PHOtoVoltAic FindER" (phovafer) was developed to automatically identify solar photovoltaic (PV) customer installations among the regular loads on low-voltage distribution networks. The software is written in R comprising functions for data representation, feature extraction, and PV users' classification using extracted features. Models built using this software will allow distribution network operators to quantify the number of PV installations on their networks by automated means which could in turn permit greater amounts of PV to be installed without network reinforcement. 
Type Of Technology Software 
Year Produced 2020 
Open Source License? Yes  
Impact This software was used to produce the results for a forthcoming journal paper. 
URL https://www.amidine.net
 
Description EPFL Machine Learning Days Presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact The presentation was on the subject of combining power system models with machine learning. The AMIDiNe projects key findings to date were presented along with the underlying research narrative. The invitation to present resulted from visibility gained through editing a Frontiers journal special edition.
Year(s) Of Engagement Activity 2021
URL https://appliedmldays.org/events/amld-epfl-2021/tracks/ai-sustainable-energy
 
Description IEEE Powertech Presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The purpose of the talk was to provide the AMIDiNe project perspective in a special panel session on increased power system digitalisation. The presentation was an opportunity to connect to colleagues in Comillas University in Madrid who are regular teaching collaborators but less so in research activities - providing visibility to policy and practice elsewhere in Europe.
Year(s) Of Engagement Activity 2021
URL https://www.powertech2021.com/index.php/program-powertech/technical-program/special-sessions
 
Description Lunchtime seminar for National Grid ESO via WebEx (during COVID-19 lockdown) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Lunchtime talk/webinar given for National Grid ESO by Jethro Browell on Probabilistic Forecasting casting this in the context of their current challenges as the UK Energy System Operator. The event was attended by National Grid staff.
Year(s) Of Engagement Activity 2020
URL https://pureportal.strath.ac.uk/en/activities/system-wide-probabilistic-energy-forecasting
 
Description MAE Postgrad Society Lunchtime lecture 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact Cross faculty talk with Q&A session afterwards. Talk entitled "Data Analytics for Future Suburban Electricity Distribution Networks", delivered by B Stephen. Attendance was across postgraduates, academics, leaders of industry facing centres. Main points raised were the need for consideration of the concepts discussed within postgraduate training programmes in engineering.
Year(s) Of Engagement Activity 2020
 
Description Presumed Open Data (POD) Challenge participation 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Network Innovation Allowance competition run by Western Power Distribution and the Energy Systems Catapult
Year(s) Of Engagement Activity 2021
URL https://www.westernpower.co.uk/projects/presumed-open-data-pod
 
Description ScottishPower Energy Networks - Senior Stakeholder Engagement 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact ScottishPower Energy Networks (SPEN) senior engineers requested an overview of currently active research work into monitoring deployments, simulation and use of analytics in understanding the behaviour of power distribution networks. AMIDiNe high level objectives and initial outcomes were reported.
Year(s) Of Engagement Activity 2020