Electric Fleets with On-site Renewable Energy Sources (EFORES): Data-driven Dynamic Dispatching and Charging under Uncertainties

Lead Research Organisation: Northumbria University
Department Name: Fac of Engineering and Environment

Abstract

In line with the UK's target to reach net zero by 2050, Electrical Vehicles (EV) charged by renewable energy are one of the solutions towards carbon-neutral road transport, which is the 2nd largest carbon emission both nationally in the UK and locally in Newcastle city (it contributed about 33% of total emission in 2020). The electrification of business fleets (either commercial or for public service) has recently emerged as one the key factors in reducing transportation related CO2 emissions. However, according to the Global Covenant of Mayors's (GCoM) guidance the electrification of fleets leads to the reduction of direction emission, it does not imply reduction of overall emission nationally or globally if the electricity charged for EV is still sourced from the fossil fuels (see also the NU et al.'s recent policy report: https://www.seev4-city.eu/wp-content/uploads/2020/09/SEEV4-City-Policy-Recommendations-and-Roadmap-1.pdf).

A recent trend in Renewable Energy Sources (RES) is an increasing amount of small-scale RES installed on-site , referred to as ORES. For instance, in March 2021, Newcastle City Council announced a £27M plan to install solar panels, energy storage etc. at schools, leisure centres, cultural venues, depots and offices to decarbonise public buildings and transport. Likewise, Gateshead Council has approved in Nov. 2020 plans to develop two significant-scale urban solar farms, and furthermore installing solar PV canopies above car parking bays in sites like Gateshead Civic Centre, and furthermore are including rooftop solar PV on new developments such as the Gateshead Quay Arena and the proposed Gateshead Quays multi-storey carpark (construction of both commencing in 2021). This provides good opportunities for EV to use more on-site generation renewable electricity to actually reduce the overall emission for road transport. The key issue is the efficient use of ORES.

Using battery as a electricity storage can alleviate this, but at significant investment and operation cost. V2G is proposed to reduce static battery storage, but causes battery degradation. And smart charging is needed to avoid or reduce the operation cost of battery degradation. Most existing EV smart charging studies focus on the EV charging only to reduce charging cost and/or peak-shaving, under the assumption of EVs' electracy demand are given and non-adjustable (either constant or statistical model, e.g. Poisson distribution). This is reasonable for non-collaborative individual EVs. However, for a electric fleet (EF) consisting of collaborative EVs, in addition to the optimal EV charging, the electricity demand can be optimized by EF dispatching, i.e. adjusting EF's travel plan by assigning the right EV to the right service to maintain the right state of charge of the battery, and allocating to the right charging station at a right time window, such that a better marginal benefits can be achieved in terms of better efficiency and utilization of on-site renewable energy.

However, the power generation of ORES is highly variable - resulting in an undesired fluctuation at the supply side. On the demand side, EVs' charging demand also comes with uncertainties, to meet various tasks with dynamic travelling and charging demands. In shifting EV energy from less variable fossil electricity (imported from the grid) to high variable on-site ORES, the main challenge is the charging strategy of maximizing self-consumption of own ORES under uncertainties, whilst meeting the variable EV demands, at minimized cost in energy storage and less impact on grid's peak load. This project is to investigate the possibility to intelligently integrate the dynamic charging demand of electric fleets with the high variable on-site renewable energy by developing a data-driven reinforcement learning (RL) decision support tool.
 
Description In line with the UK's national target to reach Net Zero by 2050 and Newcastle City Council's local target of becoming Net Zero by 2030, this project aims to investigate the optimal dispatching and charging management of electric fleets to improve the efficient use and self-consumption of highly variable on-site renewable energy sources (ORES). We have made the following key findings:
(1) EV charging demand: The 3-year history data at an hybrid commercial/residential EV car park analysis shows that the average charging duration is 20.7 minutes and average energy charged per charging session is 13.2 kWh. The spatial-temporal distribution of utilization is uneven among different charging stations at different time-of-day, varying significantly from almost zero to maximum 67.3%. A long short-term memory (LSTM) regression network is developed to predict the hourly EV charging demand with a root mean square error of 26.0. Another key finding is that the parking time that the EVs spend at a charging station with connection to the grid is significantly longer than what is needed for charging the required energy.
(2) A simulation tool of a solar-wind-powered EV car park for EV fleet charging. This tool is developed as the research outcome of Work Package 1 (WP1) and the real history data of EV charging demand at an EV car park and the variable solar power and wind power generation data was analysed and a temporal-spatial distribution model of the EV charging demand and on-site renewable energy supply was developed.
(3) An artificial intelligence digital solution, more specifically speaking, deep reinforcement learning (DRL), is developed to optimize the dispatching and charging of a EV fleet with solar-wind renewable energy sources. The multivariate Gaussian distributions derived from historical weather and EV fleet charging data are used to train the DRL. The evaluation on a real-world scenario shows that the utilisation of on-site solar and wind power renewable energy is improved by about 4% compared to existing charging methods.
(4) Evaluated by the Leicester City Council history data on its EV fleets, some findings were obtained, and recommendation were made to optimize the performance and business efficiency of their EV fleet. It is estimated the efficiency can by improved to perform the eV4ES service better. This recommendation is provided to allow for a smoother transition into smart and clean transportation electrification.
Exploitation Route The optimisation method developed in this project can be taken forward to the low-carbon manufacturing and logistics (e.g. warehouse). It can be used for the optimal operation and charging of Battery-powered Automated Guided Vehicles (AGV) and Autonomous Mobile Robots, which is widely use in material transport in smart manufacturing, warehouse and port, etc. We have established a close collaboration with ADM, one of the UK's leading systems integrators, developing AGV and automated manufacturing solutions, to exploite the key findings in this project.
Sectors Agriculture, Food and Drink,Energy,Manufacturing, including Industrial Biotechology,Transport

URL http://www.efores.net/post/20221116-tra2022/
 
Description (1) Apart from the academic impacts of the nucleation of an emerging research area on the optimal and resilient operation of autonomous connected EVs towards net zero fleets, which was made via the Energy Future Multiple Disciplinary Research Theme (EF-MDRT) communities, the EPSRC RENU doctoral training centre at Northumbria University and also conference/workshop presentations, social and public impacts were also made through our collaboration with the climate change team at the local council (Newcastle City Council). The big data analysis skills of EV charging data and some key findings of the EV charging behaviour found in this EFORES project were exploited to provide information-based decision-making support for the council's climate change team to initiate a community EV car-sharing pilot scheme. This scheme successfully secured £30k support from the Local Government Association under the Net Zero Innovation Programme (NZIP). A technical report was produced for the council partner to make an information-based decision on selecting an optimal site for EV charging station installation, by using an online tool provided by the local Distribution Network Operator (DNO) and our own model to estimate the installation and operation costs in different scenarios. Overall, our work had a positive impact on the local community by promoting the use of EVs and helping to reduce carbon emissions. (2) We also developed new collaborations with local SMEs in the field of information technology and manufacturing. This came about through our two EFORES workshops (first one was held on 22/June/2022, as part of the national-wide EPSRC Engineering Net Zero event, second one on 30/Jan/2023). From Sept/2022, we worked with an Gatehead-based local Automated Guided Vehicle (AGV) manufacturer to investigate a digital solution to their battery-powered AGV fleet management optimisation. This collaboration has the potential of significant commercial impacts on the manufacturer's new products and solutions, which focus on low-carbon manufacturing and logistics. (3) Our proposal of a workshop "Advanced Control and Artificial Intelligence in Smart Transport-Energy Systems" at the upcoming flagship IEEE Smart World Congress 2023 was successful, we will enhance our academic impacts via this workshop to be held on Aug 2023.
First Year Of Impact 2022
Sector Communities and Social Services/Policy,Manufacturing, including Industrial Biotechology
Impact Types Policy & public services

 
Description EVOLVE - Electric vehicles point location optimisation via vehicular communications
Amount £281,282 (GBP)
Funding ID 101086218 
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 01/2023 
End 12/2025
 
Title Clustering and Forecasting of EV cahrging load at EV car park 
Description A big data analysis technique has been developed to obtain the EV charging user behaviours and patterns. The data analysis tool is applied to the data of an EV car park (one of the largest hybrid public/commercial/residential parking garages for EV charging in Norway/Europe) and to the data of a local council's EV fleet data. 
Type Of Material Data analysis technique 
Year Produced 2022 
Provided To Others? Yes  
Impact Connected Energy is now wanting have a senior staff engagement with us on the core finding of this project. We are beginning to develop a focused project partnership on renewable energy in transport and infrastructure in South Tyneside Council, Leicester City Council, and the councils' partners, and Mer (UK), one of the EU lead EV charging solution providers. 
URL http://www.efores.net/publication/tra2022/Dai2022_TRA2022.pdf
 
Title Performance and Cost Evaluaiotn tool for location selection of EV charing stations 
Description This performance and cost evalution tool was develped for council officer users to make an information-based decision on selecting an optimal site for EV charging station. It is a combination of an online tool provided by the local Distribution Network Operator (DNO) and our own model to estimate the installation and operation costs in different scenarios. 
Type Of Material Computer model/algorithm 
Year Produced 2023 
Provided To Others? Yes  
Impact The climate change team at Newcastle City Council, the officer at the transprot planning team at South Tyneside Council are wanting have more in-depth engagement with us on how to use the performance and cost evaluaiotn tool for their tasks of selcting optimal location of public EV charing stationso installation. A gold open access peer reviewed article on the DNO provided tool is being planned and written in conjunction with professional local government officer users in both South Tyneside Council and Newcastle City Council will be submitted in 2023 
 
Title Simulation Model and Smart Charging Algorithm of Solar-Wind Powered EV Car Parks 
Description This computer model and algorithm consist two parts: (1) A simulation model of a solar-wind-powered EV car park for EV fleet charging. This tool is developed as planned, in which the real history data of EV charging demand at an EV car park and the variable solar power and wind power generation data were analysed and a temporal-spatial distribution model of the EV charging demand and on-site renewable energy supply was developed. This model is able to simulate the EV charging demand and on-site renewable power generation with uncertainties in various scenarios. This tool overcomes the limits of real data (e.g. imperfect and unbalanced data) and provides the environment to train the reinforcement learning method to optimize EV charging. (2) An proximal policy optimization (PPO) framework of Deep Reinforcement Learning for optimal charging and scheduling decision-making algorithm has been developed. The performance of the algorithm is evaluated on a real-world scenario comprised of the council's EV fleet charging data at Leicester, UK and the charging activities scheduled by the proposed decision-making algorithm are shifted towards the period when the renewable energy generation is high. As a result, the self-utilisation of on-site renewable energy is improved by 2% to 4%. 
Type Of Material Computer model/algorithm 
Year Produced 2023 
Provided To Others? Yes  
Impact A local technology innovation company, Connected Energy, is now wanting to have a senior staff engagement with us on the core finding of this project. We are beginning to develop a focused project partnership on renewable energy in transport and infrastructure in South Tyneside Council, Leicester City Council and the councils' partners, and Mer (UK), one of the EU lead EV charging solution providers. 
URL http://www.efores.net/post/20230130_workshop/
 
Description Collaboration with Scottish Power 
Organisation Scottish Power Ltd
Department Scottish Power Energy Networks
Country United Kingdom 
Sector Private 
PI Contribution Sharing the key findings and tools we developed in this EFORES project with Scottish Power, one of the UK's leading providers of EV charging solutions to residential and business EV users.
Collaborator Contribution SP Future Network contributed to this project under the framework of EPSRC Centre for Doctoral Training in Renewable Energy Northeast Universities (ReUN), by participating through regular attendance of progress review meetings, and coaching/mentoring to support the research.
Impact With the contribution of Scottish Power on project steering and advising, we developed a model to represent the uncertainties of on-site renewable sources for optimal EV charging. this is a key part of the simulation environment and reinforcement learning algorithm developed in this project. This collaboration is not multi-disciplinary.
Start Year 2022
 
Description Enhanced Paternership with Newcastle City Council 
Organisation Newcastle City Council
Country United Kingdom 
Sector Public 
PI Contribution We shared our experience of using the online cost evaluation tool provided by the local Distributed Network Operator (DNO) and the model we developed.
Collaborator Contribution The climate change team at the Newcastle City Council had regular meetings with the project team. The climate advise office from Newcastle City Council shared his view on the digital technical technology for low carbon transport for a social house neighbourhood.
Impact A gold open access peer-reviewed article on the DNO provided tool is being planned and written in conjunction with professional local government officer users in both South Tyneside Council and Newcastle City Council will be submitted in 2023
Start Year 2022
 
Description New Paternership with South Tyneside council 
Organisation South Tyneside Council
Country United Kingdom 
Sector Public 
PI Contribution We shared our experience of using the online cost evaluation tool provided by the local Distributed Network Operator (DNO) and the model we developed.
Collaborator Contribution During this EFORES project delivery, we developed a new partnership with the South Tyneside Council. The transport planning officer at the South Tyneside Council had three advising and steering meetings with the project team. The transport planning office shared his view on the digital technical technology for low-carbon transport.
Impact A gold open access peer-reviewed article on the DNO provided tool is being planned and written in conjunction with professional local government officer users in both South Tyneside Council and Newcastle City Council will be submitted in 2023
Start Year 2022
 
Description Wind Power Modelling and large fluctuation detection 
Organisation Sichuan University
Country China 
Sector Academic/University 
PI Contribution We worked together to develop a wind power model to improve the accuracy of wind power ramp detection. I contributed in the time series analysis by using the spinning door transformation.
Collaborator Contribution My partners, Prof. Liangyin Chen and his research team, from the School of Computer Science, at Sichuan University, integrated the SDT algorithm into their Ramp point correct climbing detecting (RPCRD) framework to detection the large fluctuation of wind power in a short time interval.
Impact DOI: 10.1109/ICAC55051.2022.9911117
Start Year 2022
 
Description EFORES End of Project Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact This end-of-project workshop is to disseminate our results and exchange ideas for further collaboration and industrial applications. This workshop was designed to raise awareness of digital solutions to promote EV fleets and renewable energy sources in the pathways of road transport decarbonisation by bringing researchers, industry leaders, technology innovation people and local councils together. In this workshop, we share what we did, and our findings from our EFORES research and will have a chance to listen to and ask questions of inspiring speakers and engage with a panel of engaging external experts. With networking and development sessions for further application of the information and machine learning technologies developed in academics to the EV industry, this promises to be a day with something for everyone.
Year(s) Of Engagement Activity 2023
URL http://www.efores.net/post/20230130_workshop/
 
Description EPSRC ENZ Workshop: Challenges & Opportunities of Net Zero Energy-Transport Pathways 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact This workshop is to share the progress of and stakeholder's perspectives on the research project EFORES. By bringing researchers, industry leaders, technology innovation people and local councils together in this workshop, we aim at raising awareness of digital solutions to promote EVs and renewable energy sources in the pathways of road transport decarbonisation. 'This workshop is also slected as a part of the national-wide EPSRC's Engineering Net Zero (ENZ) week. This workshop consists of two parts:
(1) Presentations by the academics at Northumbria University and industrial partners to share the experiences;
(2) A panel discussion to understand the user requirement on net zero transport energy systems.
Year(s) Of Engagement Activity 2023
URL https://www.ukri.org/events/epsrc-engineering-net-zero-showcase/
 
Description Working group for EV carclub promotion at a local social house community 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact This engagement activity is to promote an EV carclub scheme in the Elswick neighbourhood, a social house community, near the Newcastle city centre. X. Dai (PI) and R, Kotter worked with the Climate change team at Newcastle City Council and a local EV carclub company to develop a better understanding of the transport needs and patterns of people and families in the community. We visited the communities on 31/March/2022 for selecting an optimal location for EV charging station installation. Five potential locations were identified and evaluated with both the online tool provided by the LNO and our own tool to estimate the cost and impacts on the power grid. A gold open-access peer-reviewed article on this performance and cost evaluation tool is being planned, and will also be shared with professional local government officer users in both South Tyneside Council and Newcastle City Council will be submitted in 2023.We designed a survey questionnaire with the partners to understand the transport needs of people and families. These activities increased the public's awareness of the EV carclub and the initiatives of local councils for building a low-carbon community toward the target set in "Net Zero Newcastle: 2030 Action Plan".
Year(s) Of Engagement Activity 2022
URL http://www.efores.net/post/20220324_nzip_sitevisit/