A new signal processing technology to eliminate range sidelobes in meteorological radar data
Lead Research Organisation:
University of Reading
Department Name: Meteorology
Abstract
A conventional meteorological radar works by transmitting a pulse of microwaves into the atmosphere, and measuring the echoes from cloud and precipitation particles. The sum of these echoes over many pulses (the "radar reflectivity") can then be used to infer properties of those particles, such as rainfall rate.
Radar reflectivity often varies substantially over small distances - for example stratocumulus clouds may only be 200m thick, while the heavy rain from a thunderstorm cell may be only a few kilometres wide. Because of this, high resolution measurements are required. This depends on two things. First the pencil beam from a radar can be made very narrow by using a large antenna, and this is straightforward for most cloud and precipitation radars. Second, we need high resolution along the length of that pencil beam.
This "range resolution" depends on the duration of the pulse which the radar transmits. A short pulse leads to high range resolution, which is what we want. A long pulse leads to coarse range resolution which will not resolve the clouds and rain cells we wish to probe. Unfortunately there is a trade-off: long pulses give greater sensitivity to weak echoes, while short pulses give poorer sensitivity.
Pulse compression aims to bypass this trade-off. Long pulses are transmitted for high sensitivity, but extra information is encoded into these long pulses on short time scales. The echoes reflected back to the antenna are then "decoded" into the desired high range resolution. This ability to have both high sensitivity and high resolution makes pulse compression an extremely attractive technology for meteorological radars. However it has a major practical drawback, which is the formation of range-sidelobes. Because the decoding process never works perfectly, some information is spread out in range. This leads to corruption of the radar data and erroneous measurements of cloud properties and rainrates. This problem must be solved if pulse compression is to be fully exploited.
We have recently developed a simple new technique which may solve this problem. This method, which has a rigorous grounding in statistics and signal processing, allows us to identify where range sidelobes are occurring, and even correct the corrupted data. It transpires that nature provides the solution to the problem, and it does so by causing the particles in clouds and precipitation to "reshuffle" relative to one another every few milliseconds, as a result of turbulence, wind shear, and variations in fall speed. This causes the echo measured by the radar to fluctuate - and every fluctuation is unique, like a fingerprint. To determine where the echo from one range has leaked into data at another range, we look for traces of that fingerprint where it shouldn't be (we correlate two sets of fluctuations). If there is a significant correlation we can identify that corruption of the data has occured. Furthermore, the degree of correlation between the two sets of fluctuations tells you how much power has leaked from one to the other, and this knowledge allows us to correct for that leakage.
So far our work has been a theoretical analysis, and its application to two short samples of data from a cloud radar. The proposed project would develop the idea to the point where we can demonstrate that this is likely to be a practical technology of use for both research and national weather service radars. We will underpin our theory with calculations of the errors in our correlation measurements - this determines how accurately we can identify and correct our data. Second, many radars operate 24/7 so we will demonstrate that the technique is computationally fast enough to operate in real-time. Third, weather services use scanning radars which transmit "dual-polarised" pulses and this creates some challenges for the technique: we will demonstrate how it can be applied such systems.
Radar reflectivity often varies substantially over small distances - for example stratocumulus clouds may only be 200m thick, while the heavy rain from a thunderstorm cell may be only a few kilometres wide. Because of this, high resolution measurements are required. This depends on two things. First the pencil beam from a radar can be made very narrow by using a large antenna, and this is straightforward for most cloud and precipitation radars. Second, we need high resolution along the length of that pencil beam.
This "range resolution" depends on the duration of the pulse which the radar transmits. A short pulse leads to high range resolution, which is what we want. A long pulse leads to coarse range resolution which will not resolve the clouds and rain cells we wish to probe. Unfortunately there is a trade-off: long pulses give greater sensitivity to weak echoes, while short pulses give poorer sensitivity.
Pulse compression aims to bypass this trade-off. Long pulses are transmitted for high sensitivity, but extra information is encoded into these long pulses on short time scales. The echoes reflected back to the antenna are then "decoded" into the desired high range resolution. This ability to have both high sensitivity and high resolution makes pulse compression an extremely attractive technology for meteorological radars. However it has a major practical drawback, which is the formation of range-sidelobes. Because the decoding process never works perfectly, some information is spread out in range. This leads to corruption of the radar data and erroneous measurements of cloud properties and rainrates. This problem must be solved if pulse compression is to be fully exploited.
We have recently developed a simple new technique which may solve this problem. This method, which has a rigorous grounding in statistics and signal processing, allows us to identify where range sidelobes are occurring, and even correct the corrupted data. It transpires that nature provides the solution to the problem, and it does so by causing the particles in clouds and precipitation to "reshuffle" relative to one another every few milliseconds, as a result of turbulence, wind shear, and variations in fall speed. This causes the echo measured by the radar to fluctuate - and every fluctuation is unique, like a fingerprint. To determine where the echo from one range has leaked into data at another range, we look for traces of that fingerprint where it shouldn't be (we correlate two sets of fluctuations). If there is a significant correlation we can identify that corruption of the data has occured. Furthermore, the degree of correlation between the two sets of fluctuations tells you how much power has leaked from one to the other, and this knowledge allows us to correct for that leakage.
So far our work has been a theoretical analysis, and its application to two short samples of data from a cloud radar. The proposed project would develop the idea to the point where we can demonstrate that this is likely to be a practical technology of use for both research and national weather service radars. We will underpin our theory with calculations of the errors in our correlation measurements - this determines how accurately we can identify and correct our data. Second, many radars operate 24/7 so we will demonstrate that the technique is computationally fast enough to operate in real-time. Third, weather services use scanning radars which transmit "dual-polarised" pulses and this creates some challenges for the technique: we will demonstrate how it can be applied such systems.
Planned Impact
The primary non-academic beneficiaries will be:
NASA, who have recently developed an airborne cloud and precipitation radar system which employs solid state transmitters using pulse compression (see http://har.gsfc.nasa.gov/index.php?section=13). This project will demonstrate the feasibility of mitigating range sidelobe artefacts on such a radar system.
The USA Department of Energy, which runs the ARM program and has several sites across the globe which operate cloud radars employing pulse compression. This project will help them to improve the quality of their data.
Radar Manufacturers. We are aware of several radar manufacturers actively developing scanning weather radars employing pulse compression (Toshiba, Vaisala, EEC, Baron Services). They will benefit if we can demonstrate that it is possible to eliminate range sidelobes from radar systems comparable to the ones they are developing, since this will make them a more attractive proposition to the weather services or research organisations that might purchase them. There are also similar benefits for manufacturers who produce cloud radars, such as Pro Sensing Inc who build/refurbish the cloud radars used at the ARM sites, and are currently developing an airborne 35GHz cloud radar using a solid-state transmitter and pulse compression.
National Weather Services, such as the Met Office. There are a number of advantages of employing low-power radars with pulse compression for monitoring of precipitation, rather than traditional high power magnetron or klystron transmitters, such as increased reliability and reduced interference with other users of the electromagnetic spectrum (such as Wi-Fi networks). Indeed the Japanese Meteorological Agency is currently replacing all of its weather radar network with solid-state dual-polarisation radars using pulse compression for these reasons. If one is to achieve these benefits without compromising the quality of the meteorological data, identification and correction of range-sidelobe effects is essential. This project will demonstrate that this can be achieved, and will quantify to what degree of accuracy sidelobes can be eliminated.
Weather services will also benefit through the higher quality of cloud radar data, since this is routinely used to evaluate the quality of numerical weather prediction and climate models to simulate clouds. The improved data quality should lead to more accurate evaluation, and hence better identification of poor performance and improved representation of physical processes in these models. These improved numerical models will lead to better weather forecasts and climate prediction benefiting government organisations, the public, and commercial organisations.
NASA, who have recently developed an airborne cloud and precipitation radar system which employs solid state transmitters using pulse compression (see http://har.gsfc.nasa.gov/index.php?section=13). This project will demonstrate the feasibility of mitigating range sidelobe artefacts on such a radar system.
The USA Department of Energy, which runs the ARM program and has several sites across the globe which operate cloud radars employing pulse compression. This project will help them to improve the quality of their data.
Radar Manufacturers. We are aware of several radar manufacturers actively developing scanning weather radars employing pulse compression (Toshiba, Vaisala, EEC, Baron Services). They will benefit if we can demonstrate that it is possible to eliminate range sidelobes from radar systems comparable to the ones they are developing, since this will make them a more attractive proposition to the weather services or research organisations that might purchase them. There are also similar benefits for manufacturers who produce cloud radars, such as Pro Sensing Inc who build/refurbish the cloud radars used at the ARM sites, and are currently developing an airborne 35GHz cloud radar using a solid-state transmitter and pulse compression.
National Weather Services, such as the Met Office. There are a number of advantages of employing low-power radars with pulse compression for monitoring of precipitation, rather than traditional high power magnetron or klystron transmitters, such as increased reliability and reduced interference with other users of the electromagnetic spectrum (such as Wi-Fi networks). Indeed the Japanese Meteorological Agency is currently replacing all of its weather radar network with solid-state dual-polarisation radars using pulse compression for these reasons. If one is to achieve these benefits without compromising the quality of the meteorological data, identification and correction of range-sidelobe effects is essential. This project will demonstrate that this can be achieved, and will quantify to what degree of accuracy sidelobes can be eliminated.
Weather services will also benefit through the higher quality of cloud radar data, since this is routinely used to evaluate the quality of numerical weather prediction and climate models to simulate clouds. The improved data quality should lead to more accurate evaluation, and hence better identification of poor performance and improved representation of physical processes in these models. These improved numerical models will lead to better weather forecasts and climate prediction benefiting government organisations, the public, and commercial organisations.
Organisations
| Description | We are developing ways to alleviate a problem called "range sidelobes" which leads to errors in radar measurements of clouds and precipitation. We have run computer simulations to understand the effect better, and are comparing these with our recent theoretical model to see how accurately we can remove these errors. |
| Exploitation Route | We still have work to complete on this project, implementing a real-time sidelobe suppression system, and testing the idea for weather radar. The findings are applicable to many others in the field of radar meteorology (both academics and commercial radar manufacturers), where the pulse compression technique responsible for production of range sidelobes is becoming increasingly common. |
| Sectors | Electronics,Environment |