the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Dual adaptive differential threshold method for automated detection of faint and strong echo features in radar observations of winter storms
Laura M. Tomkins
Sandra E. Yuter
Matthew A. Miller
Radar observations of winter storms often exhibit locally enhanced linear features in reflectivity, sometimes labeled as snow bands. We have developed a new, objective method for detecting locally enhanced echo features in radar data from winter storms. In comparison to convective cells in warm season precipitation, these features are usually less distinct from the background echo and often have more fuzzy or feathered edges. This technique identifies both prominent, strong features and more subtle, faint features. A key difference from previous radar reflectivity feature detection algorithms is the combined use of two adaptive differential thresholds, one that decreases with increasing background values and one that increases with increasing background values. The algorithm detects features within a snow rate field rather than reflectivity and incorporates an underestimate and overestimate of feature areas to account for uncertainties in the detection. We demonstrate the technique on several examples from the US National Weather Service operational radar network. The feature detection algorithm is highly customizable and can be tuned for a variety of data sets and applications.
- Article
(19107 KB) - Full-text XML
- BibTeX
- EndNote
Linear features of enhanced reflectivity, labeled as snow bands, are often observed in winter storms and are an active topic of research (Baxter and Schumacher, 2017; Ganetis et al., 2018; Lackmann and Thompson, 2019; Kenyon et al., 2020; Picca et al., 2014; Novak et al., 2004; McMurdie et al., 2022; Colle et al., 2023). Snow bands that are ≥ 250 km in length are described as primary or single bands, and sets of roughly parallel smaller bands each less than 250 km long are described as multi-bands (Ganetis et al., 2018). Primary bands are typically associated with frontogenesis (Novak et al., 2004), but the forcing mechanism for multi-bands is still unclear (Ganetis et al., 2018). Unlike convective cells in rain which usually have high reflectivities and a sharp reflectivity gradient between the cell itself and the background reflectivity, snow bands have weaker reflectivities and stand out less from the background, and the edges of snow bands can gradually taper out, creating an irregular edge. Hence, objective methods to identify convective and stratiform precipitation in radar data of deep convection do not work well for winter storms.
Much of the previous work to detect snow bands in radar reflectivity data focused on identification of primary bands and either ignored multi-bands or only addressed the stronger subset of multi-bands. Novak et al. (2004) and Baxter and Schumacher (2017) used dBZ thresholds (30 and 25 dBZ, respectively) to identify primary band objects in National Weather Service (NWS) Next Generation Radar (NEXRAD) Level-III reflectivity regional maps. Kenyon et al. (2020) identified primary snow bands for five winter seasons using Level-III reflectivity data. Kenyon et al. (2020) used a 20 dBZ threshold, with the caveat that there must be an embedded region > 25 dBZ along at least half the axis that is at least 10 dB greater than the background reflectivity. Level-III reflectivity data has a precision of 5 dB and will inherently not be able to identify features that are < 5 dB different from the background. In general, methods that use fixed thresholds are sensitive to the radar calibration and the grid spacing of the input data since reflectivity values are not invariant in scale (Rinehart, 2004).
Several authors have used methods that adapt to changing background reflectivity values in the wider storm and hence better detect localized enhancements than fixed threshold methods. Ganetis et al. (2018) identified both primary and multi-band features by identifying echo regions in NEXRAD Level-II regional reflectivity maps that were greater than the upper sextile of reflectivity values for a given precipitation region. Ganetis et al. (2018) classified primary bands as objects that were ≥ 200 km and had an aspect ratio (width length) of ≤ 0.5 and multi-bands as objects that were < 200 km and had an aspect ratio ≤ 0.5. Objects that had an aspect ratio > 0.5 and a length ≥ 10 and ≤ 100 km were labeled as cells. Radford et al. (2019) used NEXRAD base reflectivity (lowest elevation angle) mosaics for three winter seasons and only considered objects that were 1.25 standard deviations above the mean reflectivity, ≥ 250 km in length, and with a minimum aspect ratio of 0.33, following the methods of Baxter and Schumacher (2017).
The Method for Object-Based Diagnostic Evaluation (MODE), included in the Model Evaluation Tools (MET) verification software package, is a popular tool for detecting objects in meteorological data sets (Bullock et al., 2016). Originally developed to compare forecast fields to observed fields, MODE applies a convolution to a field and then uses user-defined thresholds to find objects in the original field. For example, the user can change the size of the convolution radius used to smooth the input field and the single threshold that determines whether an object is defined relative to the smoothed background.
For some applications, detecting only strong snow bands is sufficient. For our research, which aims to understand the environments in which snow bands form and the physical processes that create them, a fuller picture of their life cycle is needed. Visual inspection of sequences of radar data demonstrates that advecting snow bands often undergo transitions from faint to strong to faint before dissipating. In order to study these structures, we needed an automated snow band detection method that would detect a range of echo features from faint to strong.
Our method, described in detail in Sect. 2, re-scales the reflectivity field to an estimated snow rate to better discern weak echo features and combines two differential adaptive thresholds to determine if a feature stands out from the background. Based on the difference between a pixel and the background average value, the algorithm determines if the pixel is part of an enhanced feature. The algorithm “adapts” the difference threshold to the mean background value. There are two ways a pixel could pass this test. One is based on a criterion that requires a decreasing difference with increasing background value, while the other requires an increasing difference with increasing background value. We use the generic term “locally enhanced feature” to describe objects that one would pick out by eye as distinct from lower background values. We define two varieties of locally enhanced features, “strong” features that have larger differences from the background and “faint” features that have smaller differences from the background where the background field is weak. The algorithm we developed for detecting locally enhanced features in winter storms is described in Sect. 2, examples of our technique are shown in Sect. 3, and a summary is provided in Sect. 4. We contributed the software to the open-source Python package, Py-ART (Helmus and Collis, 2016), where it is available for general use. Within this paper, we will be using the terms “object”, which is commonly used in the image processing literature, and “feature”, which refers here to the meteorological application interchangeably. We also define winter season storms of interest as those that contain a substantial area of surface snowfall.
2.1 Data
To demonstrate our method, we use NEXRAD Level-II radar reflectivity regional reflectivity maps composed from several radars in the northeastern US (Tomkins et al., 2022, 2023a, b). The regional maps use 2D Cartesian Cressman interpolation to a 2 km grid based on the 0.5° elevation angle from several different radars. Where there is overlap between adjacent radars, we use the point with the highest reflectivity value. Given the coarse vertical spatial resolution of NWS operational radar volume coverage patterns, 3D Cartesian interpolation often smooths and obscures the fine-scale horizontal features we need to discern faint objects. For our application, the varying altitudes along the 0.5° elevation angle scans that constitute the regional maps are preferable to a constant altitude map that smooths key features we need for our analysis. While we demonstrate our technique with a specific set of NEXRAD radars in the northeastern US, the technique can be applied to any gridded radar data.
2.2 Feature detection algorithm
The feature detection method described in this paper to identify locally enhanced reflectivity features in cool-season precipitation systems is built upon the implementation of adaptive thresholds for objective convective-stratiform precipitation classification developed for warm-season storms in a series of papers by Churchill and Houze (1984), Steiner et al. (1995), Yuter and Houze (1997), and Yuter et al. (2005). The underlying idea, identifying the cores of features that exceed the background value by an amount that varies with the background value, is well established (Steiner et al., 1995). These types of algorithms are highly customizable and can be tuned to a wide variety of data sets. So as to be more general purpose, the software we contributed to the open-source python package, Py-ART, can be configured to run either as a variant of established convective-stratiform precipitation algorithm for warm-season storms or for the application described in this paper for winter storms.
A data flow diagram of the winter storm algorithm using the Yourdon symbol conventions (Woodman, 1988) shows the key steps in the data processing (Fig. 1). The top-level data flow (Fig. 1a) is shown with two levels of nested data processing (Fig. 1b and c). The steps in Fig. 1c follow the data flow steps from the Steiner et al. (1995) algorithm to identify convective and stratiform precipitation from reflectivity in rain layers. Input parameter names and recommended settings for detecting locally enhanced reflectivity features in snow are provided in Table 1.
The feature detection algorithm outputs 2D arrays that in effect simplify the input reflectivity field into faint feature, strong feature, and background categories. Additional image processing of this output based on the shape characteristics of individual features such as aspect ratio, length, width, and area can be used to further classify the features into different types of banded and cellular features (e.g., Ganetis et al., 2018).
2.2.1 Estimation of snow rate
A key difference from previous methods described in Sect. 1 is the use of an estimated snow rate field as the input for the feature detection instead of a radar reflectivity field. A very rough first-order approximation is that radar reflectivity dBZ∝log 10(mass3) for unrimed aggregates, where mass is the mass per unit volume of precipitation-sized particles (Matrosov et al., 2007). For rain, the radar reflectivity to mass relationship can be approximated by dBZ∝log 10(mass2). Multiple observational studies have shown that any one relationship between reflectivity and snow rate has high uncertainty, since the associated snow rate can vary by 2 orders of magnitude for any given dBZ value (Fujiyoshi et al., 1990; Rasmussen et al., 2003). This first step in the data processing transforms reflectivity to a value that is more linear in liquid-equivalent snow rate. We chose to use liquid-equivalent snow rate rather than linear Z since it is more physically intuitive. We do not use the derived snow rates for quantitative estimates of precipitation. We only use them as an alternative scaling factor to reflectivity in dBZ.
Empirical Z–S relations encompass ones for dry snow, which have smaller changes in equivalent liquid per ΔZ to ones for wet snow, which have larger changes per ΔZ (Fig. 2; Rasmussen et al., 2003). In order to obtain higher contrast between locally enhanced Z in terms of snow rates, we use the wet snow Z–S relationship from Rasmussen et al. (2003): Ze=57.3S1.67, where Ze is equivalent radar reflectivity with units of mm6 m−3 and S is snow rate with units of mm h−1. Our results are not sensitive to the absolute values of snow rate, only to the relative anomaly from the background average. Examples of re-scaling the reflectivity field to a snow rate field are shown in Fig. 3.
2.2.2 Calculation of smoothed background field
A locally smoothed background average snow rate field is computed from the snow rate field (Fig. 3). The background radius smoothing parameter is used to define a circular footprint surrounding each pixel (Fig. 1a). We found that use of circular footprints produced better results than rectangular footprints. The points within the circular footprint are averaged to find the background value for that point. Feature detection is sensitive to the size of the area used to calculate the background value (not shown). We found a background radius of 40 km was the most suitable for detecting snow band features in the NWS NEXRAD data. A larger background radius will yield a smoother background average field used to compare to the input field to find features. A smaller background radius is likely more suitable for warm-season precipitation systems, which usually have stronger reflectivity gradients than cool-season precipitation systems. An example of the locally smoothed background average snow rate field is shown in Fig. 3.
When calculating the background average, a minimum fraction of valid points within the footprint can be set so only pixels with a sufficient amount of surrounding echo are used in the analysis. We use a minimum fraction of 0.75 (i.e., the footprint must contain at least 75 % echo coverage to be used in the analysis). This is done to minimize small, spurious features on the edge of the echo. The effects of the 0.75 minimum fraction can be seen in Fig. 3, where there are differences between the more jagged echo outer edges in the snow rate field (Fig. 3d–f) compared to the smoother echo edges in the background field (Fig. 3g–i). Changing the minimum fraction acts to change how much echo must be present in the circular background footprint for a given pixel to be considered in the algorithm. A minimum fraction of zero would yield a background field with identical outer edges to the snow rate field.
2.2.3 Two adaptive differential thresholds for finding feature cores
The background average field and the original snow rate field are compared using two difference threshold schemes. Pixels where the difference between the snow rate field and the background average field are greater than or equal to the adaptive difference threshold constitute a feature's core.
There are two individual pixel versus background difference relationships built into the algorithm, a cosine scheme and a scalar multiplier scheme that are used in combination and utilize units of mm h−1. A pixel is identified as feature core if the value of the pixel exceeds the background by either adaptive threshold. If the pixel is only identified as a core with the scalar multiplier scheme, it is labeled as a faint feature. If it is identified as a core with the cosine scheme, it is labeled as a strong feature. The cosine relationship has a decreasing threshold with increasing background value (Fig. 4a). The cosine scheme uses simple and intuitive parameters to define a smooth, curved relationship between the background value and the difference threshold. The scalar multiplier scheme uses a difference threshold that increases linearly as the background value increases (Fig. 4b). This allows the scalar multiplier to pick up subtle features that are not very distinct from the background when the background values are small (i.e., in regions of weak precipitation). For example, for a background value of 1 mm h−1, the cosine scheme threshold is 1.4 mm h−1, while the scalar scheme threshold is 0.5 mm h−1. After extensive testing on many idealized and real examples from winter storms, we found that a combination of both types of adaptive thresholds was needed in order to detect the full range of reflectivity features from faint to strong. The cosine scheme only identifies objects that are very distinct from the background, while the scalar multiplier scheme identifies objects that are both very distinct and not very distinct. We chose the particular equations described here as they were both intuitive and easy to tune.
The cosine scheme's decreasing difference threshold with increasing background value is described in Eq. (1), where S represents the snow rate at a pixel, Saverage represents the background average snow rate, a represents a maximum possible difference value corresponding when the background average value is 0 mm h−1, and b represents the background average value where the corresponding difference threshold is zero.
Other similar equations with a decreasing threshold with increasing background value would also likely be suitable. The cosine scheme (Fig. 4a) is adapted from methods used to identify convective and stratiform precipitation structures in rain (e.g., Steiner et al., 1995; Yuter and Houze, 1997; Yuter et al., 2005; Powell et al., 2016). The choice of this specific equation is purposeful as it permits the same Python code to be used with an input field of radar reflectivity from a rain layer and appropriate parameter settings to exactly reproduce the data processing of the original C++ code used in Yuter et al. (2005).
Figure 4a shows how changing the maximum difference (a in Eq. 1; horizontal dashed line) and zero difference cosine value (b in Eq. 1; vertical dashed line where the function would cross the x axis) changes the overall shape of the difference function and thus the thresholds used to identify pixels that are cores. Having a lower maximum difference or zero difference cosine value will increase the number of cores since it relaxes the difference threshold needed for a point to be considered a core. The final tuning parameter in the difference relationship is the “always core threshold” which is the value above which all background points are considered cores (vertical dashed line in Fig. 4). An absolute threshold like the always core threshold is helpful for identifying cores in regions where the background values are high. It is particularly useful for the scalar scheme and provides additional flexibility in turning. The zero difference cosine value can be used in place of the always core threshold in the cosine scheme. In our method, the value corresponding to a pixel that is always part of a snow band is set at an equivalent liquid precipitation rate of 5 mm h−1 (which corresponds to a reflectivity value of 30 dBZ). For reflectivity fields in rain, usually this value is set at or above 40 dBZ (rain rate of about 13 mm h−1).
The scalar multiplier scheme uses a linear function with a difference threshold that increases with increasing background value up to the always core threshold (Fig. 4b). The equation for the scalar multiplier scheme is described by Eq. (2)m where S represents the snow rate at a pixel, Saverage represents the background average snow rate, and c represents the scalar difference.
The scalar difference value (c in Eq. 2) changes the slope of the difference threshold in Fig. 4b). A larger scalar difference value will yield a steeper slope and a greater difference threshold needed for a given background average value.
Figure 4c shows both difference equations and is colored coded by classification (strong feature, faint feature, background) based on the two different schemes. A detection threshold that increases with increasing background value helps to distinguish both the tapered edges of stronger features and features that differ only slightly from the background. Figure 5 shows three examples of the output from both the cosine scheme and the scalar scheme. Both the cosine scheme and the scalar scheme pick up the strong features from the snow rate (e.g., band of 10+ mm h−1 in Fig. 5b), but only the scalar scheme can identify the weaker features including the fuzzy, irregular edges.
Examples in Appendix A demonstrate the influence of the background radius, always core threshold, scalar difference, zero difference cosine value, and maximum difference on the algorithm output.
2.2.4 Converting cores to contiguous features
To address isolated pixels within detected features, we perform a binary closing on the 2D array of cores to mitigate these artifacts (Fig. 6a). A binary closing is an image dilation followed by an image erosion that acts to fill in the holes within a feature but keeps the feature at roughly the original size (Jamil et al., 2008). We use a quasi-circular 5×5 kernel (Fig. 6b) for the binary closing to yield a more physically realistic output as opposed to use of a square kernel.
After we perform the binary closing step, we then remove objects that are less than 120 km2 in area. We found that this value was suitable for our applications. No object capable of meeting the band criteria of Ganetis et al. (2018) is less than 120 km2 in area. An example of the binary closing and small object removal on the cosine scheme cores from the examples presented in Fig. 5 is shown in Fig. 7 to yield the filtered, spatially contiguous features of interest.
There were two steps from the established convective-stratiform algorithm that we turned off for our feature detection application to winter storms. An additional step can be applied to delineate a weaker echo subset of the background echo. We do not use this for our application and set both the weak echo and minimum value to 0 mm h−1 (Table 1). Alternate values of these settings can be useful for tabulating statistics of different magnitudes of background radar echo. For the radar data set we were using, we found that the additional step of using a radius of influence around each core pixel as part of the feature was not needed. To turn this off, we set the maximum core radius to 2 km, the same as the input grid pixel size (Table 1). For some applications, the radius of influence step may be needed, especially for finer grids.
2.2.5 Snow storm faint and strong feature identification method
Objects that are identified by the cosine scheme we define as “strong” objects, while objects that are only identified by the scalar multiplier and not by the cosine scheme are defined as “faint” objects (Fig. 8). The separation into strong and faint objects allows for analysis that addresses the relative intensity of the observed reflectivity compared to independent data sets, such as surface weather station snow rates. The output of the algorithm can yield strong and faint portions of the same contiguous feature and objects that are solely of one type (Fig. 8g–i).
An important component of running the algorithm in practice is to account for uncertainties in the observed data and that no one method for feature detection will work perfectly in all situations. Similar to Yuter et al. (2005), we bound our feature identification by running the algorithm on the estimated snow rate field and two offsets of that field with slightly higher and lower values to yield purposeful overestimates and underestimates of the feature detection. Increasing the radar reflectivity by 2 dB, converting to snow rate, and then running the algorithm yields an overestimate in feature area, while decreasing by 2 dB yields an underestimate. For the underestimate, since we do not consider values ≤ 0 mm h−1 (Table 1), echo where the original reflectivity field ≤ 2 dBZ gets removed, so the underestimate feature detection field will have less total echo area than the best and overestimate feature detection fields. Bounding the best-estimate feature detection field can be accomplished by varying the input field slightly as we have done here or by varying the difference equation. Both accomplish the same goal of making minor adjustments to yield an underestimate and overestimate in the field. We recommend adjusting the field by at least ± 2 dB as this value is close to the minimum uncertainty in the US NWS operational radar reflectivity calibrations. As compared to the “best estimate”, the underestimate version usually reduces the size of strong features and amplifies the detection of faint features compared to the best estimate. The overestimate version the snow field usually yields larger feature sizes for the strong features and damps the detection of the faint features compared to the best estimate.
2.3 Visual de-emphasis of regions with mixed precipitation
After we run the algorithm to detect features, we apply image muting (Tomkins et al., 2022) as a separate step independent of the feature detection algorithm to identify regions of mixed precipitation in the winter storms. This step de-emphasizes portions of the echo that pass through the 0 °C level in the final visualized plots by utilizing information from the radar's correlation coefficient field. Regions where the reflectivity is ≥ 20 dBZ and the correlation coefficient are ≤ 0.97 are considered to be likely melting or mixed precipitation and are colored in a grayscale (Tomkins et al., 2022). The sharp temperature gradients in winter storms can yield mixed-precipitation echo regions that resemble bands (e.g., Picca et al., 2014, their Fig. 2, and Colle et al., 2023, their Fig. 7). It is important to remove these mixed-phase echoes before interpreting the detected enhanced features as snow. Full details of how the image muting is applied and evaluated can be found in Tomkins et al. (2022).
2.4 Limitations
The quality of the input data fields, including their calibration and precision, are constraints that impact the quality of the output. For example, this particular algorithm would not work well on input radar reflectivity data with 5 dB precision. Input data quality issues such as attenuation are not able to be corrected inside the algorithm. As expected, when we applied our algorithm to Ku-band and Ka-band radar data collected from aircraft, we found that attenuation can affect the detection of enhanced features. While the algorithm runs fairly quickly (about 60 s per 601×601 size reflectivity input field on our servers), there is room for improvement in code efficiency and the potential for parallelization to be incorporated.
An important consideration when interpreting the feature detection field is situational awareness of where snow is occurring. Winter storms in the northeastern US often transition among multiple precipitation types, including snow, rain, mixed, and melting precipitation. We tuned the algorithm to work specifically in regions where we were reasonably confident that surface snow was occurring. Because regions of rain typically have high reflectivities, they are almost always identified as enhanced features based on how we tuned our algorithm to detect features in snow. Our image muting technique (Tomkins et al., 2022) assists with the interpretation of precipitation type within echo by identifying regions of likely mixed and melting precipitation using the correlation coefficient field. Additional independent data sets such as surface air temperatures and surface-based precipitation type sensors can also help provide context for the precipitation type observed by radar.
The “flashing” of features occurs when a particular enhanced feature alternates between being detected and not being detected in sequential times. A key goal of the algorithm development was to minimize flashing of individual features in consecutive times. Small speckles are more prone to flashing than larger area features, which is why we filter out small objects. While we minimized flashing as best we could, there are still times when features are not consistent through time. Another aspect of flashing occurs where the edges of enhanced features can alternate between strong and faint.
With the “turning knobs” on the command line, it is straightforward to test and to refine the input parameters for the algorithm (see also Appendix A). There is no one set of input parameters that will work perfectly every time. For best results, the user needs to optimize the parameters for their application. It is recommended to use a tuning data set of test cases representing a wide range of possible input fields including time sequences from a dozen or more real cases. Like an out-of-tune piano, poor tuning will obviously lead to poor results. The input parameters in Table 1 were tuned for the US NEXRAD network of S-band radars and mid-latitude northeastern US winter storms. These particular values will likely need to be modified for other radar hardware and/or other storm regimes such as polar winter storms.
We illustrate our algorithm on regional composites of Level-II data from National Weather Service (NWS) Next-Generation Radar (NEXRAD) network radars that were obtained from the NOAA Archive on Amazon Web Services (Ansari et al., 2018). Full details on how the composites are created can be found in Sect. 2.1 of Tomkins et al. (2022).
Our examples span a range of cases and snow band intensities including storms with and without primary bands and multi-bands. The example from 7 February 2021 (left column in Figs. 3, 5, 7, and 8) shows several strong bands over Maryland and Virginia and a few faint objects as well. The one from 17 December 2020 (middle column in Figs. 3, 5, 7, and 8) includes a strong primary band over northern Pennsylvania and southern New York and several faint bands over southern Pennsylvania. The data from 17 December 2019 (right column in Figs. 3, 5, 7, and 8) contains mostly faint bands over New Hampshire and Maine. All the cases shown also include portions of echo that contain mixed precipitation, which commonly occurs in US East Coast winter storms. In each of the example regional cases, video supplements illustrate the time continuity of the detection method as features evolve and move through the domain.
Application in snow layers to identify faint and strong reflectivity features
The spatial and temporal coherence of the bands is illustrated in the sequences of images ±1 h for each of Figs. 9–12 in the Video Supplement. Individual bands form and dissipate as the storm moves and evolves.
The winter storm from 7 February 2021 at 14:37 UTC exhibited a primary band extending from northern Virginia to Connecticut and faint multi-bands across Pennsylvania and New York (Fig. 9). The underestimate field (Fig. 9c) also has a strong primary band similar to the best estimate (albeit smaller and narrower). The few, small strong features in the best estimate are detected as faint features in the underestimate (Fig. 9c). The overestimate field (Fig. 9d) has a wider strong band compared to the best estimate and has more strong objects in general compared to the best estimate. The strong, primary band traverses along the US East Coast, while the faint multi-bands dissipate and form in the weaker region in Pennsylvania and New York (Video Supplement Animation-Figure-9).
The winter storm from 17 December 2020 over the northeastern US (Fig. 10) contained primary and multi-bands. There are several large bands that extend over New York and Massachusetts that are associated with high values in the snow rate field and are identified as strong features (Fig. 10). Over southern Pennsylvania there are other features that do not stand out as much that are identified as faint features (Fig. 10). As the storm evolves, the large band remains roughly in the same location but changes shape while the other, smaller features undergo more dramatic changes (e.g., dissipate, break apart, strengthen) (Video Supplement Animation-Figure-10). The faint bands over Pennsylvania also evolve in time and space, some transitioning to strong bands and some weakening and dissipating (Video Supplement Animation-Figure-10). Similar to the previous example, the underestimate has a narrower primary band and has a lot more “faint” features compared to the best estimate and overestimates. The overestimate shows very few faint features and mostly amplifies the main strong features (Fig. 10d).
The winter storm on 17 December 2019 was generally weaker and had a lot of faint bands compared to the example from 17 December 2020 (Fig. 11). Areas of the southern part of the storm are image muted, indicating melting and mixed precipitation and a transition to rain. The northern part of the storm has numerous faint features over northern New York, Vermont, New Hampshire, and Maine (Fig. 11a and b). In this example, the faint bands are more coherent in time and space than the other examples, some of these faint bands evolve into strong bands, and some strong bands evolve into faint bands (Video Supplement Animation-Figure-11).
The winter storm from 7 February 2020 over the northeastern US that is characterized by large regions of melting (gray muted regions in Fig. 12). This example has a large, strong object extending from Pennsylvania through New York but does not have any faint bands or sets of multi-banded structures as discussed in Colle et al. (2023) (Fig. 12). This large, long, and strong feature spans the transition from snow to rain and is persistent in time for several hours (Video Supplement Animation-Figure-12). It is very likely that the portion of the strong band to the east of the SW–NW mixed-precipitation area is rain rather than snow. Further feature filtering by surface air temperature fields would be useful in cases like this to isolate surface snow.
We present a novel method for identifying locally enhanced features in radar observations of winter storms that uses a combination of increasing and decreasing adaptive thresholds as a function of average background values. Our method identifies features from a snow rate field rather than radar reflectivity in order to better automatically identify human eye discernable features in radar data of snow. Previous methods to automatically detect snow bands in radar observations either used inflexible thresholds and Level-III reflectivity data (5 dB precision) or used adaptive thresholds that were not able to detect objects that are not very distinct from the background. This new method facilitates both the detection of stronger objects and fainter objects that are less distinct from the background average in snow storms. The wider range of characteristics of detected features provides a more comprehensive basis for examining hypotheses relating radar-observed features to surface snowfall and intra-storm environments.
There is no one feature detection algorithm that is going to produce perfect results every time. Our image processing software facilitates easy adjustments to the algorithm tuning from the command line and has built functionality for determining credible underestimates and overestimates of feature areas. These underestimates and overestimates aid in bounding the uncertainty in the feature detection field. The user is advised to always test and refine the tuning parameters of the algorithm on their data to ensure that the settings are adequate for their purpose.
The output of the algorithm described in this paper yields 2D arrays with categorical values for different strengths of detected radar echo features and background echo. These output arrays can be input into image processing software to yield statistics of feature characteristics such as area, aspect ratio, orientation, convex hull, and centroid location. Object attributes can be used to further subset objects and for comparison to other independent data sources. Additionally, this algorithm can be applied to snow rate fields from numerical forecast model output to yield feature objects for use in nowcasting and for model evaluation.
Differential adaptive threshold methods for image segmentation that distinguish locally enhanced features from a varying background have applications to several areas in geosciences. In satellite data analysis, detection of cold cloud tops associated with deep convective storm anvils is often defined based on absolute IR brightness thresholds (Schiffer and Rossow, 1983; Arkin and Meisner, 1987; Machado and Rossow, 1993), but tropopause heights can vary latitudinally, regionally, and seasonally. Additionally, satellite passive microwave brightness temperature signatures associated with local enhancements in scattering and emission by precipitation are harder to discern over the more spatially varying thermal characteristics of land as compared to ocean (Ferraro et al., 2013).
By design, adjusting the tuning parameters in the algorithm changes the detected features in the output. To demonstrate how each parameter influences the output, we run the algorithm with many different configurations on an example from Long Island, NY, in February 2021 (Fig. A1). Example output of the scalar scheme portion of the algorithm and how it varies with different combinations of scalar difference (1.2x, 1.5x, and 1.8x), background radius (20, 40, and 60 km), and always core threshold (4, 5, and 6 mm h−1) is shown in Figs. A2–A4. Example output of the cosine scheme portion of the algorithm and how it varies with different combinations of zero difference cosine value (4, 5, and 6 mm h−1), maximum difference (0.5, 1.5, and 2.5 mm h−1), and always core threshold (4, 5, and 6 mm h−1) is shown in Figs. A5–A7. As expected, a lower scalar difference (1.2x, Fig. A2) picks up more distinct features and larger areas for a given feature compared to a higher scalar difference (1.8x, Fig. A4) since a lower scalar difference setting will result in a smaller difference needed for a feature to be identified from the background (Fig. 4b). In general, fewer separate features with larger areas are identified when the background radius is larger compared to when the background radius is smaller (compare across a row from left to right in Figs. A2–A4). As the always core threshold setting is increased from 4 to 6 mm h−1, the areas of detected features decrease as the weaker values along the tapered edges of the local enhancements fall below the detection threshold (compare down a column from top to bottom in Figs. A2–A7). Similar to the always core threshold, the areas of the detected features decrease as the zero difference cosine value increases from 4 to 6 mm h−1 as the tapered edges of the features no longer meet the detection threshold (Figs. A5–A7). A lower maximum difference value decreases the threshold needed to identify cores when the background value is low. As the maximum difference value increases, less echo is identified as a feature, particularly along the edges of the locally enhanced features (compare across a row from left to right in Figs. A5–A7). Depending on the user's specific application, any one of these 54 variations may be most suitable. A key to this algorithm is its built-in flexibility.
We submitted functions that run the feature detection algorithm to the Py-ART GitHub repository (Helmus and Collis, 2016) to facilitate use of this technique by others. They were accepted and released in Py-ART version 1.14.1. The Py-ART function used to create the figures in the paper can be accessed via https://arm-doe.github.io/pyart/API/generated/pyart.retrieve.feature_detection.html (Helmus and Collis, 2016). An example of how to use the function is provided here: https://arm-doe.github.io/pyart/examples/retrieve/plot_feature_detection.html (last access: 27 November 2023).
The NWS NEXRAD Level-II data used in Figs. 9–12 can be accessed from the National Centers for Environmental Information (NCEI) at https://www.ncei.noaa.gov/products/radar/next-generation-weather-radar (Amazon Web Services, 2023). The radar composites created from the NEXRAD Level-II data used in Figs. 9–12 can be accessed from a Dryad repository at https://doi.org/10.5061/dryad.rbnzs7hj9 (Tomkins et al., 2023b).
Below is a list of animations with captions and filenames. All animations can be viewed at https://av.tib.eu/series/1524/ (Tomkins, 2023e). Individual animations can be viewed by following the DOI URL.
Animation-Figure-9 (https://doi.org/10.5446/63170, Tomkins, 2023a) is an animated plot of Fig. 9 demonstrating bounding the best-estimate feature detection with purposeful overestimates and underestimates using an example from 7 February 2021 13:30–15:30 UTC that features a primary snow band and a few multi-bands. Locally enhanced features that include mixed precipitation are image muted in gray (Tomkins et al., 2022). (a) Re-scaled snow rate field (mm h−1 units) and feature detection (b) best estimate, (c) underestimate, and (d) overestimate. Feature detection fields show background regions in teal, strong features in yellow, and faint features in orange.
Animation-Figure-10 (https://doi.org/10.5446/63171, Tomkins, 2023c) is an animated plot of Fig. 10 demonstrating bounding the best-estimate feature detection with purposeful overestimates and underestimates using an example from 17 December 2020 05:30–07:30 UTC that features several strong primary bands and a few faint multi-bands. Locally enhanced features that include mixed precipitation are image muted in gray. (a) Re-scaled snow rate field (mm h−1 units) and feature detection (b) best estimate, (c) underestimate, and (d) overestimate. Feature detection fields show background regions in teal, strong features in yellow, and faint features in orange.
Animation-Figure-11 (https://doi.org/10.5446/63172, Tomkins, 2023b) is an animated plot of Fig. 11 demonstrating bounding the best-estimate feature detection with purposeful overestimates and underestimates using an example from 17 December 2019 15:30–17:30 UTC that features many faint multi-bands. Locally enhanced features that include mixed precipitation are image muted in gray. (a) Re-scaled snow rate field (mm h−1 units) and feature detection (b) best estimate, (c) underestimate, and (d) overestimate. Feature detection fields show background regions in teal, strong features in yellow, and faint features in orange.
Animation-Figure-12 (https://doi.org/10.5446/63168, Tomkins, 2023d) is animated plot of Fig. 12 demonstrating bounding the best-estimate feature detection with purposeful overestimates and underestimates using an example from 7 February 2020 12:30–14:30 UTC that features a large primary band, portions of which are mixed precipitation and image muted in gray. (a) Re-scaled snow rate field (mm h−1 units) and feature detection (b) best estimate, (c) underestimate, (d) overestimate. Feature detection fields show background regions in teal, strong features in yellow, and faint features in orange.
LMT and SEY conceptualized the project and designed the methodology with input from MAM. LMT wrote the Python software with input from SEY and MAM. LMT prepared the manuscript and the figures. All authors contributed to editing and review.
The contact author has declared that none of the authors has any competing interests.
Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors.
Our testing methodology and iterative algorithm refinement benefited from discussions with Brian Colle, Phillip Yeh, Luke Allen, and Kevin Burris.
This research has been supported by the National Aeronautics and Space Administration (grant no. 80NSSC19K0354), the Division of Atmospheric and Geospace Sciences (grant no. AGS-1905736), and the Center for Geospatial Analytics at North Carolina State University.
This paper was edited by Stefan Kneifel and reviewed by two anonymous referees.
Ansari, S., Greco, S. D., Kearns, E., Brown, O., Wilkins, S., Ramamurthy, M., Weber, J., May, R., Sundwall, J., Layton, J., Gold, A., Pasch, A., and Lakshmanan, V.: Unlocking the Potential of NEXRAD Data through NOAA's Big Data Partnership, B. Am. Meteorol. Soc., 99, 189–204, https://doi.org/10.1175/BAMS-D-16-0021.1, 2018. a
Arkin, P. A. and Meisner, B. N.: The Relationship between Large-Scale Convective Rainfall and Cold Cloud over the Western Hemisphere during 1982–84, Mon. Weather Rev., 115, 51–74, https://doi.org/10.1175/1520-0493(1987)115<0051:TRBLSC>2.0.CO;2, 1987. a
Amazon Web Services (AWS): Next Generation Weather Radar (NEXRAD), https://registry.opendata.aws/noaa-nexrad, last access: 7 November 2023. a
Baxter, M. A. and Schumacher, P. N.: Distribution of Single-Banded Snowfall in Central U. S. Cyclones, Weather Forecast., 32, 533–554, https://doi.org/10.1175/WAF-D-16-0154.1, 2017. a, b, c
Bullock, R. G., Brown, B. G., and Fowler, T. L.: Method for Object-Based Diagnostic Evaluation, NCAR Technical Note, https://doi.org/10.5065/D61V5CBS, 2016. a
Churchill, D. D. and Houze, R. A.: Development and Structure of Winter Monsoon Cloud Clusters on 10 December 1978, J. Atmos. Sci., 41, 933–960, https://doi.org/10.1175/1520-0469(1984)041<0933:DASOWM>2.0.CO;2, 1984. a
Colle, B. A., Yeh, P., Finlon, J. A., McMurdie, L., McDonald, V., and DeLaFrance, A.: An Investigation of a Northeast U.S. Cyclone Event Without Well-Defined Snow Banding During IMPACTS, Mon. Weather Rev., 151, 2465–2484, https://doi.org/10.1175/MWR-D-22-0296.1, 2023. a, b, c
Ferraro, R. R., Peters-Lidard, C. D., Hernandez, C., Turk, F. J., Aires, F., Prigent, C., Lin, X., Boukabara, S.-A., Furuzawa, F. A., Gopalan, K., Harrison, K. W., Karbou, F., Li, L., Liu, C., Masunaga, H., Moy, L., Ringerud, S., Skofronick-Jackson, G. M., Tian, Y., and Wang, N.-Y.: An Evaluation of Microwave Land Surface Emissivities Over the Continental United States to Benefit GPM-Era Precipitation Algorithms, IEEE T. Geosci. Remote, 51, 378–398, https://doi.org/10.1109/TGRS.2012.2199121, 2013. a
Fujiyoshi, Y., Endoh, T., Yamada, T., Tsuboki, K., Tachibana, Y., and Wakahama, G.: Determination of a Z-R Relationship for Snowfall Using a Radar and High Sensitivity Snow Gauges, J. Appl. Meteorol. Clim., 29, 147–152, https://doi.org/10.1175/1520-0450(1990)029<0147:DOARFS>2.0.CO;2, 1990. a
Ganetis, S. A., Colle, B. A., Yuter, S. E., and Hoban, N. P.: Environmental Conditions Associated with Observed Snowband Structures within Northeast U.S. Winter Storms, Mon. Weather Rev., 146, 3675–3690, https://doi.org/10.1175/MWR-D-18-0054.1, 2018. a, b, c, d, e, f, g
Helmus, J. J. and Collis, S. M.: The Python ARM Radar Toolkit (Py-ART), a Library for Working with Weather Radar Data in the Python Programming Language, Journal of Open Research Software, 4, e25, https://doi.org/10.5334/jors.119, 2016 (code available at: https://arm-doe.github.io/pyart/API/generated/pyart.retrieve.feature_detection.html, last access: 27 November 2023). a, b, c
Jamil, N., Sembok, T. M. T., and Bakar, Z. A.: Noise Removal and Enhancement of Binary Images Using Morphological Operations, in: 2008 International Symposium on Information Technology, Kuala Lumpur, Malaysia, 26–28 August 2008, IEEE, 4, 1–6, https://doi.org/10.1109/ITSIM.2008.4631954, 2008. a
Kenyon, J. S., Keyser, D., Bosart, L. F., and Evans, M. S.: The Motion of Mesoscale Snowbands in Northeast U.S. Winter Storms, Weather Forecast., 35, 83–105, https://doi.org/10.1175/WAF-D-19-0038.1, 2020. a, b, c
Lackmann, G. M. and Thompson, G.: Hydrometeor Lofting and Mesoscale Snowbands, Mon. Weather Rev., 147, 3879–3899, https://doi.org/10.1175/MWR-D-19-0036.1, 2019. a
Machado, L. A. T. and Rossow, W. B.: Structural Characteristics and Radiative Properties of Tropical Cloud Clusters, Mon. Weather Rev., 121, 3234–3260, https://doi.org/10.1175/1520-0493(1993)121<3234:SCARPO>2.0.CO;2, 1993. a
Matrosov, S. Y., Clark, K. A., and Kingsmill, D. E.: A Polarimetric Radar Approach to Identify Rain, Melting-Layer, and Snow Regions for Applying Corrections to Vertical Profiles of Reflectivity, J. Appl. Meteorol. Clim., 46, 154–166, https://doi.org/10.1175/JAM2508.1, 2007. a
McMurdie, L. A., Heymsfield, G. M., Yorks, J. E., Braun, S. A., Skofronick-Jackson, G., Rauber, R. M., Yuter, S., Colle, B., McFarquhar, G. M., Poellot, M., Novak, D. R., Lang, T. J., Kroodsma, R., McLinden, M., Oue, M., Kollias, P., Kumjian, M. R., Greybush, S. J., Heymsfield, A. J., Finlon, J. A., McDonald, V. L., and Nicholls, S.: Chasing Snowstorms: The Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS) Campaign, B. Am. Meteorol. Soc., 103, E1243–E1269, https://doi.org/10.1175/BAMS-D-20-0246.1, 2022. a
Novak, D. R., Bosart, L. F., Keyser, D., and Waldstreicher, J. S.: An Observational Study of Cold Season–Banded Precipitation in Northeast U.S. Cyclones, Weather Forecast., 19, 993–1010, https://doi.org/10.1175/815.1, 2004. a, b, c
Picca, J. C., Schultz, D. M., Colle, B. A., Ganetis, S., Novak, D. R., and Sienkiewicz, M. J.: The Value of Dual-Polarization Radar in Diagnosing the Complex Microphysical Evolution of an Intense Snowband, B. Am. Meteorol. Soc., 95, 1825–1834, https://doi.org/10.1175/BAMS-D-13-00258.1, 2014. a, b
Powell, S. W., Houze, R. A., and Brodzik, S. R.: Rainfall-Type Categorization of Radar Echoes Using Polar Coordinate Reflectivity Data, J. Atmos. Ocean. Tech., 33, 523–538, https://doi.org/10.1175/JTECH-D-15-0135.1, 2016. a
Radford, J. T., Lackmann, G. M., and Baxter, M. A.: An Evaluation of Snowband Predictability in the High-Resolution Rapid Refresh, Weather Forecast., 34, 1477–1494, https://doi.org/10.1175/WAF-D-19-0089.1, 2019. a
Rasmussen, R., Dixon, M., Vasiloff, S., Hage, F., Knight, S., Vivekanandan, J., and Xu, M.: Snow Nowcasting Using a Real-Time Correlation of Radar Reflectivity with Snow Gauge Accumulation, J. Appl. Meteorol. Clim., 42, 20–36, https://doi.org/10.1175/1520-0450(2003)042<0020:SNUART>2.0.CO;2, 2003. a, b, c, d, e
Rinehart, R. E.: Radar for Meteorologists, 4th edn., Rinehart, Columbia, Mo, ISBN-10: 0965800210, ISBN-13: 978-0965800211, 2004. a
Saltikoff, E., Huuskonen, A., Hohti, H., Koistinen, J., and Järvinen, H.: Quality Assurance in the FMI Doppler Weather Radar Network, Boreal Environ. Res., 15, 579–594, 2010. a
Schiffer, R. A. and Rossow, W. B.: The International Satellite Cloud Climatology Project (ISCCP): The First Project of the World Climate Research Programme, B. Am. Meteorol. Soc., 64, 779–784, https://doi.org/10.1175/1520-0477-64.7.779, 1983. a
Steiner, M., Houze, R. A., and Yuter, S. E.: Climatological Characterization of Three-Dimensional Storm Structure from Operational Radar and Rain Gauge Data, J. Appl. Meteorol. Clim., 34, 1978–2007, https://doi.org/10.1175/1520-0450(1995)034<1978:CCOTDS>2.0.CO;2, 1995. a, b, c, d
Tomkins, L.: 07 February 2021 feature detection example, TIB AV-Portal [video], https://doi.org/10.5446/63170, 2023a. a
Tomkins, L.: 17 December 2019 feature detection example, TIB AV-Portal [video], https://doi.org/10.5446/63172, 2023b. a
Tomkins, L.: 17 December 2020 feature detection example, TIB AV-Portal [video], https://doi.org/10.5446/63171, 2023c. a
Tomkins, L.: 7 February 2020 feature detection example, TIB AV-Portal [video], https://doi.org/10.5446/63168, 2023d. a
Tomkins, L.: Supplemental videos for the paper “Dual adaptive differential threshold method for automated detection of faint and strong echo features in radar observations of winter storms”, TIB AV-Portal, https://av.tib.eu/series/1524/ (last access: 1 December 2023), 2023e. a
Tomkins, L., Yuter, S., Miller, M., Corbin, N., and Hoban, N.: Northeast US Regional NEXRAD Radar Mosaics of Winter Storms from 1996–2023, Part 1, Dryad [data set], https://doi.org/10.5061/dryad.zcrjdfnk6, 2023a. a
Tomkins, L., Yuter, S., Miller, M., Corbin, N., and Hoban, N.: Northeast US Regional NEXRAD Radar Mosaics of Winter Storms from 1996–2023, Part 2, Dryad [data set], https://doi.org/10.5061/dryad.rbnzs7hj9, 2023b. a, b
Tomkins, L. M., Yuter, S. E., Miller, M. A., and Allen, L. R.: Image muting of mixed precipitation to improve identification of regions of heavy snow in radar data, Atmos. Meas. Tech., 15, 5515–5525, https://doi.org/10.5194/amt-15-5515-2022, 2022. a, b, c, d, e, f, g, h
Woodman, M.: Yourdon Dataflow Diagrams: A Tool for Disciplined Requirements Analysis, Inform. Software Tech., 30, 515–533, https://doi.org/10.1016/0950-5849(88)90131-0, 1988. a
Yuter, S. E. and Houze, R. A.: Measurements of Raindrop Size Distributions over the Pacific Warm Pool and Implications for Z–R Relations, J. Appl. Meteorol. Clim., 36, 847–867, https://doi.org/10.1175/1520-0450(1997)036<0847:MORSDO>2.0.CO;2, 1997. a, b
Yuter, S. E., Houze, R. A., Smith, E. A., Wilheit, T. T., and Zipser, E.: Physical Characterization of Tropical Oceanic Convection Observed in KWAJEX, J. Appl. Meteorol. Clim., 44, 385–415, https://doi.org/10.1175/JAM2206.1, 2005. a, b, c, d