Articles | Volume 15, issue 19
https://doi.org/10.5194/amt-15-5821-2022
https://doi.org/10.5194/amt-15-5821-2022
Research article
 | 
14 Oct 2022
Research article |  | 14 Oct 2022

Machine learning-based prediction of Alpine foehn events using GNSS troposphere products: first results for Altdorf, Switzerland

Matthias Aichinger-Rosenberger, Elmar Brockmann, Laura Crocetti, Benedikt Soja, and Gregor Moeller
Abstract

Remote sensing of water vapour using the Global Navigation Satellite System (GNSS) is a well-established technique and reliable data source for numerical weather prediction (NWP). However, one of the phenomena rarely studied using GNSS are foehn winds. Since foehn winds are associated with significant humidity gradients between two sides of a mountain range, tropospheric estimates from GNSS are also affected by their occurrence. Time series reveal characteristic features like distinctive minima and maxima as well as a significant decrease in the correlation between the stations. However, detecting such signals becomes increasingly difficult for large datasets. Therefore, we suggest the application of machine learning algorithms for the detection and prediction of foehn events by means of GNSS troposphere products. This initial study develops a new, machine learning-based method for detection and prediction of foehn events at the Swiss station Altdorf by utilising long-term time series of high-quality GNSS troposphere products. Data from the Automated GNSS Network Switzerland (AGNES) and various GNSS sites from neighbouring countries as well as records of an operational foehn index are used to investigate the performance of several different classification algorithms based on appropriate statistical metrics. The two best-performing algorithms are fine tuned and tested in four dedicated experiments using different feature setups. The results are promising, especially when reprocessed GNSS products are utilised and the most dense station setup is used. Detection- and alarm-based measures reach levels between 66 %–80 % for both tested algorithms and thus are comparable to those from studies using data from meteorological stations and NWP. For operational prediction, limitations due to the availability and quality of GNSS products in near-real time (NRT) exist. However, they might be mitigated to a significant extent by provision of additional NRT products and improved data processing in the future. Results also outline benefits for the results when including geographically relevant stations (e.g. high-altitude stations) in the utilised datasets.

Dates
1 Introduction

Global Navigation Satellite Systems (GNSS) are used extensively for positioning and navigation applications worldwide. Additionally, they enable users to retrieve information about the state of the earth's atmosphere, particularly the distribution of water vapour. This technique, commonly referred to as GNSS meteorology, was first proposed three decades ago (Bevis et al.1992) and is still gaining increasing interest from the scientific community as well as from meteorological institutions. The retrieval of atmospheric information from GNSS is based on the fact that electromagnetic signals (such as GNSS signals) are delayed when travelling through specific layers of the atmosphere. The delay experienced by a GNSS signal in the lowest part of the atmosphere (troposphere) is proportional to the water vapour content along the signal path. This fact is typically exploited in GNSS meteorology by introducing GNSS-derived atmospheric parameters like the zenith wet delay (ZWD) or the zenith total delay (ZTD) in data assimilation schemes. In numerous studies, a positive impact has been demonstrated, especially on precipitation forecasts (see e.g. de Haan2008; Brenot et al.2013; Bennitt and Jupp2012; Yan et al.2009). However, while mostly precipitation-related studies represent the current focus of research (see Guerova et al.2016 for a comprehensive summary), other meteorological phenomena can also be investigated by means of GNSS. The number of studies on other meteorological processes is relatively small, covering phenomena such as thunderstorm activity (de Haan2013) or fog formation (Stoycheva and Guerova2015; Aichinger-Rosenberger2018). To our knowledge, Stoev and Guerova (2018) represent the only investigation of foehn winds using GNSS products in an initial study for Bulgaria based on observations of integrated water vapour (IWV).

Foehn winds are a characteristic weather phenomenon in mountainous regions all over the world, especially in the vicinity of prominent mountain ranges like the Alps (where it is typically referred to as Alpine foehn). In general, foehn can be characterised as “a wind (which is) warmed and dried by descent, in general on the lee side of a mountain” (WMO1992). This definition already includes the major characteristics observed in affected areas: strong and gusty winds, increasing temperatures, and decreasing humidity. While there are many other effects of foehn winds (from social to economic impacts), large wind speeds and gusts are the most critical features from the perspective of operational forecasting and warning systems. In typical foehn valleys like the Reuss Valley (Switzerland) or the Wipp Valley (Austria), wind speeds up to 100 km h−1 are common; gusts up to 200 km h−1 can even be observed at high altitude stations.

Foehn research denotes one of the major topics of (alpine) mountain meteorology (Steinacker2006). Despite the fact that the underlying physical processes of foehn have been studied for over a century, still some gaps in knowledge, especially concerning small-scale features, exist. As the classical thermodynamic foehn theory is not able to sufficiently explain all observed foehn events (especially those lacking precipitation), a number of different theories and extensions have been proposed. Furthermore, large observation campaigns like the Mesoscale Alpine Programme (MAP) have been conducted and combined with NWP results in order to assess small-scale effects (Gohm and Mayr2004; Lothon et al.2006; Drobinski et al.2007; Mayr et al.2007).

Despite these substantial efforts in research, both the classification and forecasting of foehn are still challenging tasks. Classification by human expertise still provides the most accurate results, as dedicated experiments comparing subjective and objective methods reveal (Mayr et al.2018). The ability of NWP models to predict foehn is limited by the fact that small-scale features still cannot be modelled with sufficient accuracy due to coarse representation of real-world topography (Wilhelm2012).

Machine learning (ML) techniques have been a major research topic in atmospheric sciences over the last decade. ML-based approaches of post-processing NWP output, known as model output statistics (MOS), have been shown to significantly enhance operational weather forecasts – see, e.g. Glahn and Lowry (1972), Wilks and Hamill (2007), or Hess (2020). ML has also been used to assign uncertainty estimates to forecasts based on deep learning methods applied to previous forecasts (Scher and Messori2018). Furthermore, the classification and detection of different weather types has been advanced and automated for different kinds of weather phenomena, such as thunderstorms (Perler and Marchand2009; Manzato2005), temperature forecasts (Yalavarthi and Shashi2009), wind systems (Kretzschmar et al.2004; Otero and Araneo2021), or large-scale weather regimes in general (Deloncle et al.2007). Common ML methods for such classification problems investigated in former studies are

Only a few authors have used ML approaches for the detection and prediction of Alpine foehn yet. Initial studies were carried out by Sprenger et al. (2017), who applied the AdaBoost algorithm to a dataset combining weather station observations with NWP output fields from the Consortium for Small-scale Modelling (COSMO) model. They found good performance of the algorithm, obtaining high values for the probability of detecting foehn events (88 %) and the ratio for correct alarms of the algorithm (66 %). The most recent study by Mony et al. (2021) showed the feasibility of using ERA5 reanalysis and climate model output instead of NWP output, in a similar way to Sprenger et al. (2017). In addition, statistical mixture models were also applied for foehn diagnosis, e.g. by Plavcan et al. (2014).

The presented study represents an initial investigation on the usability of GNSS troposphere product time series for the detection and prediction of foehn events at the meteorological observation site Altdorf, Switzerland. Therefore we make use of state-of-the-art ML-based classification algorithms trained and tested on a dataset spanning 11 years (2010–2020), derived from GNSS observations at sites all over Switzerland and neighbouring countries as well as from a long-term record of foehn observations at Altdorf.

Although foehn diagnosis might be characterised as an unsupervised learning problem (no universal truth exists, and even forecasts from human experts vary considerably; Mayr et al.2018), we apply supervised learning methods in this initial study. This choice is motivated by the fact that reference data of proven quality are available (see Sect. 3.1.2 for details), results are easier to interpret, and our only reference study by Sprenger et al. (2017) also uses this approach. On the other hand, unsupervised learning is typically used to cluster data in order to discover something that is not visible otherwise. For our investigation, it is doubtful that a clear cluster solely corresponding to foehn events would emerge considering the highly imbalanced dataset and the multitude of phenomena affecting GNSS tropospheric delays.

The average performance of different ML algorithms is assessed via a cross-validation procedure. The two best-performing algorithms are trained over an eight-year period and tested over a two-year period for different study setups (feature setups). These feature setups cover the usage of reprocessed troposphere products as well as NRT products, which could be used for operational prediction and detection of foehn events. Furthermore, we explore the performance of an extended station network, with the disadvantage of a shorter period of availability for algorithm training. Finally, we analyse the performance of our newly developed method in detail over a week-long period, covering two major foehn events at Altdorf.

2 GNSS meteorology

As already outlined in the introduction, the concept of GNSS meteorology is based on the fact that electromagnetic signals are delayed by the presence of the earth's atmosphere. The signal delay is directly proportional to the refractive index n of the atmosphere. In the neutral atmosphere, the refractive index or refractivity N is composed of a dry part (Nd) and wet part (Nw), which depend on temperature T (K) as well as the dry Pd (hPa) and water vapour partial pressure e (hPa), respectively (Rüeger2002):

(1) N = ( n - 1 ) × 10 6 = N d + N w = 77.6890 P d T + 71.2952 e T + 3.75463 × 10 5 e T 2 .

The total tropospheric delay experienced by a GNSS signal observed at an elevation (el) and azimuth direction a is referred to as the slant total delay (STD):

(2) STD ( a , el ) = ZHD mf h ( el ) + ZWD mf w ( el ) + mf g ( el ) GN cos ( a ) + GE sin ( a ) ,

where ZHD (zenith hydrostatic delay) represents the hydrostatic part, and ZWD the wet part of the signal delay in the zenith direction. In addition, horizontal gradients GN (north–south direction) and GE (east–west direction), accounting for the asymmetry of the atmospheric layers passed by the signal, can be estimated in GNSS processing. In order to map the delays and gradients estimated for the zenith direction to the correct elevation, mapping functions for both parts of the delay (mfh(el),mfw(el)) and the gradients (mfg(el)) are used.

The total delay in the zenith direction, i.e. the zenith total delay (ZTD), is the sum of the hydrostatic and wet part:

(3) ZTD = ZHD + ZWD .

ZHD accounts for the major part of the total delay and is largely determined by the atmospheric pressure. It can be modelled with sufficient accuracy from surface pressure observations using, e.g. the formula of Saastamoinen (Saastamoinen1972):

(4) ZHD = 0.0022767 p s 1 - 0.00266 cos ( 2 θ ) - 0.00028 H ,

where ps is the surface pressure, θ the station latitude, and H is the station height above the geoid.

ZWD represents the main signal of interest for meteorological purposes, as it is directly related to the water vapour content in the air column above the GNSS receiver, and therefore to IWV, via

(5) IWV = κ ( T m ) ZWD ,

where κ denotes a semi-empirical function depending on the integrated mean temperature Tm. Thus, it shows the same high temporal and spatial variability as water vapour, making precise modelling from meteorological surface observations practically impossible. As a consequence, ZWD is commonly estimated as an unknown in GNSS parameter estimation alongside station coordinates and the receiver clock error.

2.1 Influence of hydrometeors on GNSS signal delays

Since foehn events can occur with and without simultaneous precipitation, the influence of hydrometeor formation on GNSS signal delays should also be described in the following. In an initial investigation over two decades ago, Solheim et al. (1999) quantified propagation delays induced in GPS signals by different types of molecular constituents, such as dry air, water vapour, hydrometeors, and sand particles. They were able to show that the influence of water in both solid and liquid form on GNSS signals is significantly smaller than for its gaseous form (water vapour). However, in cases of extreme amounts of precipitation (especially in liquid form, i.e. extreme amounts of rain in very intense thunderstorms), a considerable influence for high-precision applications (as troposphere estimation) can be expected. In the framework of this study, we do not expect such severe events occurring with foehn events. Nevertheless, these events might lead to problems for our classification method (misclassification through degraded GNSS products due to high hydrometeor influence), especially in the summer months.

3 Methodology

3.1 Data

3.1.1 GNSS station network and tropospheric products

All investigations presented in this study are based on GNSS troposphere products from the Automated GNSS Network Switzerland (AGNES). The AGNES network, which currently consists of 31 GNSS stations, was established in 2001 and is maintained by the Swiss Federal Office of Topography (swisstopo) (Brockmann et al.2002). The capabilities of the network were extended to multi-GNSS in 2015 (Brockmann2016).

Reprocessed, long-term time series of hourly tropospheric delays and gradients, available for the period 2010–2020, are used in this study. A description of the dataset as well as details on the reprocessing of GNSS data can be found in e.g. Brockmann (2015). Parts of this reprocessing were carried out in the framework of the second EUREF (International Association of Geodesy Reference Frame Sub-Commission for Europe) Permanent Network (EPN) reprocessing campaign in 2014, where GNSS data from a large number of European stations were reprocessed (Pacione et al.2017). Therefore, some interesting stations (from neighbouring countries such as Italy and Austria) are also available and incorporated. More details on the actual selection of GNSS stations utilised for different experiments are given in Sect. 3.2. For this study, we use hourly GNSS troposphere products originating from reprocessing campaigns as well as operational NRT processing. The delay products are estimated every hour from 30 s measurements together with station coordinates (in this case using least-squares adjustment). Gradient products are typically estimated only every 12 h and hourly values in between results from linear interpolation and extrapolation.

3.1.2 Foehn observations at Altdorf

In order to train a specific ML algorithm and evaluate its performance, a reference dataset of foehn observations is needed as the target variable. This study uses time series of 10 min estimates of foehn index (FI) calculated at the station Altdorf, following the approach presented by Dürr (2008). Altdorf is located at the exit of the Reuss Valley, between the Gotthard pass and the Lake Lucerne, at a height of 449 m above mean sea level (a.m.s.l.). The station has the longest time series of foehn observations in the Alps (spanning over 150 years of total observations), and FI data is provided back to 1981 for 10 min intervals. It is also part of the National Meteorological Ground-level Monitoring Network (SwissMetNet, SMN) operated by MeteoSwiss. Currently, data not only from Altdorf but from about 10 sites frequently experiencing foehn winds are available on an operational level. The FI introduced by Dürr (2008) is designed for operational nowcasting and relies on typical foehn predictors such as wind speed and direction, pressure and temperature gradients, and humidity observations at the respective measurement site and surrounding stations. It returns three different integer values: 0 (no foehn), 1 (foehn-mixed air), and 2 (foehn), which are distinguished based on the predictors mentioned above. In an extensive validation against classifications by human experts, the index showed good performance for indices re-calculated back to 1981 (Gutermann et al.2012). For a detailed description of the calculation algorithm, we refer to Dürr (2008) and Gutermann et al. (2012). As we aim for a binary classification (no foehn or foehn), the cases of FI = 1 are treated as non-foehn events and therefore mapped to value 0. Furthermore, we map the cases of foehn (FI = 2) to the value 1 for the sake of simplicity in all results shown in the following. Then, each hour in the whole dataset where at least one 10 min value indicates foehn is treated as an hour of foehn appearance and thus a foehn event.

3.2 GNSS station selection criteria

The final selection of GNSS stations, whose data we use as input features, is a difficult task for a number of reasons. The following list gives an overview of the main problems to keep in mind:

  • Not every GNSS station provides a continuous dataset of troposphere products. In fact, almost all of the available stations have data gaps over the chosen study period (2010–2020), and a large number of stations were only established after 2010.

  • The ML-based detection and prediction can only be applied for foehn events where troposphere products from all selected GNSS stations (i.e. all features or predictors) are available. Since not all GNSS stations have data gaps at the same periods, the actual amount of possibly missed events can add up.

In order to document and cope with these challenges, we calculated detailed statistics for data availability for each station or feature setup used within this study, which are given in the respective result sections. Using these statistics, we try to balance the need to incorporate important stations (e.g. because of their geographic location) and still cover a sufficient amount of foehn events (for both training purposes and performance assessment). In the following, we therefore introduce the rules for the selection of GNSS stations applied in this study:

  • Selected stations need to be relevant for the foehn classification in terms of their geographical location. Based on previous studies, we define an area of interest with latitude and longitude borders of [44.9, 48.2] and [5.9, 10.75], respectively.

  • Time series from a selected station (of all troposphere products used) should cover at least 95 % of all foehn events (hours of FI = 1) in the study period (2010–2020).

  • The overall feature setup (GNSS stations and available products) should be available for at least 50 % of all foehn events in the study period.

3.3 Feature selection from GNSS time series

The selection of features from GNSS troposphere time series is based on previous investigations on visual detection from time series of different parameters as well as on obvious choices that are expected to be impacted most by foehn conditions. Two obvious choices are visualised for December 2019 in Fig. 1, namely ZWD at stations north (KALT, shown in blue) and south (LOMO, shown in red) of the Alpine ridge and its difference (bottom section, shown in black). In addition, foehn events at Altdorf are shown as colour-coded periods (orange). Strong correlation between the contrary trends in ZWD at the two stations and the onset of foehn in Altdorf can be observed. Furthermore, the difference in ZWD between the stations reaches minima in the two extended foehn periods observed (∼15–18 and 19–21 December 2019). These time series give a first impression how (and from which parameters) foehn events can be detected using GNSS datasets. As this becomes a very demanding task for longer periods (both visually and analytically), ML techniques are a promising tool to extend and automate such a detection process, with the additional benefit of possibly providing the ability to also predict upcoming events.

https://amt.copernicus.org/articles/15/5821/2022/amt-15-5821-2022-f01

Figure 1Time series of promising foehn predictors for December 2019. (a): ZWD (12 h moving-averaged for visualisation) from stations KALT (north of Alpine ridge, blue) and LOMO (south of Alpine ridge, red), (b): ZWD difference between KALT and LOMO (black). Observed foehn events at Altdorf (based on FI) are visualised as orange areas.

Download

3.4 Default study setup

In the following, the default feature setup for the algorithm comparison (cross-validation) and the first (reference) experiment is introduced. In general, the definition of a specific setup concerns the following points:

  • GNSS station network. The selection of GNSS stations, from which data is utilised for training and testing the ML algorithms used, should be compliant with the criteria outlined in Sect. 3.2.

  • Study period. In combination with the chosen station selection, a sufficient time period must be chosen to match the criteria outlined in Sect. 3.2.

  • Features. This point defines which troposphere products should (or could) be used for this specific setup.

The detailed setup and statistics of data availability for the cross-validation and the first feature setup (FS1) are given in Table 1. It includes ZWD (absolute values and all possible differences between stations) and gradient products (GN and GE) as well as a selection of four ZHD differences, which are representative differences between north–south stations in the network. Tests have also been conducted using all possible differences in ZHD (as for ZWD), but no improvement was found using this setup. This might be explained by the fact that ZHD is largely dependent on pressure, which typically does not show such small-scale variations as water vapour (and thus ZWD). Therefore, a small number of ZHD differences (i.e. pressure differences) across the Alpine ridge might be sufficient.

Table 1Default setup used for the cross-validation and feature setup 1 (FS1). For features not outlined in a specific row, by default, all stations and combinations of stations are used.

Download Print Version | Download XLSX

Figure 2 provides a visualisation of the full station network utilised in this study. The different coloured triangles represent different station setups for the feature setups introduced later (red triangles represent stations used in the default setup; blue triangles represent stations that are added for the third feature setup). In addition, a complete list of utilised stations (including geographical coordinates) can be found in the Appendix A.

https://amt.copernicus.org/articles/15/5821/2022/amt-15-5821-2022-f02

Figure 2GNSS station network utilised for this study. Stations included in the default setup (cross-validation and all feature setups) are marked as red triangles. Stations explicitly used in feature setup 3 (FS3) are marked as blue triangles. The SMN station Altdorf is marked with a yellow star. In addition, the black lines represent the ZWD differences between stations, which serve as the top predictors in FS3, shown in Sect. 4.3.

3.5 Data preparation

One of the main challenges for ML-based classification algorithms are imbalanced datasets. This imbalance is also strongly present in datasets of foehn observations, since foehn is a rather rare meteorological phenomenon. For the utilised FI dataset, the average foehn probability over the 11 year period (2010–2020) amounts to only ∼4 %. Thus, the ratio of under-representation of the minority class (foehn event) compared to the majority class (no foehn event) is as large as 1:25.

3.5.1 Oversampling

A common approach to overcome problems originating from a high imbalance in a dataset is to oversample the minority class for the training dataset. One possible approach to achieve this is the Synthetic Minority Over-sampling Technique (SMOTE) (Chawla et al.2002), which we use in this study. The technique creates new (synthetic) instances of the minority class within the training data. For this study, an oversampling of observed foehn hours in the training dataset by 25 % was conducted using SMOTE, which improves the performance of the applied algorithms by about 20 %. The value of 25 % oversampling was chosen to achieve a reasonable balance between the advantage of having more usable training events (larger percentage of oversampling) and the fact that foehn is still a rather rare phenomenon (therefore also rare in possible test datasets). All results shown in the following sections are based on pre-processing using this approach.

3.5.2 Shifting of FI time series

In order to assess the suitability of the GNSS troposphere products for operational prediction, a time shift of one hour is applied to the target vector (i.e. FI time series at Altdorf). As operational usage is considered a future goal of the proposed method, the shift is applied for all feature setups investigated in this study (also those using post-processed GNSS products). Therefore, each prediction of a foehn event is based on GNSS observations collected one hour before a possible onset of foehn at Altdorf.

3.6 Performance metrics

As already outlined in the last section, the imbalance in datasets of foehn observations is a major obstacle for the application of ML algorithms and the assessment of their performance. For highly imbalanced data, performance metrics typically used in ML studies might not be representative; therefore, other options have to be explored. In the case of the present dataset, a typical performance measure such as precision alone would not be suitable, as it simply compares detected or predicted foehn hours with the observed data for all time steps. Thus, it might happen that an algorithm with optimal precision predicts (almost) no foehn events at all, since this will still result in an optimal performance with regards to precision. In order to overcome these issues, we adapt the same performance metrics (see e.g. Barnes et al.2007) as used in Sprenger et al. (2017). These can be formulated as conditional probabilities P(|) and calculated using the so-called confusion matrix. The matrix reports the number of false negatives (FNs), false positives (FPs), true negatives (TNs), and true positives (TPs) and thus allows for the calculation of common performance measures in ML, such as precision or recall.

The measures used in this study can be separated into detection-based metrics:

  • probability of detection (POD) = P (predicted | observed)

  • probability of false detection (POFD) = P (predicted | not observed)

  • missing rate (MR) = P (not predicted | observed)

and alarm-based metrics:

  • correct alarm ratio (CAR) = P (observed | predicted)

  • false alarm ratio (FAR) = P (not observed | predicted)

  • missing alarm rate (MAR) = P (observed | not predicted).

As already visible from the formulations above, POD and CAR are directly connected to each other via the Bayes Theorem. This also implies that there is always a trade-off between those two parameters, and therefore, only one of them can be optimised while decreasing the respective other one. Which metric should be optimised strongly depends on the actual application, as already outlined by Sprenger et al. (2017), who argued that alarm-based measures might be more relevant from a forecaster's perspective.

In addition, we adopt two measures that represent a kind of mean performance in terms of both CAR and POD for describing the results presented in the next sections. The first one is just the simple average of those two parameters combined, therefore referred to as COMB in the following:

(6) COMB = POD + CAR 2 .

The second adopted metric is based on the F-beta score Fβ (Baeza-Yates and Ribeiro-Neto1999), which can also be formulated using the confusion matrix. Using precision and recall measures, the Fβ score can be computed for varying β:

(7) F β = ( 1 + β 2 ) precision recall ( β 2 precision ) + recall .

The classical F-beta score (F1, using β=1) represents the weighted harmonic mean of precision and recall, with a range between 0 (worst case) and 1 (optimal value). As already discussed above, a precision measure might not be representative for results of this study, as this might result in our algorithm predicting no foehn events at all. Thus, we use the F2 score (beta = 2), which weights the recall measure two times larger than precision measure, instead of F1 in order to put more emphasis on the recall, i.e. on the detection of all foehn events:

(8) F 2 = 5 precision recall ( 4 precision ) + recall .

3.7 Algorithm selection and tuning

This section gives an overview on tested algorithms and the process of algorithm selection using a cross-validation approach. Details on this approach are given in the following Sect. 3.7.1. Furthermore Sect. 3.7.2 presents the means as to how the chosen algorithms are optimised via a grid search procedure.

3.7.1 Machine learning algorithms

In the course of this study, several different ML algorithms are tested in order to investigate their usability for this specific problem and to compare their performance relative to each other. The following algorithms, which have already been applied for classification of foehn or other meteorological phenomena (as listed in the introduction), are tested:

As a detailed discussion of all algorithms would go beyond the scope of this study, we focus on the chosen ones at the end of this section. For a comprehensive overview of all of them, we refer to Hsieh (2009).

Before carrying out experiments using a specific ML algorithm, the most promising one(s) have to be identified from the list of algorithms given above. Therefore, a cross-validation over the training dataset (2010–2018) was performed and evaluated using the performance metrics introduced in Sect. 3.6. For the cross-validation, single years of data are iteratively taken out of the training dataset, serving as validation data in order to assess the performance of the outlined algorithms. This is repeated until every year serves once as validation dataset. The actual implementation is carried out using the Python package scikit-learn (version 1.1.2) (Pedregosa et al.2011). For these cross-validation runs, the default settings from the algorithm routines are used in order to get an objective, initial picture of their performance for this problem. More sophisticated approaches, like including more (complex) algorithms or running grid searches for each algorithm separately before the comparison, were not followed due to the “proof-of-concept” focus of the study. However, these approaches might be used in future studies on this topic in order to optimise the overall performance (see also the future ideas described in the outlook (Sect. 6)).

Resulting statistics of the cross-validation are summarised in Table 2. These results indicate best performance for the SVC algorithm in terms of combined measures (COMB and F2 score). For detection-based measures (POD), the KNN algorithm achieves the highest value on average but falls short in terms of CAR and POFD. The same holds for the RF algorithm in terms of alarm-based measures (CAR), but its detection-based performance is significantly degraded compared to, e.g. SVC. Ultimately, we decided to use the GB and SVC algorithms for evaluation in the feature setup experiments, as these are the only ones providing average combined measures of over 70 % (see Table 2).

Table 2Averaged performance metrics of the cross-validation for all tested algorithms over the nine year training period 2010–2018.

Download Print Version | Download XLSX

Based on the results of the cross-validation, the GB and SVC algorithm are chosen for the experiments shown in Sects. 4 and 5. In the following, we give a brief introduction of those two algorithms.

  1. Gradient Boosting (GB). Introduced by Friedman (2001), GB represents a technique of ensemble learning. It builds a prediction model by an additive combination of weak learners. Typically, decision trees, which are built sequentially in an iterative manner, are used. GB represents a supervised model that can deal with both classification and regression problems. The main hyperparameters of the algorithm (tuned in the next section) are:

    • n_estimators: number of boosting stages to perform

    • max_depth: maximum depth of the individual regression estimators that limits the number of nodes in the tree

    • learning_rate: limits the contribution of each tree.

  2. Support Vector Classifier (SVC). The SVC (Platt1999) also denotes a supervised model that classifies samples by searching for the best hyperplane separating data points of one class from those of the other class. The basic version of SVC is a linear classifier, finding the best linear separation between two classes. In order to solve non-linear problems, one can make use of the kernel formulation, which uses a radial basis function (RBF) in our study. Through the combination of several binary classifiers, binary problems can be extended to multiclass classification.

    The main hyperparameters for SVC are:

    • C: regularisation parameter

    • gamma: represents the kernel coefficient

    • kernel: kernel type to be used in the algorithm, set to radial basis function (RBF) in this study.

3.7.2 Hyperparameter tuning

In order to optimise the performance of the chosen algorithms, dedicated tuning of their hyperparameters is carried out. Therefore, a (small-scale) grid search procedure is conducted, which is an exhaustive search over a subset of manually selected values. The performance of all hyperparameter value combinations is evaluated based on a three-fold cross-validation. Therefore, the training dataset (2010–2018) is randomly divided into three folds, where two thirds are used for training while the last third serves for validation. This procedure is repeated three times until each third is used once for validation. All tested hyperparameter values as well as the best performing value combinations are summarised in Table 3.

Table 3Tuned hyperparameters of both algorithms with their best, tested and default values.

Download Print Version | Download XLSX

We waive to do a more intensive grid search procedure for reasons already mentioned in the cross-validation section (“proof-of-concept” study), although we plan to optimise the performance of the method through this in future studies.

4 Results: feature setup experiments

As the major performance test of the proposed method, four experiments are performed. Within these experiments, different setups regarding utilised GNSS stations and tropospheric parameters in the feature matrix are investigated.

4.1 Feature setup 1: reprocessed products

Feature setup 1 (FS1) investigates the performance of the chosen algorithms for an optimal combination of the largest station network and longest study period, still compliant to the selection criteria from Sect. 3.2. For this setup, the reprocessed time series of GNSS troposphere products are used; thus, tropospheric gradients can also be utilised.

Resulting statistics for FS1 from both algorithms are given in Table 4. Both algorithms show a promising performance, which, on average, is comparable to the results reported by Sprenger et al. (2017). For the GB algorithm, POD values significantly (13 %) lower than for the reference study are balanced by a  10 % improvement in CAR. The SVC algorithm tends to predict more events (higher POD) and therefore also produces more false alarms (higher POFD, lower CAR), somewhat similar to the AdaBoost algorithm of Sprenger et al. (2017). Combined measures (COMB and F2) indicate very similar overall performance for both tested algorithms, with GB having the advantage of more balanced (almost equal) values for detection- and alarm-based measures. Furthermore, the actual probability of foehn events predicted by both algorithms over the test period (3.7 % and 4 %) lies within 1 percentage point of the actual observed probability (4.7 %) for all events where GNSS-based results could be generated.

Table 4Performance metrics for the proposed models using post-processed troposphere products and the full feature setup (as shown in Table 1).

Download Print Version | Download XLSX

Table 5 provides the confusion matrix statistics of the GB and SVC algorithm for all setups investigated in this study. The uppermost two lines provide the values of TN, FP, FN, and TP for FS1. First of all, the results show the large imbalance of the classification problem, with TN values being approximately 30 times larger than TP values. Furthermore, it can be seen that SVC produces a significantly larger amount of FP values (false alarms), which is also reflected in the statistics given in Table 4. On the other hand, it also misses less events compared to the GB algorithm, resulting in a lower number of FNs and thus lower MAR. GB shows an approximately equal number of FP and FN values, but providing more TN values than SVC.

In addition to the statistics provided in Tables 4 and 5, Fig. 3 shows observed (red) and predicted (orange = GB and blue = SVC) foehn events for FS1 (top left corner) as well as the results for all other FS experiments. It should be noted that all observed events are shown, including those where no GNSS data are available and thus no prediction could be made. This fact also has to be kept in mind when looking at the results in Table 4, otherwise they might look too optimistic. Nevertheless, some overall conclusions, such as SVC predicting more events than GB (higher POD but lower CAR), are still visible from Fig. 3.

https://amt.copernicus.org/articles/15/5821/2022/amt-15-5821-2022-f03

Figure 3Time series of observed (red, FI) and predicted (orange = GB, blue = SVC) foehn events (FI == 1) for all FS experiments and their respective time periods (2019–2020 or 2019). Note that all observed foehn events are shown here, including those for which no prediction could be made due to missing GNSS data.

Download

Table 5Confusion matrix statistics for all four feature setup experiments.

Download Print Version | Download XLSX

Another major advantage of the GB algorithm is its ability to assess the importance of the used features for the prediction result. In Fig. 4, we show the 20 most important predictors (features) for the classification carried out for FS1. By far, the best predictor is the ZWD difference between the stations FLDK and FALE, which is surprising due to the fact that both stations are not as close to Altdorf as others in the utilised network. Interestingly, features from stations even further away from Altdorf also have a significant impact, most prominently ZWD and also gradient products (even for an east–west direction), e.g. in the Valais area (WEHO and HOH2 stations). This is reasonable due to the fact that typical wind trajectory in the Rhone valley is east–west oriented. ZHD differences representing larger-scale pressure gradients (such as LUZE-STA2 or ETHZ-TORI) are also found in Fig. 4. This is consistent with the study from Sprenger et al. (2017), where the pressure difference between Zürich and Locarno was the single most important predictor.

https://amt.copernicus.org/articles/15/5821/2022/amt-15-5821-2022-f04

Figure 4Feature importance score of the 20 top predictors for the GB algorithm for the setup used in FS1.

Download

4.2 Feature setup 2: NRT products

Feature setup 2 (FS2) addresses the major question of to what degree the proposed method can be used for (or incorporated into) operational forecasting of foehn events. Therefore, the investigations presented for FS1 are extended by using NRT troposphere products for the two-year test period. This way, we investigate the suitability of the proposed ML algorithms for operational prediction. NRT troposphere products are currently available in the form of tropospheric delays (ZHD, ZWD, and ZTD), which are typically provided with a latency of approximately 30–40 min after each full hour. Unfortunately, no atmospheric gradients are currently delivered in NRT mode, but an extension is possible and aimed for in the near future. The missing gradient information makes it necessary to train the GB and SVC algorithms again for the dedicated period (2010–2018 of reprocessed products) but this time only using features related to tropospheric delays (ZWD, ZTD, ZWD differences, ZHD differences). The detailed setup used for FS2 is again aligned with the criteria outlined before and given in Table 6.

Table 6Default setup used for FS2. For features not outlined in a specific row, by default, all stations and combinations of stations are used.

Download Print Version | Download XLSX

Resulting statistics of the prediction using NRT products can be found in Table 7. In comparison to FS1, a general performance decrease in all measures is apparent for both algorithms. For the SVC algorithm, the degradation is more pronounced for the alarm-based (-6 % in CAR) than for detection-based measures (almost equal performance). The GB algorithm shows equal degradation for both types.

Table 7Performance metrics for FS2 using NRT GNSS products.

Download Print Version | Download XLSX

Rows three and four of Table 5 give the confusion matrix entries for FS2. Results for the different algorithms are almost identical to those of FS1. As for FS1, SVC produces a larger amount of FP values but misses less events compared to the GB algorithm. GB again shows an approximately equal number of FP and FN values and provides more TP values.

The top right corner of Fig. 3 shows observed vs. predicted foehn events for FS2, in a similar way to that which is already described for FS1. It also confirms the conclusions drawn from statistics given in Tables 5 and 7, namely that using NRT products increases the number of false alarms (lowering CAR) compared to post-processed data (FS1). This holds true especially for the GB algorithm, where significantly more predicted events are visible for FS2 compared to FS1.

https://amt.copernicus.org/articles/15/5821/2022/amt-15-5821-2022-f05

Figure 5Feature importance score of the 20 top predictors for the GB algorithm for FS2.

Download

This indicates the importance of gradient parameters for the proposed method, as already visible in feature importances of FS1 (Fig. 4). Furthermore, lower quality of ZWD estimates must also be taken into consideration for the NRT solution, since lower quality orbit and clock products have to be used for GNSS processing. Nevertheless, combined measures (F2 and COMB) are still reaching values around 70 %, which might qualify the method as a potentially beneficial additional tool for operational forecasting, if efficient mitigation strategies for missing GNSS data can be applied. Some possible strategies will be discussed in the outlook section (Sect. 6).

In the absence of gradient parameters, ZWD differences dominate the top 20 most important features of the GB algorithm, as is to be expected (see Fig. 5). The dominance of the top predictor (again ZWD difference between FALE and FLDK) is even more pronounced than for FS1. Nevertheless, ZHD differences and DOY are again present, and absolute ZWD for certain stations also shows up.

4.3 Feature setups 3 and 4: shorter period and more stations

These additional experiments investigate the question of whether the time period of training data can be reduced when, at the same time, new stations (and therefore features) are introduced. This is especially important, since it allows for the introduction of geographically interesting stations (e.g. located at higher altitudes, such as SANB or OALP, see Appendix A for more details), which might be beneficial for the algorithm performance. The details of the feature setup for both experiments are given in Table 8. The utilised GNSS parameters remain unchanged from the default setup, but in addition, four stations (marked in blue in Fig. 2) are added to the station setup. The study period is adjusted to 2015–2019 in order to again be aligned with the selection criteria, and this period is split into training and test periods by an 80 %/20 % proportion.

In order to make a direct comparison possible, a fourth feature setup (FS4) is introduced in addition. It uses the station setup of the former experiments (FS1 and FS2) but the study period of FS3. Resulting statistics for both experiments (FS3 and FS4) are given in Table 9.

Table 8Default setup used for FS3 and FS4. For features not outlined in a specific row, by default, all stations and combinations of stations are used.

Download Print Version | Download XLSX

The results for FS3 show improvements for both algorithms, especially for alarm-based measures, compared to FS4. This outlines the importance of including geographically relevant stations (especially stations at the crest, i.e. higher altitudes) for the performance of the methods. Confusion matrix elements for FS3 and FS4 can be found in the lower half of Table 5. Overall, they show the same behaviour as already observed for the other experiments. However, it should be noted that the relative amount of FNs is lower for this feature setup, which is also reflected in the (improved) resulting statistics. One major reason for this is the higher probability of foehn events during 2019 in general. This is evident from both Table 9 (probability only, considering events which are also covered by GNSS data) as well as from Fig. 3 (showing all observed events). Another reason is that introducing new stations also leads to a significant decrease in foehn events, for which results are available. This is clearly visible by comparing time series for FS3 and FS4, e.g. for the GB algorithm in November 2019 (around DOY 315–320). Still, benefits can be attributed to the newly introduced stations, as they are also reflected in the feature importances of the GB algorithm, visualised in Fig. 6. In this case, the top predictor of FS1 and FS2 (ZWD difference between FLDK and FALE) is superseded by the ZWD difference between FLDK and SANB (station at San Bernadino pass, 1702 m a.s.l.). The station SANB as well as other high-altitude stations (such as OALP) are present a few times in the top 20 for FS3. ZHD differences are actually no longer among the top predictors for FS3, which might be explained by the fact that ZWD observations (and having them at relevant location) still provides significantly more valuable information. Feature importances for FS4 are not shown, as they are excepted to be fairly similar to those obtained for FS1, for which the same station setup and products are used. Overall, it can be concluded that benefits from additional stations can be excepted, although for future applications of the method, it will be crucial to ensure data availability, especially for the top predictors shown in Fig. 6.

https://amt.copernicus.org/articles/15/5821/2022/amt-15-5821-2022-f06

Figure 6Feature importance score of the 20 strongest predictors for the GB algorithm when using the FS3 setup.

Download

Table 9Performance metrics for FS3 and FS4.

Download Print Version | Download XLSX

5 Results: performance analysis for distinctive foehn events

The performance statistics shown in the last section give an overview of the average performance over the test period. In order to gain more insight on the performance of our method for specific events, we look at a week-long period (including two foehn events) at Altdorf in the year 2019 in more detail. Therefore, we make use of results from both algorithms for FS3 and evaluate their performance for this specific week against the operational FI.

Between 15–21 December 2019, two major (south) foehn events were observed at Altdorf, for which we analyse the performance of our method in the following. Relevant meteorological parameters (provided by MeteoSwiss) describing the situation are visualised in the upper two panels of Fig. 7. The upper part shows observations of temperature (red) and relative humidity (green) as well as wind speed (black) and direction (grey) for the time period 15–21 December 2019 (DOY 349–355). The first major event started around midnight at DOY 350 (16 December 2019), as visible in the significant increase in temperature and decrease in relative humidity as well as the onset of a strong southerly flow (up to 60 km h−1). This situation persisted over 48 h until the early morning hours of DOY 352 (18 December 2019). After a short break during daytime, the second major event started in the late evening of that same day and again lasted close to 48 h until the evening of DOY 354 (20 December 2019), again accompanied by similar conditions observed at the SMN station.

The bottom part of Fig. 7 shows the classification results of our method for the GB (orange) and SVC (blue) algorithms as well as the reference FI index (red) from MeteoSwiss. First of all, it must be noted that, for both the initial hours of the first major event and the last hours of the second event, no full feature matrix was available, and therefore, no classification was possible. This highlights the major drawback or limitation of the introduced method. However, as soon as all necessary data are available, the event is captured by both algorithms.

An overall assessment of the results shows a good average performance of the GNSS-based classification, especially for the GB algorithm. The SVC algorithm tends to over-predict foehn during the break period and therefore issues a large number of false alarms. This fact is also reflected in the statistics of all feature setups shown in Sect. 4 (higher POD but also higher POFD and lower CAR).

However, the transition from foehn to non-foehn and vice versa is not as accurately captured as in the operational FI index. One possible reason might be a slightly longer (or shorter) response time of the GNSS-based parameters at a specific station to a change in synoptic conditions, relative to the classical meteorological parameters observed at Altdorf. Therefore, it might be beneficial to introduce different time lags on some of the predictors, depending on the actual physical parameter and the geographical location of the contributing stations.

https://amt.copernicus.org/articles/15/5821/2022/amt-15-5821-2022-f07

Figure 7Time series of meteorological observations (a: temperature (red) and relative humidity (green), (b): wind speed (black) and direction (grey)); (c): classification results of SVC (blue) and GB (orange) and the reference FI index (red)

Download

In order to analyse the performance of the methods in more detail and to increase understanding of the physical processes captured in the GNSS products, we additionally analyse the time series of the most important predictors (features) of the introduced method. Figure 8 shows the six top predictors of the GB classification for FS3, as shown in Fig. 6, as well as the observed foehn periods (colour-coded in red). Most of them show distinctive patterns for foehn as well as for non-foehn periods, which are consistent with the physical relationships between GNSS observations and meteorological conditions (as introduced in Sects. 2 and 3.3) experienced for the respective period. ZWD differences show local minima or maxima for the major foehn periods, as already suspected in Sect. 3.3. Whether minima or maxima are observed depends on the actual location of the stations and on how the difference is built. Most of the (ZWD difference) features shown in Fig. 8 are built as a north–south station difference, which was expected to be a good predictor for foehn. Typically, low ZWD values are observed at stations north of the Alpine ridge (such as FLDK here) and high ZWD values at stations south of the Alpine ridge (e.g. LOMO). The north gradient observed at station WEHO (GN_WEHO) is also consistent with the physical understanding, showing a southward (negative) trend for the observed foehn periods. The only feature that might not be intuitive is the ZWD difference between the stations ZIMM (near Bern) and HABG (located a bit north of the main Alpine ridge). Although the extreme values are not as pronounced as for other predictors, they are still visible in the shown time series. This suggests that, in the majority of cases, humid air also reaches the station HABG, which is located further north of the main Alpine ridge.

https://amt.copernicus.org/articles/15/5821/2022/amt-15-5821-2022-f08

Figure 8Time series of the six top predictors of the GB algorithm (most important features as shown in Fig. 6) for the analysed time period (15–21 December 2019). Observed foehn events (FI = 1) are colour-coded in red.

Download

6 Conclusions and outlook

In the present study, we introduced a new method for the detection and prediction of foehn events at the Swiss station Altdorf based on GNSS troposphere products and ML-based classification. We showed the performance of the introduced method by making use of an 11-year-long dataset of GNSS tropospheric parameters from a dedicated station network, namely the Swiss AGNES GNSS network, as well as from additional sites in neighbouring countries. Furthermore, we made use of FI observations at the SMN station Altdorf for the chosen time period, provided by MeteoSwiss. In the course of an extensive cross-validation over the training dataset (2010–2018), six different classification algorithms were tested. The two best-performing algorithms were the GB and SVC algorithms, which were then used in the following feature setup experiments. In a first experiment (FS1), we evaluated results of foehn classifications and predictions from those two algorithms over a two-year test period (2019–2020) at Altdorf. The second experiment (FS2) investigated the usability of NRT GNSS products for foehn prediction in order to assess the feasibility of these low-latency (∼30–40 min) data for operational forecasting. By comparing results from a third and fourth experiment (FS3 vs. FS4), we assessed the benefit of including single, geographically relevant GNSS stations, such as high-altitude sites. Additionally, the performance of the method was tested in a detailed investigation of a weekly period including two strong foehn events in December 2019.

The following main conclusions can be drawn from the presented results:

  • The introduced ML-based method using GNSS troposphere products can provide encouraging results. It achieves equal performance in terms of both detection-based (POD = 75 %–80 %, POFD = 1 %–2 %) and alarm-based (CAR = 66 %–76 %, MAR = 1 %–2 %) metrics. On average, the results of both utilised algorithms are comparable to those obtained by Sprenger et al. (2017).

  • The most promising results can be obtained if the full station network (shown in Fig. 2) can be utilised. This also incorporates stations from neighbouring countries (Austria, Italy, Germany).

  • When using NRT troposphere products instead of reprocessed data, e.g. for operational prediction, some degradation of the results has to be accepted. This shows differently for the two used algorithms. For SVC, the performance loss mainly concerns alarm-based measures, whereas for the GB algorithm, both performance metric types are affected similarly. There are two apparent reasons for the experienced degradation related to the GNSS products. First, the NRT products do not include tropospheric gradients, which show up in the top predictors for the other case studies, at least for dedicated stations. Second, it can be expected that the quality of the prediction results is also influenced by the quality of the troposphere products. For NRT products, this quality is lower due to lower quality (but also lower latency) products used in GNSS processing (such as satellite orbits and clocks). In order to confirm this assumption, we plan to compare results using the NRT setup (using only delay products) on both NRT and reprocessed products in a possible future study.

  • The final decision on which algorithm (GB or SVC) to use is left to the actual users. Both algorithms show equal performance for combined measures (COMB and F2), with GB providing a more balanced performance in terms of detection- and alarm-based statistics. Another major advantage of the GB algorithm is the availability of feature importance information, which can provide valuable insight in the physical relations and meaningfulness of the results. Furthermore, its performance for the detailed event analysis, presented in Sect. 5, was clearly better (significantly lower number of false alarms).

  • As expected from the physical background of GNSS troposphere products, ZWD differences from geographically important stations serve as the most important predictors. Still, other chosen parameter types, such as north and east gradients as well as ZHD differences (representing pressure gradients), also show up in the list of top features for all experiments. Furthermore, it is worth noting that stations not only in the vicinity of Altdorf but also further away (e.g. the Valais area or the Rhine valley) play an important role. Therefore, stations from neighbouring countries can also be crucial for good performance (such as station Feldkirch (FLDK), Austria). Using the special setup of FS3, the benefits of having additional data from high-altitude stations (SANB, OALP, ZERM) was outlined. Having the positive impacts of these stations on the result could also allow for shortening the amount of data for training (from nine to four years, in this case), but lost foehn events due to missing data at added stations have to be kept in mind.

  • Choosing the optimal performance metrics and appropriate pre-processing is a key task in ML-based classification algorithms, especially when working with such a highly imbalanced dataset as in this study. The actual choice for the most important metric(s) strongly depends on the actual application of the prediction method, deciding whether detection- or alarm-based measures should be preferred. Within this study, we tried to tune the algorithms for an optimal balance between both metric types and leave a possible decision to the potential users. However, as already outlined before, there exists a trade-off between POD and CAR, and therefore, the optimisation of one metric will always result in the shortcoming of the other.

Overall, these initial results are promising, and the developed method might aid the meteorological community as an additional tool for foehn detection and/or prediction as soon as the current major limitations can be mitigated. These limitations of the introduced method are outlined as follows:

  • The most apparent limitation is that the availability of results from our method directly relies on the availability of GNSS data from all incorporated stations. As soon as data from only one station of the training network are missing, no results can be provided. This leads to a significant amount of periods (up to half of the events, in some cases) for which no results can be produced, as seen e.g. in Sect. 5.

  • Station specificity. This study only shows the applicability of the method for the FI station Altdorf. The performance achieved at this location cannot be generalised for other stations or a whole region. Tests for other meteorological stations that regularly experience foehn, both in Switzerland and neighbouring countries, are planned for future studies (see possible improvements below).

  • Supervised learning and dependence on target observations. As we use supervised learning techniques in this study, the results produced by our method will always be worse in comparison to the FI provided by MeteoSwiss, as this serves as our target observation. However, this might change when both GNSS-based FI and operational FI are compared to another, independent reference dataset (such as human forecasts).

  • Detection-based measures are not yet at the level of studies with meteorological data. However, alarm-based measures were higher for our study, so a combination of datasets is expected to be beneficial for the overall performance.

  • Looking into specific foehn events, the introduced method shows weaknesses in terms of capturing the exact periods of foehn onset and decay compared to the standard FI algorithm. As only a one-week period (including two major foehn events) was analysed here, this result cannot be generalised yet. Therefore, further studies are needed to look into more events in detail and, if needed, develop ways to increase the accuracy of the methods in terms of event start and end prediction.

Some of these limitations might be overcome by enhancements that can still be achieved through more detailed investigations in future studies. Possible improvements of the method we aim to investigate in the future would be the following:

  • As stations from neighbouring countries are found to be important for the performance of the methods, extending the utilised station network for several more of them is expected to benefit the results. In particular, having a denser station distribution on the southern side of the Alps (Italy) should have a positive impact on the performance of the methods.

  • Time lags of specific predictors should be introduced, accounting for the response time of the actual parameter at a specific station to changes in the synoptic conditions indicating a foehn event or lack thereof. Pressure-related parameters (ZHD) might be applied a greater time lag (response in advance) compared to humidity- or temperature-related parameters (such as ZWD). The same relation holds for the geographic location of contributing stations (south stations should respond in advance). Such approaches might help to overcome the limitations in terms of exact onset or decay prediction.

  • The developed method should be used at other foehn locations in Switzerland and neighbouring countries. For some of those locations, the currently used setup might even provide better results than for Altdorf, based on a denser station network in those areas (e.g. Valais area).

  • Enhance the nowcasting capabilities of the proposed method by including GNSS atmosphere gradients in the NRT products. If possible, gradient parameters should also be estimated at the same rate as delay products (every hour). Currently, this is done only every 6–12 h, and hourly estimates in between are interpolated linearly. This adaption might make the detection of smaller foehn events (lasting only a few hours) easier or even possible.

  • Data gaps in GNSS time series should be mitigated. In this regard, a number of different strategies can be investigated:

    • Interpolation techniques should be explored, at least for shorter gaps.

    • A set of different algorithms should be explored, iteratively excluding GNSS data from one station in the feature setup each time. This could provide a continuous solution under the assumption that only data from one station is missing.

    • Alternate features should be used in the case of a particular missing feature, which is possible for ML algorithms relying on weak learners.

  • The methods' performances should be optimised by carrying out a more extensive grid search for hyperparameter tuning of the used algorithms or by trying new (possibly more sophisticated deep learning) algorithms.

  • The incorporation of GNSS products (especially from stations showing large impact in this study already) into algorithms based on meteorological data, as in Sprenger et al. (2017), should be tested. As mentioned before, this might allow for a performance increase, especially for alarm-based statistics.

  • Comparisons to independent reference data should be made. As mentioned in the list of limitations, the GNSS-based FI will always perform worse than the operational FI in direct comparison. Therefore, it would be of interest to compare GNSS-based results with other independent methods, such as forecasts by human experts.

Appendix A: List of GNSS stations

This section provides the full GNSS station network that is utilised for this study.

Table A1Full list of GNSS stations utilised for this study. Indicated are Name, geographical location (Longitude, Latitude and Height), Network to which a station belongs, and the Feature setup in which it is used.

Download Print Version | Download XLSX

Code and data availability

Source code, trained algorithms, and test datasets are available on request from the corresponding author.

Author contributions

MAR developed the research idea and software implementation and prepared the manuscript (including formal analysis, visualisation, and writing). EB produced and provided the long-term time series of GNSS troposphere products used for this research. LC prepared selected visualisations for the manuscript. All co-authors contributed to the discussion of results as well as reviewing and editing the manuscript.

Competing interests

The contact author has declared that none of the authors has any competing interests.

Disclaimer

Publisher’s note: Copernicus Publications remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Acknowledgements

The authors would like to thank the Swiss Federal Office of Topography (swisstopo) for providing GNSS troposphere products from the AGNES network, and the Swiss National Weather Service (MeteoSwiss) for providing foehn index and other meteorological observations for the station Altdorf. Furthermore, we thank the three anonymous reviewers for their valuable comments and suggestions which greatly helped to improve the manuscript.

Review statement

This paper was edited by Roeland Van Malderen and reviewed by three anonymous referees.

References

Aichinger-Rosenberger, M.: Usability of high-resolution GNSS-ZTD data in the AROME model, Master's thesis, University of Innsbruck, https://diglib.uibk.ac.at/urn:nbn:at:at-ubi:1-27392 (last access: 2 September 2022), 2018. a

Baeza-Yates, R. A. and Ribeiro-Neto, B.: Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., USA, https://doi.org/10.5555/553876, 327–328, 1999. a

Barnes, L. R., Gruntfest, E. C., Hayden, M. H., Schultz, D. M., and Benight, C.: False Alarms and Close Calls: A Conceptual Model of Warning Accuracy, Weather Forecast., 22, 1140–1147, https://doi.org/10.1175/WAF1031.1, 2007. a

Bennitt, G. V. and Jupp, A.: Operational Assimilation of GPS Zenith Total Delay Observations into the Met Office Numerical Weather Prediction Models, Mon. Weather Rev., 140, 2706–2719, https://doi.org/10.1175/MWR-D-11-00156.1, 2012. a

Bevis, M., Businger, S., Herring, T. A., Anthes, R. A., and Ware, R. H.: GPS Meteorology: Remote Sensing of Atmospheric Water Vapor Using the Global Positioning System, Geophys. Mag., 34, 359–425, 1992. a

Breiman, L.: Random Forests, Machine Learn., 45, 5–32, https://doi.org/10.1023/A:1010933404324, 2001. a

Brenot, H., Neméghaire, J., Delobbe, L., Clerbaux, N., De Meutter, P., Deckmyn, A., Delcloo, A., Frappez, L., and Van Roozendael, M.: Preliminary signs of the initiation of deep convection by GNSS, Atmos. Chem. Phys., 13, 5425–5449, https://doi.org/10.5194/acp-13-5425-2013, 2013. a

Brockmann, E.: Reprocessed GNSS tropospheric products at swisstopo, in: GNSS4SWEC workshop, Thessaloniki, 11–14 May, 2015. a

Brockmann, E.: National Report of Switzerland, in: EUREF-Symposium, San Sebastian, Spain, 25–27 May, 2016. a

Brockmann, E., Grünig, S., Schneider, D., Wiget, A., and Wild, U.: National report of Switzerland: Introduction and first applications of a Real-Time Precise Positioning Service using the Swiss Permanent Network AGNES, in: Torres, J. A. and Hornik, H., Subcommission for the European Reference Frame (EUREF), EUREF Publication No. 10, Mitteilungen des Bundesamtes für Kartographie und Geodäsie, 23, 272–276, 2002. a

Chawla, N. V., Bowyer, K. W., Hall, L. O., and Kegelmeyer, W. P.: SMOTE: Synthetic Minority Over-sampling Technique, J. Art. Intellig. Res., 16, 321–357, https://doi.org/10.1613/jair.953, 2002. a

Cover, T. and Hart, P.: Nearest neighbor pattern classification, IEEE Trans. Inform. Theor., 13, 21–27, https://doi.org/10.1109/TIT.1967.1053964, 1967. a

de Haan, S.: Meteorological applications of a surface network of Global Positioning System receivers, Ph.D. thesis, Wageningen University, available at: https://library.wur.nl/WebQuery/wurpubs/366332 (last access: 12 October 2022), 2008. a

de Haan, S.: Assimilation of GNSS ZTD and radar radial velocity for the benefit of very-short-range regional weather forecasts, Q. J. Roy. Meteorol. Soc., 139, 2097–2107, 2013. a

Deloncle, A., Berk, R., D'Andrea, F., and Ghil, M.: Weather Regime Prediction Using Statistical Learning, J. Atmos. Sci., 64, 1619–1635, https://doi.org/10.1175/JAS3918.1, 2007. a, b

Drobinski, P., Steinacker, R., Richner, H., Baumann-stanzer, K., Beffrey, G., Bénech, B., Berger, H., Chimani, B., Dabas, A., Dorninger, M., Dürr, B., Flamant, C., Frioud, M., Furger, M., Gröhn, I., Gubser, S., Gutermann, T., Häberli, C., Häller-Scharnhost, E., Jaubert, G., Lothon, M., Mitev, V., Pechinger, U., Piringer, M., Ratheiser, M., Ruffieux, D., Seiz, G., Spatzierer, M., Tschannett, S., Vogt, S., Werner, R., and Zängl, G.: Föhn in the Rhine Valley during MAP: A review of its multiscale dynamics in complex valley geometry, Q. J. Roy. Meteorol. Soc., 133, 897–916, 2007. a

Dürr, B.: Automatisiertes Verfahren zur Bestimmung von Föhn in Alpentälern, Arbeitsberichte der MeteoSchweiz, 223, 22 pp., http://www.meteoschweiz.admin.ch/content/dam/meteoswiss/de/Ungebundene-Seiten/Publikationen/Fachberichte/doc/ab223.pdf (last access: 12 October 2022), 2008. a, b, c

Freund, Y. and Schapire, R. E.: A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting, J. Comput. Syst. Sci., 55, 119–139, https://doi.org/10.1006/jcss.1997.1504, 1997. a

Friedman, J. H.: Greedy Function Approximation: A Gradient Boosting Machine, The Ann. Stat., 29, 1189–1232, 2001. a, b

Glahn, H. R. and Lowry, D. A.: The Use of Model Output Statistics (MOS) in Objective Weather Forecasting, J. Appl. Meteorol. Climatol., 11, 1203–1211, https://doi.org/10.1175/1520-0450(1972)011<1203:TUOMOS>2.0.CO;2, 1972. a

Gohm, A. and Mayr, G. J.: Hydraulic aspects of föhn winds in an Alpine valley, Q. J. Roy. Meteorol. Soc., 130, 449–480, https://doi.org/10.1256/qj.03.28, 2004. a

Guerova, G., Jones, J., Douša, J., Dick, G., de Haan, S., Pottiaux, E., Bock, O., Pacione, R., Elgered, G., Vedel, H., and Bender, M.: Review of the state of the art and future prospects of the ground-based GNSS meteorology in Europe, Atmos. Meas. Tech., 9, 5385–5406, https://doi.org/10.5194/amt-9-5385-2016, 2016. a

Gutermann, T., Dürr, B., Richner, H., and Bader, S.: Föhnklimatologie Altdorf: die lange Reihe (1864–2008) und ihre Weiterführung, Vergleich mit anderen Stationen, https://doi.org/10.3929/ethz-a-007583529, 2012. a, b

Hess, R.: Statistical postprocessing of ensemble forecasts for severe weather at Deutscher Wetterdienst, Nonlin. Processes Geophys., 27, 473–487, https://doi.org/10.5194/npg-27-473-2020, 2020. a

Hsieh, W. W.: Machine Learning Methods in the Environmental Sciences: Neural Networks and Kernels, Cambridge University Press, https://doi.org/10.1017/CBO9780511627217, 349 pp., 2009. a

Kretzschmar, R., Eckert, P., Cattani, D., and Eggimann, F.: Neural Network Classifiers for Local Wind Prediction, J. Appl. Meteorol., 43, 727–738, https://doi.org/10.1175/2057.1, 2004. a, b

LeCun, Y. A., Bottou, L., Orr, G. B., and Müller, K.-R.: Efficient backprop, in: Neural networks: Tricks of the trade, 9–48, Springer, https://doi.org/10.1007/978-3-642-35289-8_3, 2012. a

Lothon, M., Druilhet, A., Bénech, B., Campistron, B., Bernard, S., and Said, F.: Experimental study of five föhn events during the Mesoscale Alpine Programme: From synoptic scale to turbulence, Q. J. Roy. Meteorol. Soc., 129, 2171–2193, https://doi.org/10.1256/qj.02.30, 2006. a

Manzato, A.: The Use of Sounding-Derived Indices for a Neural Network Short-Term Thunderstorm Forecast, Weather Forecast., 20, 896–917, https://doi.org/10.1175/WAF898.1, 2005. a, b

Mayr, G., Plavcan, D., Armi, L., Elvidge, A., Grisogono, B., Horvath, K., Jackson, P., Neururer, A., Seibert, P., Steenburgh, J. W., Stiperski, I., Sturman, A., Željko Večenaj, Vergeiner, J., Vosper, S., and Zängl, G.: The Community Foehn Classification Experiment, B. Am. Meteorol. Soc., 99, 2229–2235, https://doi.org/10.1175/BAMS-D-17-0200.1, 2018. a, b

Mayr, G. J., Armi, L., Gohm, A., Zängl, G., Durran, D. R., Flamant, C., Gabersek, S., Mobbs, S. D., Ross, A. B., and Weissmann, M.: Gap flows: Results from the Mesoscale Alpine Programme, Q. J. Roy. Meteorol. Soc., 133, 881–896, 2007. a

Mony, C., Jansing, L., and Sprenger, M.: Evaluating Foehn Occurrence in a Changing Climate Based on Reanalysis and Climate Model Data Using Machine Learning, Weather Forecast., 36, 2039–2055, https://doi.org/10.1175/WAF-D-21-0036.1, 2021. a

Otero, F. and Araneo, D.: Zonda wind classification using machine learning algorithms, Int. J. Climatol., 41, E342–E353, https://doi.org/10.1002/joc.6688, 2021. a, b

Pacione, R., Araszkiewicz, A., Brockmann, E., and Dousa, J.: EPN-Repro2: A reference GNSS tropospheric data set over Europe, Atmos. Meas. Tech., 10, 1689–1705, https://doi.org/10.5194/amt-10-1689-2017, 2017. a

Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., and Duchesnay, E.: Scikit-learn: Machine Learning in Python, J. Machine Learn. Res. [code], 12, 2825–2830, 2011. a

Perler, D. and Marchand, O.: A Study in Weather Model Output Postprocessing: Using the Boosting Method for Thunderstorm Detection, Weather Forecast., 24, 211–222, https://doi.org/10.1175/2008WAF2007047.1, 2009. a, b

Platt, J. C.: Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods, in: Advances In Large Margin Classifiers, 61–74, MIT Press, http://citeseer.ist.psu.edu/viewdoc/summary?doi=10.1.1.41.1639 (last access: 12 October 2022), 1999.  a, b

Plavcan, D., Mayr, G. J., and Zeileis, A.: Automatic and Probabilistic Foehn Diagnosis with a Statistical Mixture Model, J. Appl. Meteorol. Climatol., 53, 652–659, https://doi.org/10.1175/JAMC-D-13-0267.1, 2014. a

Rüeger, J. M.: Refractive index formulae for radio waves, in: Proc. XXII FIG International Congress, Washington DC, USA, FIG, http://www.fig.net/pub/fig_2002/procmain.htm (last access: 24 January 2022), 2002a. a

Saastamoinen, J.: Contributions to the theory of atmospheric refraction, Bull. Geodes. 105, 13–34, 1972. a

Scher, S. and Messori, G.: Predicting weather forecast uncertainty with machine learning, Q. J. Roy. Meteorol. Soc., 144, 2830–2841, https://doi.org/10.1002/qj.3410, 2018. a

Solheim, F. S., Vivekanandan, J., Ware, R. H., and Rocken, C.: Propagation delays induced in GPS signals by dry air, water vapor, hydrometeors, and other particulates, J. Geophys. Res.-Atmos., 104, 9663–9670, https://doi.org/10.1029/1999JD900095, 1999. a

Sprenger, M., Schemm, S., Oechslin, R., and Jenkner, J.: Nowcasting Foehn Wind Events Using the AdaBoost Machine Learning Algorithm, Weather Forecast., 32, 1079–1099, https://doi.org/10.1175/WAF-D-16-0208.1, 2017. a, b, c, d, e, f, g, h, i, j, k

Steinacker, R.: Alpiner Foehn – a new verse to an old song, Promet, 32, 3–10, 2006. a

Stoev, K. and Guerova, G.: Use of GNSS tropospheric products to study the foehn in Sofia, Talk: EMS Annual Meeting: European Conference for Applied Meteorology and Climatology 2018, 3–7 September 2018, Budapest, Hungary, 2018. a

Stoycheva, A. and Guerova, G.: Study of fog in Bulgaria by using the GNSS tropospheric products and large scale dynamic analysis, J. Atmos. Solar-Terrest. Phys., 133, 87–97, https://doi.org/10.1016/j.jastp.2015.08.004, 2015. a

Wilhelm, M.: COSMO-2 Model Performance in Forecasting Foehn: a Systematic Process-oriented Verification, Veröffentlichungen der MeteoSchweiz, 89, 64 pp., https://www.meteoschweiz.admin.ch/home/service-und-publikationen/publikationen.subpage.html/de/data/publications/2012/8/cosmo-2-model-performance-in-forecasting-foehn--a-systematic-pro.html (last access: 12 October 2022), 2012. a

Wilks, D. S. and Hamill, T. M.: Comparison of Ensemble-MOS Methods Using GFS Reforecasts, Mon. Weather Rev., 135, 2379–2390, https://doi.org/10.1175/MWR3402.1, 2007. a

WMO: International Meteorological Vocabulary, WMO No. 182, https://library.wmo.int/?lvl=notice_display&id=220#.Y0Z1zEzP23A (last access: 12 October 2022), 1992. a

Yalavarthi, R. and Shashi, M.: Atmospheric Temperature Prediction using Support Vector Machines, Int. J. Comput. Theor. Eng., 1, 55–58, https://doi.org/10.7763/IJCTE.2009.V1.9, 2009. a, b

Yan, X., Ducrocq, V., Jaubert, G., Brousseau, P., Poli, P., Champollion, C., Flamant, C., and Boniface, K.: The benefit of GPS zenith delay assimilation to high-resolution quantitative precipitation forecast. A case-study from COPS IOP 9, Q. J. Roy. Meteorol. Soc., 135, 1788–1800, 2009. a

Download
Short summary
This study develops an innovative approach for the detection and prediction of foehn winds. The approach uses products generated from GNSS (Global Navigation Satellite Systems) in combination with machine learning-based classification algorithms to detect and predict foehn winds at Altdorf, Switzerland. Results are encouraging and comparable to similar studies using meteorological data, which might qualify the method as an additional tool for short-term foehn forecasting in the future.