Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

On this page, the model performance is analysed over the whole period of 1979-2021, with any available observations . The stations were selected as described in GloFAS v4 verification data, with 1949 stations used which had that met the quality criteria, specified in the verification methodology page (place holder GloFAS hydrological performance verification methodology). In total, 1987 stations were used for the v4.0 verificaiton and 1949 for the v4.0 vs v3.1 model comparison, with at least 1 year of quality checked data and minimum human reservoir or lake influence. For the verification methodology and used metrics please see again the section page place holder GloFAS hydrological performance verification methodology.

This GloFAS v4.0 hydrological model performance assessment presented here, is based on the historical river discharge reanalysis available at https://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-historical?tab=overview.

Verification period

The verification focused on the whole period with all available river discharge observations, similarly as it is in the GloFAS hydrological model performance layer in the map viewer (GloFAS hydrological model performance web product)

Performance scores

GloFAS hydrological performance verification is done against river discharge observations available to the GloFAS team. The hydrological model performance analysis was conducted based on the modified Kling–Gupta efficiency metric (KGE'; ideal value is 1):

Image RemovedImage RemovedImage Removed

The three component scores of the KGE' were also used:

  • Pearson correlation (r) in KGE' highlights temporal errors through the strength of the linear relationship between simulation and observation time series. It ranges from -1 to 1, with 1 as ideal value.
  • Bias ratio (β) represents the bias errors, ranging from 0 to +Inf, with 1 as ideal value. Relative bias pbias (ideal value = 0) defined as β-1 (or its absolute value abspbias)
  • Variability ratio (γ) shows the variability related errors in the simulation. It ranges from 0 to +Inf, with 1 as optimal value. Relative variability var (ideal value = 0) defined as γ-1 (or its absolute value absvar)

In the GloFAS v4 calibration hydrological model performance and the GloFAS hydrological model performance web product, the KGE' and the three KGE' components (r, β and γ as bias and variability ratios and correlation) were used.

However, in this general GloFAS v4.0 model evaluation, besides the correlation (denoted as pcorr), the β-1 (pbias) and γ-1 (var) were considered as the bias and variability ratio versions, which both have 0 as optimal values instead of 1. In addition, the absolute values of pbias (abspbias) and var (absvar) were also used, which help to show skill differences between models.

Finally, a specific index was also used for measuring timing errors (timing in days; ideal value is 0), which shows the time delay between the simulated and observed river discharge time series (and also the absolute value abstiming). Timing is a time lag (or shift) L that maximises Rxy(L), cross correlation function Rxy(m) with the simulated (x) and observed (y) time series shifted by L days. Positive/negative timing error indicates late/early simulated river discharge. So, for example a timing error of +5 means the simulation needs to be shifted by 5 days backwards (brought earlier) to get to the highest correlation, i.e. the simulation is generally 5-day late predicting the ups and downs in the flow time series. Although this is not directly equivalent to measuring the timing error of the highest flood peaks, it is in very good relation with that and can be used as a simple estimate.

General v4.0 performance

For this comparison, we used all stations with good quality river discharge observations and minimal human or lake influence that could be mapped (find the corresponding model river network location) onto the higher resolution v4.0 river network. In total 1987 stations were usedcould be considered as shown below with the available observation length (gaps are removed to compute the length)

Image Modified
Figure 1. Number of years of available river discharge observations in the 1979-2021 reanalysis period.