Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Anchor
Table3
Table3
Table 3 - Trueness

Definition

Average of O-B values over a defined period 

Calculation

For each observed variable, the average of all valid data is computed for every station. 

Valid data

Data not flagged as missing value (O-B is not NULL) 

Minimum required valid data

1 valid value. 

Math expression

∑ (𝑂 − 𝐵)𝑖,𝑗/𝑁𝑗 . where Nj is number of valid data for variable j.


Precision 

The standard deviation (estimate of random error) is the quantitative measure of precision (Table 4). The targets for precision are applied to the standard deviation of O-B over a certain period for each of the observed variables (Table 6).  Like trueness, precision will be assessed 6-hourly, daily and monthly. Also, the 5-day moving average (Alert) of daily calculated standard deviation of O-B (Table 9) will be calculated for all variables and compared to the respective prescribed threshold ( Table 6).  This together with the performance indicator for Trueness will be used by the Evaluation function on their daily monitoring activities to determine the level of priority for stations showing accuracy/measurement uncertainty issues (see table in Annex2 of WDQMS Guidance Document). 

...

Anchor
Table4
Table4
Table 4 - PrecisionImage Removed

Definition

Standard deviation (std) of O-B values over a defined period 

Calculation

For each observed variable, the std of all valid data is computed for every station. 

Valid data

Data not flagged as missing value (O-B is not NULL) 

Minimum required valid data

Daily: 2 valid values 

Math expression

 , where Nj is number of valid data for variable j and the bar denotes the average as defined in Table 3.


Both bias and standard deviation contribute to the overall measurement uncertainty. The root mean square error (rmse) is a common metric used to measure accuracy, and it is applied to upper-air observations in the WDQMS web tool (section 6.2) based on the quantitative information for the two vertical layers (mean and standard deviation of O-B departures over Trop and Stra, see section 2.1.2)  provided by the NWP reports (see Table 5).



Anchor
Table5
Table5
Table 5 - Root Mean Square Error (rmse)

...