Contributors: B. Fuentes Andrade (Institute of Environmental Physics (IUP)), M. Reuter (Institute of Environmental Physics (IUP)), M. Buchwitz (Institute of Environmental Physics (IUP))
Issued by: Institute of Environmental Physics (IUP), University of Bremen / Maximilian Reuter
Date: 09/02/2026
Ref: C3S2_313a_DLR_WP1-DDP-GHG-v2_PQAR_XGHG_v5.1
Official reference number service contract: 2024/C3S2_313a_DLR/SC1
|
This document is a Product Quality Assessment Report (PQAR) generated in the framework of the Copernicus Climate Change Service (C3S, https://climate.copernicus.eu/). For C3S a large number of satellite-derived Essential Climate Variable (ECV) data products are generated and made available via the Copernicus Climate Data Store (CDS, https://cds.climate.copernicus.eu/).
This document describes how the quality of two satellite-derived atmospheric carbon dioxide (CO2) and methane (CH4) data products has been assessed. The two products are column-averaged dry-air mole fractions of CO2 and CH4, denoted as XCO2 (in parts per million, ppm) and XCH4 (in parts per billion, ppb), respectively. These two XGHG products are generated by the Institute of Environmental Physics (IUP), University of Bremen on behalf of the C3S. In the following this project is referred to as C3S/GHG project. Within this project also mid-tropospheric CO2 and CH4 products are generated. These mid-tropospheric CO2 and CH4 products are not described in this document but in dedicated separate documents (ATBD MTGHG, 2024, PQAR MTGHG, 2024 and PUGS MTGHG, 2024).
The two data products assessed in this document (XCO2_OBS4MIPS and XCH4_OBS4MIPS, collectively referred to as XGHG O4M for readability), are merged multi-sensor XCO2 and XCH4 Level 3 (L3) products with monthly time and 1ºx1º spatial resolution, generated using an ensemble of individual satellite sensor Level 2 (L2) products. The current version of the products has been produced using a new merging algorithm, i.e. EMMA v5.1. The core of EMMA v5.1 is based on the idea that the ensemble median is a good choice for merging different input data products, analogous to previous EMMA versions. However, the new approach, in contrast to former EMMA versions, is to select a reference L2 product per time period, while the ensemble of input L2 products are used for the computation of an empirical spatio-temporal adjustment of the reference product (see ATBD XGHG, 2026 for details) . The merged L2 product is again gridded to create the L3 OBS4MIPS product.
The main improvements of the new merged product are the higher resolution of the merged L3 product, i.e. monthly 1º x 1º, compared to the previous monthly 5º x 5º resolution and the absence of abrupt spatial jumps derived from the selection of different algorithms on different monthly 10º x 10º grid cells. Additionally, new input L2 products for both XCH4 and XCO2 have been included. See PUGS XGHG, 2026 for more details on the history of changes in previously generated datasets.
Specifically, this Product Quality Assessment Report (PQAR) at hand describes how version 5.1 of the XGHG O4M products has been validated using XCO2 and XCH4 retrievals from the Total Carbon Column Observing Network (TCCON, https://tccon.caltech.edu/) (Wunch et al., 2010, 2011, 2015, Laughner et al., 2024). Because the dataset has been produced using a new merging algorithm, this PQAR also contains a comparison between the current product version, v5.1, and the last version produced with the former algorithm, v4.6, to ensure consistency. The algorithm has been developed at the University of Bremen, Germany, and is based on the algorithm used to generate previous versions of these products (e.g. Reuter et al., 2013, 2020).
Summary product quality XCO2_OBS4MIPS v5.1:
The TCCON-validation of the XCO2_OBS4MIPS v5.1 product can be summarized as follows. There is only a small overall average bias of 0.29 ppm. Regional biases estimated from the site-to-site bias variability amount to 0.42 ppm. The average seasonal and spatiotemporal bias amounts to 0.24 ppm and 0.48 ppm, respectively. The overall linear drift is 0.00 ppm/year and its site-to-site variability 0.11 ppm/year. Therefore, it can be concluded that there is no significant drift in the data. The overall single-grid-cell precision is 1.82 ppm, and the uncertainty ratio, i.e. the ratio between the overall single-grid-cell precision and the average reported uncertainty is 1.10.
The probability that the 0.5 ppm accuracy requirement is met is 70%. The probability that the 0.5 ppm/year stability requirement is met is 97%. Overall, this product has therefore reasonable accuracy and high stability.
Summary product quality XCH4_OBS4MIPS v5.1:
The TCCON-validation of the XCH4_OBS4MIPS v5.1 product can be summarized as follows. There is only a small overall average bias of -6.39 ppb. Regional biases estimated from the site-to-site bias variability amount to 3.37 ppb. The average seasonal and spatiotemporal bias amounts to 2.68 ppb and 4.31 ppb, respectively. The overall linear drift of 0.11 ppb/year is much smaller than its site-to-site variability of 0.62 ppb/year. The overall single-grid-cell precision is 9.01 ppb and the uncertainty ratio, i.e. the ratio between the single-grid-cell precision and the average reported uncertainty and is 0.82.
The probability that the 10 ppb accuracy requirement is met is 91%. The probability that the 3 ppb/year stability requirement is met is 99%. Overall, this product has therefore very good accuracy and high stability.
The validation method as used for the XGHG O4M version 5.1 products is based on comparisons of the XCO2 and XCH4 satellite-derived data products with corresponding XCO2 and XCH4 retrieval from the Total Carbon Column Observing Network (TCCON, http://www.tccon.caltech.edu/) (Wunch et al., 2010, 2011, 2015, Laughner et al., 2024).
Stochastic and (quasi-)systematic errors influence the usefulness of our data very differently. Stochastic errors average out quickly in global surface flux inversions, but large-scale (spatial and temporal) systematic errors, such as false inter-hemispheric gradients of a few tenths of a ppm, can significantly degrade the results. The opposite is true for smaller-scale applications. Due to the smaller scale, fewer data points are involved, making stochastic errors more important. However, an application using only data within Europe is not influenced by biased results in Australia. Therefore, we always aim at separating stochastic error components from systematic components. From the stochastic part we infer the precision or uncertainty. The systematic part is analysed in order to conclude on the accuracy. However, we split this term into four: the overall bias or offset, a regionally varying component, a seasonally varying component, and a linear drift. The first term is practically irrelevant, because, basically all applications only analyse gradients. However, the regionally or temporally varying parts of the systematic error are critical as mentioned above. As a measure for the variability of such biases, we compute the standard deviation of the regional and temporal parts of the systematic error. In order to address its regional or temporal character, we call the corresponding accuracy measure “relative systematic error” or “spatio-temporal bias”.
The current version of the products, v5.1, has been produced using a new merging algorithm. To ensure consistency between the new product v5.1 and the previous one, v4.6, a comparison between both datasets was carried out as explained in Section 1.5.
For validation of satellite XCO2 and XCH4 retrievals the Total Carbon Column Observing Network (TCCON, http://www.tccon.caltech.edu/) has been established (e.g., Wunch et al., 2010, 2011, 2015, Laughner et al., 2024). This network is the core network used for validation of the satellite XCO2 and XCH4 retrievals. Nevertheless, there are also some limitations as explained in Section 1.4.
TCCON provides XCO2 and XCH4 data products as retrieved from ground-based Fourier Transform Infrared (FTIR) observations based on direct sun observations. The TCCON data products can essentially be directly compared with the satellite-derived XCO2 and XCH4 data products, and have been used for this purpose extensively in the past as shown in many studies and publications (e.g., Reuter et al., 2020, and references given therein).
The uncertainty of the TCCON reference data is:
see Wunch et al., 2010, but also the discussions of this uncertainty related to the use of TCCON data for the validation of satellite retrievals in Buchwitz et al. (2015, 2016), and Dils et al. (2014).
As explained in this document, the satellite-derived XCO2 and XCH4 data products have been validated by comparison with TCCON XCO2 and XCH4 data products, which in turn have been calibrated against the World Meteorological Organization (WMO) in situ trace gas measurement scales (see Wunch et al., 2010), namely X2004 for XCH4 and X2007 for XCO2. This approach ensures that the satellite XCO2 and XCH4 retrievals are linked to the WMO standards for atmospheric CO2 and CH4 measurements.
In this section, we describe the method used to validate the gridded OBS4MIPS XCO2 and XCH4 L3 products. It is based on the validation method applied to precursor C3S L2 XCO2 and XCH4 data sets, but there are some important differences. The method has been adapted to validate L3 products instead of L2 products.
The OBS4MIPS XCO2 and XCH4 data products are validated with TCCON (Wunch et al., 2011) version GGG2020 (Laughner et al., 2024) measurements in a similar way as done by Reuter et al. 2011. For all comparisons, averaging kernels have been applied and the influence of the smoothing error reduced (Wunch et al., 2011). The TCCON data was gridded to the OBS4MIPS spatio-temporal grid. If multiple TCCON stations lie within the same grid cell, their corresponding gridded data is averaged, and so are their coordinates (longitude, latitude and altitude). To ensure that the TCCON measurements used for averaging are representative for the monthly mean, only grid cells with more than 100 TCCON measurements performed on 10 or more different days are taken into account. The criteria that define the co-locations between each of the XGHG O4M product and TCCON data are the following:
The mean surface altitude at 1ºx1º resolution was computed by re-gridding the Copernicus GLO-90 Digital Elevation Model (DEM).
We only consider, for individual stations, time series that have more than 30 months of data so that the time series are long enough to ensure robust results.
For each data product several quality-related quantities have been determined as described in the following.
For each TCCON station in the gridded TCCON data, the following performance statistics are calculated: number of co- locations, station bias (also known as regional bias), seasonal bias, linear drift, and single grid cell precision.
The main validation results are computed by fitting the following bias model to the difference between the satellite retrievals and the TCCON measurements at each TCCON site.
\Delta X = a_0 + a_1 t + a_2 \sin (2 \pi t + a_3) + \epsilon. \qquad\qquad\qquad\qquad\text{(1)} |
Here,
\Delta X |
represents the difference (satellite minus TCCON),
t |
the time, in units of years, of the collocation between TCCON and the satellite measurements,
\epsilon |
the residual, and
a_{0-3} |
the free fit parameters. Specifically,
a_0 |
represents an offset,
a_1 |
the linear drift and
a_2 |
the amplitude of the seasonal bias at a TCCON site.
The station or regional bias,
\Delta_{reg} |
, is computed from the average over time of the fit model:
\Delta_{reg} = \overline{a_0 + a_1 t + a_2 \sin (2 \pi t + a_3)}, \qquad\qquad\qquad\qquad\text{(2)} |
where the overline represents the mean.
The seasonal bias,
\Delta_{sea} |
, is computed from the standard deviation (denoted as std) of the seasonal term:
\Delta_{sea} = std (a_2 \sin (2 \pi t + a_3) ). \qquad\qquad\qquad\qquad\text{(3)} |
The spatiotemporal bias is computed from the regional and seasonal biases as
\Delta_{spt} = \sqrt{ \Delta_{reg}^2 + \Delta_{sea}^2} \qquad\qquad\qquad\qquad\text{(4)} |
The linear drift,
\Delta_{dri} |
corresponds to the fit parameter
a_1 |
, i.e.
\Delta_{dri} = a_1. |
The single grid cell precision,
\sigma |
, is computed from the standard deviation of the residual:
\sigma = std(\epsilon) = std (\Delta X - a_0 - a_1 t - a_2 \sin (2 \pi t + a_3)) \qquad\qquad\qquad\qquad\text{(5)} |
The OBS4MIPS products contain an uncertainty estimate for each grid cell (see ATBD XGHG, 2026). This uncertainty is meant to be the statistical uncertainty (1-sigma) associated with that grid cell value. We compute an average reported uncertainty,
\sigma_{rep} |
, per station, as the quadratic average over time of the OBS4MIPS reported uncertainty,
\sigma'_{rep} |
, for each grid cell.
\sigma_{rep} = \sqrt{\overline{\sigma'_{rep}^2}} \qquad\qquad\qquad\qquad\text{(6)} |
Based on the per station statistics, the following summarizing statistics are calculated.
The average station bias and the station-to-station bias variability (which we consider a measure for the regional biases), are computed as the mean and standard deviation of the individual station biases:
\overline{ \Delta_{reg}} \pm std(\Delta_{reg}). |
The average seasonal bias is computed as the mean of the seasonal biases of all TCCON sites:
\overline{ \Delta_{sea} }. |
The overall spatio-temporal bias,
\overline{ \Delta_{spt} } |
, is computed as:
\overline{ \Delta_{spt} } = \sqrt{ std^2 ( \Delta_{reg} ) + \overline{ \Delta_{sea} }^2 }. \qquad\qquad\qquad\qquad\text{(7)} |
The average linear drift and the drift uncertainty is computed by:
\overline{ \Delta_{dri} } \pm std (\Delta_{dri}). |
As the linear drift can be assumed to be globally constant, the station-to-station standard deviation of the linear drift can be considered a measure of its uncertainty.
The overall single grid cell precision is computed by:
\overline{ \sigma } = \sqrt{ \overline{ \sigma^2}}, \qquad\qquad\qquad\qquad\text{(8)} |
and the average reported uncertainty is given by:
\overline{ \sigma_{rep} } = \sqrt{ \overline{ \sigma_{rep}^2}}, \qquad\qquad\qquad\qquad\text{(9)} |
To assess the quality of the OBS4MIPS uncertainty estimates, the overall single grid cell precision,
\overline{\sigma} |
, is compared to the average reported uncertainty,
\overline{\sigma_{rep}} |
. For that purpose, we computed the uncertainty ratio, defined as:
r = \frac{\overline{\sigma}}{\overline{\sigma_{rep}}}. \qquad\qquad\qquad\qquad\text{(10)} |
If the reported uncertainty is realistic, it should approximately agree with the average precision estimated from the comparison with TCCON. In this case the uncertainty ratio r should be approximately unity. Therefore, the uncertainty ratio r can be used to estimate if the reported uncertainty is realistic.
The results obtained with the quantitative assessment methods described in Section 1.2.1 and Section 1.2.2 are compared with the Target Requirements (TRs) as given in the Target Requirement and Gap Analysis Document (TR-GAD) (TR-GAD GHG, 2024).
The user requirements are listed in the Target Requirement and Gap Analysis Document (TR-GAD GHG, 2024). They are based on requirements as formulated in documents GCOS-154, GCOS-195, GCOS-200, GCOS-245 and CMUG-RBD, 2012.
The TR-GAD GHG, 2024, document contains explicit requirements for random errors, systematic errors and stability of the Level 2 XCO2 and XCH4 data products in terms of goal (G), breakthrough (B) and threshold (T) requirements. Explicit requirements for Level 3 products are not formulated in TR-GAD GHG, 2024. Instead, it is assumed that the accuracy and stability requirements are also valid for Level 3 (i.e., spatio-temporally averaged) data products. As explained in Section 2 of TR-GAD GHG, 2024, the GCOS requirements as formulated in GCOS-245 are not applicable for the data products as presented in this document as these new GCOS requirements are formulated for future missions (e.g., CO2M) and are not appropriate for existing satellite sensors that are used for this project. The following is written in TR-GAD GHG, 2024: “Because these new requirements are for future missions, we use in this document (wherever possible) the requirements as have been formulated by the Climate Research Group (CRG) of the GHG-CCI project of ESA’s Climate Change Initiative. We use the latest version, which is the User Requirements Document (URD) referred to as ESA-CCI-GHG-URD, 2024. |
To obtain a statement if a certain TR is met or not - or if it is "partially met" - several uncertainties are considered:
The following discussion is limited to "accuracy" and "stability" as these are the most critical / important data quality figures of merit (FoM) and because the TRs have been defined for them.
The TRs are the following (see also TR-GAD GHG, 2024):
The term "accuracy" as used here means "relative accuracy" or "relative bias". For many applications (e.g., trend assessments or studies related to regional enhancements) a possible global offset is not critical but spatio-temporal biases are highly relevant. For example, for trend assessments the relative accuracy between different time periods is important (i.e., temporal biases would be critical) and for studies related to regional enhancements the spatial difference is important (i.e., spatial biases would be critical). Therefore, we focus in our performance assessments on “relative accuracy” rather than “absolute accuracy” (see also TRD-GAD GHG, 2024). Nevertheless, the global offset (a single number per product) has been determined and is reported in this document (and can be considered by the users if needed).
The relative accuracy is estimated from mean biases as obtained at the various TCCON validation sites as explained in detail in Section 1.2. The estimated achieved accuracy is in the following referred to as “ACC”. To compare this estimated achieved accuracy ACC with the TR requirement, one cannot simply compare the 2 numbers (by computing achieved minus required accuracy) but has to consider the uncertainty of the accuracy estimate. This uncertainty comes from the uncertainty of the reference data (here TCCON) and the uncertainty of the comparison method (e.g., colocation method and its representativity error). In the following the uncertainty of the accuracy estimate is referred to as “UNC_ACC” and we explain how it is computed and how it is used to estimate the probability that the accuracy target requirement is met.
The uncertainty of the TCCON reference data (see Wunch et al. (2010), but also the discussions of this uncertainty related to the use of TCCON data for the validation of satellite retrievals in Buchwitz et al., 2015, 2016, and Dils et al., 2014) is:
These uncertainties are increased by 50% to also consider other error sources, especially error of the comparison method such as the representativity error. The assumed uncertainty ("UNC_ACC") of the estimated accuracy value ("ACC") are therefore:
In summary, we now have ACC +/- UNC_ACC (1-sigma) for the estimated relative accuracy or spatio-temporal bias and its uncertainty. These values are interpreted as the mean and the standard deviation of an underlying probability density function (pdf).
ACC is a non-negative number and the Target Requirement (TR) for accuracy defines an “acceptable range” or interval of “acceptable” accuracy values as [0, TR[, i.e., in order to meet the requirements ACC shall be smaller than TR but will be larger than (or equal to) zero. Because of this non-negativity, ACC cannot be distributed according to a Gaussian (“normal”) probability density function (pdf) (esp. if the mean is much smaller than the standard deviation) but it may be reasonable to assume that the overall distribution is a lognormal distribution (last accessed 15/11/2023), with parameters selected such that the lognormal pdf is very similar to a Gaussian pdf if the mean is on the order or larger than the standard deviation.
The probability density function (pdf) of the lognormal distribution is:
y = f(x|\mu, \sigma) = \frac{1}{x \sigma \sqrt{2 \pi}} \exp\left(- \frac{(\log x - \mu)^2}{2 \sigma^2}\right), \quad \text{for} \ x \ > \ 0. \qquad\qquad\qquad\qquad\text{(11)} |
The lognormal distribution has parameters µ and σ, which are related to parameters mean m = ACC and variance ν = UNC_ACC2 as follows:
\mu = \log \left( \frac{m^2}{\sqrt{\nu + m^2}} \right), \qquad\qquad\qquad\qquad\text{(12)} |
\sigma = \sqrt{\log \left( \frac{\nu}{m^2} + 1 \right)}. \qquad\qquad\qquad\qquad\text{(13)} |
The cumulative distribution function (cdf) of the lognormal distribution is:
P = F(x|\mu, \sigma) = \frac{1}{\sigma \sqrt{2 \pi}} \int_0^x \frac {1}{t} \exp\left(- \frac{(\log t - \mu)^2}{2 \sigma^2}\right) \text{d}t, \quad \text{for} \ x \ > \ 0. \qquad\qquad\qquad\qquad\text{(14)} |
This function is used to compute the probability, that the accuracy requirement is met, see Figure 1 for XCO2 and Figure 2 for XCH4.

Figure 1: Probability that the XCO2 accuracy TR is met as a function of the achieved accuracy.
Figure 2: Probability that the XCH4 accuracy TR is met as a function of the achieved accuracy.
For the TR assessment, the stability assessment is limited to the linear bias trend / drift.
As for the accuracy assessment, it is assumed that the value for stability has been obtained assuming error free TCCON observations and an error free comparison method. In contrast to the accuracy assessment approach, it is assumed that the uncertainty of the stability value is known (it corresponds to the (1-sigma) slope (SLO) error of the linear fit). The result of the stability assessment is: STA +/- UNC_SLO.
To consider the uncertainty of the reference data we assume that the TCCON data approximately meet the following stability requirements:
These uncertainties need to be added quadratically (via Root-Sum-Square (RSS)) to UNC_SLO to obtain the overall uncertainty UNC_STA.
As shown in Table S-1 for XCO2 and Table S-2 for XCH4 in column "Long-term drift" in document PVIRv5 (Buchwitz et al., 2017) typical values for STA +/- UNC_SLO are (if the uncertainty is converted to 1-sigma):
These values are listed here only for illustration (the exact value depends on product and assessment method).
Quadratically adding the assumed TCCON uncertainty gives for this example for STA +/- UNC_STA:
In contrast to ACC, STA can also be negative and we use a Gaussian probability density function N(x, mean=STA, sigma=UNC_STA) to compute the probability that the stability TR is met. This probability is the integral of N over the interval as defined by the stability TR requirement, i.e., interval [-TR, +TR], or simply the difference between two different values of the cumulative distribution function Nc(x, mean=STA, sigma=UNC_STA) (namely at x=TR and x=-TR). The probability P that the stability TR is met for XCO2 for a given value of STA is therefore for this example: P(STA) = Nc (+0.5, mean=+0.1, sigma=0.2) – Nc(-0.5, mean=+0.1, sigma=0.2) = 97%. This means that in these cases it is almost certain that the stability TR is met.
Figure 3 shows typical probability functions.
Figure 3: Probability functions used to obtain the probability that the stability requirement is met. Top: for XCO2. Bottom: for XCH4.
The TCCON network (see also the TCCON wiki pages for the TCCON Sites and for the Sites Pages) consists of the sites shown in Figure 4. It is relatively dense in the USA, in Europe and in Japan, but overall the TCCON network is relatively sparse (e.g., no or only very few sites in Russia, South America and Africa) and does not cover all areas with conditions that (can) affect the quality of the satellite XCO2 and XCH4 retrievals (e.g., deserts due to their high surface albedo combined with potentially high amounts of specific aerosol types such as desert dust storm mineral aerosols). Typically, the TCCON network underrepresents desert-like surfaces, open oceans, the tropics and the southern hemisphere in general.
It should also be noted that some bias correction methods of the individual L2 products contributing to EMMA use TCCON data, which can reduce the independence between the satellite product and the validation data set to some degree.
The TCCON project started in 2004 and the number of operational sites has increased over time. The TCCON Network provides temporally dense observations, but delays in data availability can limit their timeliness for validation purposes.
Figure 4: Location of TCCON sites. Source: https://tccondata.org/.
The TCCON network is the core reference network for the validation of the satellite XCO2 and XCH4 retrievals and is therefore essential for this part of the C3S service.
However, several limitations affect its current use for validation:
To compare the XGHG O4M v5.1 and v4.6 data products, they were converted to the same resolution. For that, the XGHG variable of v5.1 was regridded to a 5ºx5º spatial grid using a weighted average, where the weights were the number of L2 observations within each 1ºx1º grid box normalized to the total number of L2 observations within the corresponding 5ºx5º grid box.
For a qualitative comparison, some examples of global maps for the original v5.1 products, the re-gridded v5.1 products and the v4.6 products are shown. Additionally, the re-gridded v5.1 products and the v4.6 products are brought to the same sampling to plot the time series for different latitude bands.
For a more quantitative comparison, the re-gridded v5.1 products are plotted against the v4.6 products and fitted to a straight line.
The results of these comparisons are shown in Section 2.3 for XCO2 and Section 2.4 for XCH4.
In this section, detailed validation results are shown. The validation results for the Level 3 XCO2 product are presented in Section 2.1 and the XCH4 validation results are shown in Section 2.2. For each data product a set of well defined FoMs is computed to summarize the validation results.
The validation is based on comparisons with TCCON XCO2 and XCH4 retrievals. For the results presented in this document, the TCCON station IDs as shown in Table 1 have been used to name each corresponding TCCON station.
Table 1: Station IDs corresponding to each TCCON Station name.
Station ID | Station name |
|---|---|
ny | Ny-Ålesund |
so | Sodankylä |
et | East Trout Lake |
bi | Bialystok |
pr | Paris |
ka | Karlsruhe |
or | Orleans |
gm | Garmisch-Partenkirchen |
pa | Park Falls |
rj | Rikubetsu |
xh | Xianghe |
oc | Lamont |
tk | Tsukuba_tk |
| df | Edwards |
ni | Nicosia |
js | Saga |
ci+jc+jf | Pasadena_ci + Pasadena_jc + Pasadena_jf |
hf | Hefei |
bu | Burgos |
db | Darwin |
ra | Reunion Island |
wg | Wollongong |
lh+ll+lr | Lauder_lh + Lauder_lh + Lauder_lr |
Figure 5 shows all 11338 co-located OBS4MIPS and TCCON XCO2 gridded results used for the validation study. One can see that the temporal sampling differs from site to site and that the L3 OBS4MIPS XCO2 product captures the year-to-year increase and the seasonal features well.
The overall agreement of the OBS4MIPS data with TCCON data at all sites is illustrated in Figure 6 and Figure 7. Figure 6 shows the histogram of the difference OBS4MIPS – TCCON, displaying a near Gaussian distribution with a center at 0.22 ppm and a standard deviation of 1.26 ppm. The OBS4MIPS vs. TCCON plot in Figure 7 shows a pronounced clustering along the one-to-one line. This is supported by a good agreement of the orthogonal distance regression with the one to-one line and high Pearson correlation coefficient of 0.9788. These results provide a first rough overview of the agreement between the OBS4MIPS XCO2 dataset with TCCON.
The results of all site performance statistics as well as the summarizing performance statistics are illustrated in Figure 8 and listed in Table 2. The Product Quality Summary Table for the OBS4MIPS XCO2 product is shown as Table 3.

Figure 5: Co-located OBS4MIPS and TCCON XCO2 results used for the validation study.

Figure 6: Normalized histogram of the difference XCO2 OBS4MIPs minus TCCON.

Figure 7: XCO2 OBS4MIPS vs. TCCON data, including one-to-one line (black), orthogonal distance regression (ODR, red), and Pearson correlation coefficient.

Figure 8: Validation results for XCO2 OBS4MIPS monthly averages. From left to right, the figure shows the per site performance statistics explained in Section 1.2.1, i.e. regional
(\Delta_{reg}), |
seasonal
(\Delta_{sea}), |
and spatiotemporal biases
(\Delta_{spt}), |
the linear drift
(\Delta_{dri}), |
the single cell
(\sigma) |
and reported precision
(\sigma_{rep}) |
and the number of soundings ( # ). TCCON sites are ordered from top to bottom by average latitude of the co-located satellite soundings. The last row includes the summarizing performance statistics as defined in Section 1.2.2.
Table 2: Validation results for XCO2 OBS4MIPS. From left to right, the table shows the per site performance statistics explained in Section 1.2.1, i.e. regional
(\Delta_{reg}), |
seasonal
(\Delta_{sea}), |
and spatiotemporal biases
(\Delta_{spt}), |
the linear drift
(\Delta_{dri}), |
the single cell
(\sigma) |
and reported precision
(\sigma_{rep}) |
and the number of soundings ( # ). TCCON sites are order from top to bottom by average latitude of the co-located satellite soundings. The last row includes the summarizing performance statistics as defined in Section 1.2.2.
Station | Δreg [ppm] | Δsea [ppm] | Δspt [ppm] | Δdri [ppm/year] | σ [ppm] | σrep [ppm] | # |
|---|---|---|---|---|---|---|---|
| ny | -0.42 | 0.36 | 0.56 | -0.11 | 2.07 | 1.91 | 166 |
| so | -0.25 | 0.07 | 0.26 | 0.02 | 2.26 | 1.93 | 730 |
| et | 0.58 | 0.14 | 0.60 | -0.08 | 2.18 | 1.64 | 689 |
| bi | 0.24 | 0.24 | 0.34 | 0.18 | 2.28 | 1.71 | 289 |
| ka | 0.30 | 0.30 | 0.42 | 0.00 | 2.00 | 1.60 | 273 |
| pr | 0.54 | 0.39 | 0.66 | -0.06 | 2.08 | 1.57 | 347 |
| gm | 0.75 | 0.36 | 0.83 | 0.11 | 1.57 | 1.75 | 173 |
| or | 0.76 | 0.24 | 0.80 | 0.03 | 2.05 | 1.65 | 630 |
| pa | 0.18 | 0.45 | 0.48 | -0.03 | 2.15 | 1.74 | 1034 |
| xh | 1.15 | 0.23 | 1.18 | 0.03 | 2.76 | 1.71 | 255 |
| oc | 0.36 | 0.14 | 0.38 | 0.07 | 1.67 | 1.54 | 1583 |
| tk | 0.54 | 0.35 | 0.64 | 0.16 | 1.80 | 1.74 | 261 |
| ni | 0.16 | 0.12 | 0.20 | -0.03 | 1.17 | 1.52 | 571 |
| df | 0.72 | 0.12 | 0.73 | 0.02 | 1.35 | 1.39 | 732 |
| jc+ci+jf | -0.66 | 0.46 | 0.80 | -0.06 | 1.91 | 1.57 | 656 |
| js | 0.69 | 0.14 | 0.71 | 0.24 | 1.67 | 1.73 | 587 |
| bu | 0.10 | 0.36 | 0.38 | 0.05 | 1.08 | 1.58 | 343 |
| db | 0.01 | 0.06 | 0.06 | -0.16 | 1.38 | 1.54 | 764 |
| ra | 0.19 | 0.22 | 0.29 | -0.19 | 0.98 | 1.55 | 400 |
| wg | 0.12 | 0.05 | 0.13 | -0.09 | 1.24 | 1.65 | 559 |
| lh+lr+ll | 0.09 | 0.25 | 0.27 | -0.10 | 1.40 | 1.54 | 296 |
| Summary | 0.29 ± 0.42 | 0.24 | 0.48 | 0.00 ± 0.11 | 1.82 | 1.65 | 11338 |
The validation results show that there is only a small overall average station bias of 0.29 ppm. Regional biases estimated from the site-to-site bias variability amount to 0.42 ppm. The average seasonal and spatiotemporal bias amounts to 0.24 ppm and 0.48 ppm, respectively. The overall linear drift of 0.00 ppm/year is much smaller than its site-to-site variability of 0.11 ppm/year and, therefore, considered not significant. The uncertainty ratio, i.e. the ratio between the single grid cell precision,
\sigma, |
and the reported uncertainty,
\sigma_{rep}, |
is 1.10, which is close to unity, indicating good agreement between the OBS4MIPS reported uncertainty and the overall precision.
Table 3: Product Quality Summary Table for product XCO2_OBS4MIPS.
Product Quality Summary Table for Product: XCO2_OBS4MIPS Level: 3, Version: 5.1, Time period covered: 01.2003 – 12.2024 | ||||
|---|---|---|---|---|
Parameter [unit] | Achieved performance | Requirement | TR | Comments |
Overall uncertainty [ppm] | 1.82 | - | - | No requirement but small value expected for a high quality data product. |
Mean bias [ppm] | 0.29 | - | - | No requirement but value close to zero expected for a high quality data product. |
Accuracy: Relative systematic error [ppm] | Spatio-temporal bias: 0.48 (1-sigma) | < 0.5 | Probability that accuracy TR is met: 70% | - |
Stability: Linear bias trend [ppm/year] | 0.00 +/- 0.11 (1-sigma) | < 0.5 | Probability that stability TR is met: 97% | - |
The probability that the 0.5 ppm accuracy requirement is met is 70%.
The probability that the 0.5 ppm/year stability requirement is met is 97%.
Overall, this product has therefore reasonable accuracy and high stability.
Figure 9 shows all 19246 co-located OBS4MIPS and TCCON XCH4 gridded results used for the validation study. One can see that the temporal sampling differs from site to site and that the L3 OBS4MIPS XCH4 product captures the year-to-year increase and the seasonal features well.
The overall agreement of the OBS4MIPS data with TCCON data at all sites is illustrated in Figure 10 and Figure 11. The histogram of the difference OBS4MIPS – TCCON (Figure 10) shows a near Gaussian distribution with a center at -7.07 ppb and a standard deviation of 8.08 ppb. The OBS4MIPS vs. TCCON plot (Figure 11) shows a pronounced clustering along the one-to-one line. This is supported by a good agreement of the orthogonal distance regression with the one to-one line and high Pearson correlation coefficient of 0.9702. These results provide a first rough overview of the agreement between the OBS4MIPS XCH4 dataset with TCCON.
The results of all site performance statistics as well as the summarizing performance statistics are illustrated in Figure 12 and listed in Table 4.
The Product Quality Summary Table for the OBS4MIPS XCH4 product is shown as Table 5.

Figure 9: Co-located OBS4MIPS and TCCON XCH4 results used for the validation study.

Figure 10: Normalized histogram of the difference XCH4 OBS4MIPs minus TCCON.

Figure 11: XCH4 OBS4MIPS vs. TCCON data, including one-to-one line (black), orthogonal distance regression (ODR, red), and Pearson correlation coefficient.

Figure 12: Validation results for OBS4MIPS monthly averages. From left to right, the figure shows the per site performance statistics explained in Section 1.2.1, i.e. regional
(\Delta_{reg}), |
seasonal
(\Delta_{sea}), |
and spatiotemporal biases
(\Delta_{spt}), |
the linear drift
(\Delta_{dri}), |
the single cell
(\sigma) |
and reported precision
(\sigma_{rep}) |
and the number of soundings ( # ). TCCON sites are ordered from top to bottom by average latitude of the co-located satellite soundings. The last row includes the summarizing performance statistics as defined in Section 1.2.2.
Table 4: Validation results for XCH4 OBS4MIPS. From left to right, the table shows the per site performance statistics explained in Section 1.2.1, i.e. regional
(\Delta_{reg}), |
seasonal
(\Delta_{sea}), |
and spatiotemporal biases
(\Delta_{spt}), |
the linear drift
(\Delta_{dri}), |
the single cell
(\sigma) |
and reported precision
(\sigma_{rep}) |
and the number of soundings ( # ). TCCON sites are order from top to bottom by average latitude of the co-located satellite soundings. The last row includes the summarizing performance statistics as defined in Section 1.2.2.
Station | Δreg [ppb] | Δsea [ppb] | Δspt [ppb] | Δdri [ppb/year] | σ [ppb] | σrep [ppb] | # |
|---|---|---|---|---|---|---|---|
| ny | -4.70 | 3.52 | 5.87 | -1.30 | 13.34 | 14.03 | 1149 |
| so | -7.13 | 2.18 | 7.46 | -0.09 | 11.42 | 12.50 | 1844 |
| et | -1.26 | 3.30 | 3.53 | -0.86 | 8.52 | 10.74 | 1845 |
| bi | -6.44 | 1.82 | 6.70 | -0.64 | 10.43 | 10.77 | 666 |
| ka | -11.68 | 2.60 | 11.97 | 0.20 | 7.24 | 9.01 | 475 |
| pr | -9.09 | 2.28 | 9.37 | 0.60 | 7.52 | 8.48 | 638 |
| gm | -0.98 | 3.73 | 3.86 | 0.29 | 8.61 | 11.08 | 492 |
| or | -6.14 | 1.41 | 6.30 | 0.12 | 7.67 | 9.80 | 1517 |
| pa | -8.00 | 4.26 | 9.06 | -0.08 | 12.34 | 14.04 | 2186 |
| rj | -1.23 | 1.22 | 1.74 | 0.86 | 8.21 | 10.70 | 187 |
| xh | 0.74 | 9.12 | 9.15 | 0.73 | 8.15 | 8.23 | 448 |
| oc | -8.77 | 0.53 | 8.78 | -0.19 | 6.74 | 7.94 | 2085 |
| tk | -11.44 | 4.26 | 12.21 | 0.92 | 8.59 | 10.66 | 269 |
| ni | -4.54 | 0.79 | 4.61 | 0.61 | 6.73 | 8.56 | 668 |
| df | -3.88 | 3.40 | 5.16 | 0.66 | 4.05 | 8.03 | 710 |
| jc+ci+jf | -10.29 | 2.99 | 10.71 | 0.55 | 9.50 | 12.53 | 871 |
| js | -6.58 | 1.71 | 6.79 | 1.21 | 10.42 | 11.89 | 833 |
| bu | -5.48 | 0.93 | 5.56 | -0.45 | 8.17 | 12.74 | 432 |
| db | -7.53 | 0.93 | 7.59 | 0.20 | 7.74 | 9.90 | 828 |
| ra | -8.37 | 2.83 | 8.83 | -0.68 | 8.59 | 11.48 | 138 |
| wg | -9.25 | 2.67 | 9.63 | -0.22 | 11.15 | 12.05 | 579 |
| lh+lr+ll | -8.65 | 2.47 | 8.99 | -0.08 | 8.02 | 14.09 | 386 |
| Summary | -6.39 ± 3.37 | 2.68 | 4.31 | 0.11 ± 0.62 | 9.01 | 11.05 | 19246 |
The validation results show that there is only a small overall average station bias of -6.29 ppb. Regional biases estimated from the site-to-site bias variability amount to 3.37 ppb. The average seasonal and spatio-temporal bias amounts to 2.68 ppb and 4.31 ppb, respectively. The overall linear drift of 0.11 ppb/year is much smaller than its site-to-site variability of 0.62 ppb/year and, therefore, considered not significant.
The uncertainty ratio, the ratio between the single grid cell precision,
\sigma, |
and the reported uncertainty,
\sigma_{rep}, |
is 0.82, which is close to unity, indicating good agreement between the OBS4MIPS reported uncertainty and the overall precision.
Table 5: Product Quality Summary Table for product XCH4_OBS4MIPS.
Product Quality Summary Table for Product: XCH4_OBS4MIPS Level: 3, Version: 5.1, Time period covered: 01.2003 – 12.2024 | ||||
|---|---|---|---|---|
Parameter [unit] | Achieved performance | Requirement | TR | Comments |
Overall uncertainty [ppb] | 9.01 | - | - | No requirement but small value expected for a high quality data product. |
Mean bias [ppb] | -6.39 | - | - | No requirement but value close to zero expected for a high quality data product. |
Accuracy: Relative systematic error [ppb] | Spatio-temporal bias: 4.31 (1-sigma) | < 10 | Probability that accuracy TR is met: 91% | - |
Stability: Linear bias trend [ppb/year] | 0.11 +/- 0.62 (1-sigma) | < 3 | Probability that stability TR is met: 99% | - |
The probability that the 10 ppb accuracy requirement is met is 91%.
The probability that the 3 ppb/year stability requirement is met is 99%.
Overall, this product has therefore very good accuracy and high stability.
Examples of global maps for the v5.1 product at its original resolution, the re-gridded v5.1 product to match the v4.6 resolution and the v4.6 product are shown in Figure 13 (for May 2020) and Figure 14 (for July 2020). In the figures, we can see that both the v5.1 and v4.6 datasets present very similar features. For example, Figure 13 shows global maps for May 2020, corresponding to the beginning of the vegetation growing season in the northern hemisphere, i.e. when the atmospheric CO2 concentration typically reaches its maximum values, leading to a pronounced north-south gradient in XCO2. Figure 14 shows global maps for July 2020, after the photosynthetic CO2 uptake by the plants grown in the northern hemisphere, leading to a decrease in the atmospheric CO2 concentration and an inversion of the north-south gradient. Regarding the spatial coverage, we can appreciate in both Figure 13 and Figure 14 that the (re-gridded) v5.1 product has a more complete coverage.

Figure 13: Example of a Obs4MIPs XCO2 global map for May 2020 showing (a) v5.1 in its original 1°x1° spatial resolution, (b) v5.1 re-gridded to match the v4.6 5°x5° resolution, and (c) v4.6 in its original 5°x5° spatial resolution.
Figure 14: Same as Figure 13, but showing an Obs4MIPs XCO2 global map for July 2020.
The plots of the re-gridded v5.1 products against the v4.6 products are shown in Figure 15, where we can see that most data lie near the one-to-one line. The fit to a straight line yields both a slope and coefficient of determination very close to one, showing good agreement between both datasets. For the lowest XCO2 values (below approximately 380 ppm) both datasets agree almost perfectly. These values correspond to the period in which SCIAMACHY BESD is the reference and the only available product, so both datasets are almost identical in this period because there is no ensemble from which to compute the empirical spatio-temporal adjustment.

Figure 15: Scatter plot of Obs4MIPs v4.6 XCO2 against Obs4MIPs v5.1 XCO2 (re-gridded to the v4.6 resolution). Each point represents a grid box (5°x5°) containing data in both datasets. The data was fitted to a straight line (displayed as a red line), yielding both a slope and a coefficient of determination (r2) very close to one (see the shaded box). Marker colours indicate the number of counts (note the logarithmic scale of the colour bar) in a 2-D histogram, showing that the data concentrates near the one-to-one line (black).
Finally, Figure 16 shows the time series for three latitude bands for both v5.1 and v4.6. The plot shows, for each month and latitude band, the mean XCO2 values. Only grid boxes with XCO2 data from both v4.6 and the re-gridded v5.1 products were used for the plot. Both datasets exhibit very similar behaviour in the time series.

Figure 16: Time series for XCO2 Obs4MIPs v5.1 (blue) and superposed XCO2 Obs4MIPs v4.6 (orange). The dashed gray vertical lines mark the changes in the reference product, i.e. from the beginning of the dataset until the end of March 2009, SCIAMACHY BESD was used as the reference; from April 2009 until the end of August 2014, GOSAT FOCAL was the reference; and from September 2014 until the end of the dataset period, the reference product was OCO-2 FOCAL. Three latitude bands were used, shown in the corresponding panels: panel (a) shows the latitude band from 20º N - 60º N, panel (b) shows 20º S to 20º N, and panel (c) shows 60º S to 20º S.
The random error, accuracy and stability estimates obtained for the v5.1 and v4.6 XCO2 datasets are shown in Table 6. Overall, the direction of change in the mean bias and stability suggests improvement whilst there is regression in the accuracy. However, direct comparison of the parameters obtained for the different versions have nuances. First of all, the time periods covering the two versions of the datasets is different, as the v5.1 datasets covers one year more than the v4.6 datasets. Additionally, the definition of collocations used for the validation of both versions of the datasets is slightly different, which together with the different spatial coverage of the datasets for the different versions, leads to the use of different sets of collocations, and even different TCCON stations, for the validation. As a result, and taking into account also the TCCON uncertainties, we consider the small changes between versions in the obtained mean bias, accuracy and stability parameters as non-significant, showing consistency between versions. Finally, a direct comparison of the random error estimates does not reflect a change in the performance of the dataset due to the different spatial resolution of the v5.1 dataset (1º x 1º) and the v4.6 dataset (5º x 5º), since higher random errors are expected for higher spatial resolution.
Table 6: Comparison of random error, accuracy and stability estimates obtained from v5.1 and v4.6 XCO2 datasets, together with an assessment of their corresponding change.
| Parameter | v5.1 | v4.6 | Assessment |
|---|---|---|---|
| Random error (precision) (ppm) | 1.82 | 0.91 | N/A |
| Mean bias (ppm) | 0.29 | 0.34 | Improvement |
| Accuracy: Relative systematic error (ppm) | 0.48 | 0.40 | Regression |
| Stability: Linear bias trend (ppm/year) | 0.00 | 0.02 | Improvement |
Analogously to Section 2.3., examples of global maps for the XCH4 v5.1 product in its original resolution, the re-gridded v5.1 product and the v4.6 product are shown in Figure 17 (for April 2020) and Figure 18 (for October 2020). As for XCO2, both the v5.1 and v4.6 datasets represent similar features, such as the spatial latitudinal gradients or regionally enhanced values. Additionally, we can appreciate in both Figure 17 and Figure 18 a significant improvement in the spatial coverage of the re-gridded v5.1 dataset with respect to v4.6.

Figure 17: Same as Figure 13, but showing an Obs4MIPs XCH4 global map for April 2020.
Figure 18: Same as Figure 13, but showing an Obs4MIPs XCH4 global map for October 2020.
The plots of the re-gridded v5.1 products against the v4.6 products are shown in Figure 19, where we can see, as for XCO2, that most data lie near the one-to-one line. The fit to a straight line yields both a slope and correlation coefficient very close to one, showing good agreement between both datasets. For the lowest XCH4 values (below approximately 1630 ppb) both datasets agree almost perfectly. These values correspond to the period in which SCIAMACHY WFMD is the reference and the only available product, so both datasets are almost identical in this period because there is no ensemble from which to compute the empirical spatio-temporal adjustment.

Figure 19: Same as Figure 13, but for Obs4MIPs v4.6 XCH4 against Obs4MIPs v5.1 XCH4 (re-gridded to the v4.6 resolution).
Figure 20 shows the time series for three latitude bands for both v5.1 and v4.6. Analogous to Figure 16, the plot shows, for each month and latitude band, the mean XCH4 values. Only grid boxes with XCH4 data from both v4.6 and the re-gridded v5.1 products were used for the plot. Both datasets exhibit very similar behaviours in the time series, showing only a small offset in the three latitude bands until April 2009 (i.e. the time in which SCIAMACHY BESD is the reference and only avalilable product), and a very small discrepancy in the latitude band 20°S-20°N towards the end of the data series.

Figure 20: Same as Figure 14, but for time series for XCH4 Obs4MIPs v5.1 (blue) and superposed XCH4 Obs4MIPs v4.6 (orange). The dashed gray vertical lines mark the changes in the reference product, i.e. from the beginning of the dataset until the end of March 2009, SCIAMACHY WFMD was used as the reference; from April 2009 until the end of April 2018, GOSAT FOCAL PR was the reference; and from May 2018 until the end of the dataset period, the reference product was TROPOMI WFMD.
The random error, accuracy and stability parameters obtained for the v5.1 and v4.6 XCH4 datasets are shown in Table 7. The direction of change suggests regression in the mean bias and improvement in both accuracy and stability. However, as discussed in Sect 2.3 for XCO2, a comparison between the estimates of these parameters obtained for the different dataset versions is not straightforward, and also in this case, the changes are considered as non-significant, thereby showing consistency in the estimated parameters for both versions of the datasets. Also in this case, due to their different spatial resolution, a direct comparison of the random error estimates does not reflect a change in the performance of the datasets.
Table 7: Comparison of random error, accuracy and stability estimates obtained from v5.1 and v4.6 XCH4 datasets, together with an assessment of their corresponding change.
Parameter | v5.1 | v4.6 | Assessment |
|---|---|---|---|
| Random error (precision) (ppb) | 9.01 | 6.10 | N/A |
| Mean bias (ppb) | -6.39 | -6.29 | Regression |
| Accuracy: Relative systematic error (ppb) | 4.31 | 6.25 | Improvement |
| Stability: Linear bias trend (ppb/year) | 0.11 | 0.32 | Improvement |
The OBS4MIPS products analysed in this PQAR are merged products that were generated using various retrieval algorithms and satellite instruments (see Figures 2 and 3 in ATBD XGHG, 2026). Although the data were homogenized (ATBD XGHG, 2026), there may still be differences between the data products used, e.g. in sampling and data quality. This can lead to temporal or spatial changes in the characteristics of the OBS4MIPS products, which are, however, reflected in the estimated uncertainties.
In climate applications, it is important that the time series of a parameter studied are significantly longer than the changes caused by its natural variability. For this reason, climate scientists usually analyse at least several decades. The data analysed in this PQAR span more than two decades and the user requirements for stability are also met.
The OBS4MIPS data were thoroughly validated with co-located TCCON data in this PQAR. However, due to the spatially sparse sampling of TCCON sites (Figure 4), some geophysical conditions are underrepresented in the validation. These include, for example, deserts, some tropical regions and the southern hemisphere in general. Figures 2-5 of PUGS XGHG, 2026 show that the uncertainty (mainly due to the scatter between algorithms) is the highest in some of these regions.
In the past, predecessor versions of the OBS4MIPS data have already been used for climate applications such as the annual Copernicus ESOTC (European State of the Climate) Greenhouse Gas Concentrations report (ESOTC GHG, 2023). These data products were used to compute global average annual atmospheric concentrations and their year-to-year increase for both CO2 and CH4.
Previous versions of the OBS4MIPS XCO2 product have also been used in the peer-reviewed publications of Lauer et al. (2017) and Gier et al. (2020). In these publications, the OBS4MIPS XCO2 products were used to evaluate the performance of CMIP (Coupled Model Intercomparison Project) models in its Phase 5 (CMIP5) in Lauer et al. (2017), and both its Phases 5 and 6 (CMIP5 and CMIP6) in Gier et al. (2020).
Quality assessments performed by C3S quality control evaluators on previous versions of the OBS4MIPS XCO2 and XCH4 products are also available here.
This section summarizes the achieved data quality including comparisons with the required data quality.
The development of satellite-derived gridded ECV products in OBS4MIPS format started in the framework of ESA’s Climate Change Initiative (CCI) via the GHG-CCI project (last access: 3-Mar-2025) (see also Reuter et al., 2020). The envisaged main application is comparison with climate models. The GHG-CCI project team therefore proposed several years ago to generate XCO2 and XCH4 products in OBS4MIPS format at the described spatio-temporal resolution. That spatio-temporal resolution was assumed to be appropriate for climate model comparisons considering also the characteristics of existing satellites. It was later confirmed by scientific studies (e.g., Lauer et al., 2017, and Gier et al., 2020) that the generated products were in fact very useful for the envisaged application.
Table 8 compares the required and the achieved performance for random error (precision), required accuracy (in terms of spatio-temporal biases) and stability (in terms of linear bias drift). The data quality level is also summarized in Section 5.1 for XCO2 and Section 5.2 for XCH4 (see Section 1.3 for a more detailed explanation on the reported probabilities).
For the random error, two requirements are provided: for single observations and for 1000 km x 1000 km monthly averages. The requirements available for the random error of gridded data are for a much coarser resolution (1000 km x 1000 km, which would be in the order of magnitude of 10º x 10º) than that of the XGHG v5.1 products (1º x 1º). At finer resolutions, the amount of L2 observations in each grid cell decreases, leading to less independent data within each grid cell available for averaging, and therefore a higher random error. In fact, some grid cells contain only one or a few L2 observation for averaging. In other cases, despite containing a high number of L2 observations, they were measured in very close temporal proximity, so that they are highly correlated and effectively account only for one of very few days of data. Therefore, none of the two available requirements for random error applies to the XGHG O4M v5.1 datasets, but realistic values would lie between both requirements. It is the case for XCO2, which is within the breakthrough requirement for single observations, but does not fulfil the requirement for averaged data on a 1000 km x 1000 km monthly grid, despite being relatively close to the threshold requirement. For XCH4, both requirements are fulfilled. |
Table 8:
Compliance with User Requirements. XCO2 and XCH4 random (“precision”), systematic error and stability requirements (from TR-GAD GHG, 2024). Abbreviations: G=Goal, B=Breakthrough, T=Threshold requirement. §) Required systematic error after an empirical bias correction that does not use the verification data. #) Required systematic error and stability after bias correction, where bias correction is not limited to the application of a constant offset / scaling factor. |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
The validation of Level 3 product XCO2_OBS4MIPS can be summarized as follows:
|
The validation of Level 3 product XCH4_OBS4MIPS can be summarized as follows:
|
ATBD MTGHG, 2024: Crevoisier, C., Meilhac, N., C3S Greenhouse Gas (GHG: MTCO2 v10.1 & MTCH4 v10.2): Algorithm Theoretical Basis Document (ATBD)
ATBD XGHG, 2026: Reuter , M., Fuentes Andrade, B., Buchwitz, M., C3S Greenhouse Gas (GHG: CO2 & CH4) v5.1: Algorithm Theoretical Basis Document (ATBD), C3S project C3S2_313a_DLR, 2025. Link: https://confluence.ecmwf.int/x/PqKRGw
Bojinski et al., 2014: Bojinski, S., M. Verstraete, T.C. Peterson, C. Richter, A. Simmons, M. Zemp, The Concept of Essential Climate Variables in Support of Climate Research, Applications, and Policy. Bull. Amer. Meteor. Soc., 95, 1431–1443. Available at http://journals.ametsoc.org/doi/pdf/10.1175/BAMS-D-13-00047.1, 2014.
Buchwitz et al., 2015: Buchwitz, M., Reuter, M., Schneising, O., Boesch, H., Guerlet, S., Dils, B., Aben, I., Armante, R., Bergamaschi, P., Blumenstock, T., Bovensmann, H., Brunner, D., Buchmann, B., Burrows, J.P., Butz, A., Chédin, A., Chevallier, F., Crevoisier, C.D., Deutscher, N.M., Frankenberg, C., Hase, F., Hasekamp, O.P., Heymann, J., Kaminski, T., Laeng, A., Lichtenberg, G., De Mazière, M., Noël, S., Notholt, J., Orphal, J., Popp, C., Parker, R., Scholze, M., Sussmann, R., Stiller, G.P., Warneke, T., Zehner, C., Bril, A., Crisp, D., Griffith, D.W.T., Kuze, A., O'Dell, C., Oshchepkov, S., Sherlock, V., Suto, H., Wennberg, P., Wunch, D., Yokota, T., Yoshida, Y., The Greenhouse Gas Climate Change Initiative (GHG-CCI): comparison and quality assessment of near-surface-sensitive satellite-derived CO2 and CH4 global data sets. Remote Sens. Environ. 162:344–362, http://dx.doi.org/10.1016/j.rse.2013.04.024, 2015.
Buchwitz et al., 2016: Buchwitz, M., Reuter, M., Schneising, O., Hewson, W., Detmers, R. G., Boesch, H., Hasekamp, O. P., Aben, I., Bovensmann, H., Burrows, J. P., Butz, A., Chevallier, F., Dils, B., Frankenberg, C., Heymann, J., Lichtenberg, G., De Mazière, M., Notholt, J., Parker, R., Warneke, T., Zehner, C., Griffith, D. W. T., Deutscher, N. M., Kuze, A., Suto, H., and Wunch, D.:, Global satellite observations of column-averaged carbon dioxide and methane: The GHG-CCI XCO2 and XCH4 CRDP3 data, Remote Sensing of Environment (in press), Special Issue on Essential Climate Variables, DOI: 10.1016/j.rse.2016.12.027, (link: http://dx.doi.org/10.1016/j.rse.2016.12.027
), 2016.
Buchwitz et al., 2017: ESA Climate Change Initiative (CCI) Product Validation and Intercomparison Report (PVIR) for the Essential Climate Variable (ECV) Greenhouse Gases (GHG) for data set Climate Research Data Package No. 4 (CRDP#4), Version 5.0, 9. Feb. 2017, 2017.
CMUG-RBD, 2012: Climate Modelling User Group Requirements Baseline Document, Deliverable 1.2, Number D1.2, ESA Climate Change Initiative (CCI), Version 2.0, 17 Dec 2012, 2012. Link: https://climate.esa.int/media/documents/CMUG_D1.2_URD_v2.0.pdf
Dils et al., 2014: B. Dils, M. Buchwitz, M. Reuter, O. Schneising, H. Boesch, R. Parker, S. Guerlet, I. Aben, T. Blumenstock, J. P. Burrows, A. Butz, N. M. Deutscher, C. Frankenberg, F. Hase, O. P. Hasekamp, J. Heymann, M. De Mazière, J. Notholt, R. Sussmann, T. Warneke, D. Griffith, V. Sherlock, D. Wunch :The Greenhouse Gas Climate Change Initiative (GHG-CCI): Comparative validation of GHG-CCI SCIAMACHY/ENVISAT and TANSO-FTS/GOSAT CO2 and CH4 retrieval algorithm products with measurements from the TCCON network, Atmos. Meas. Tech., 7, 1723-1744, 2014.
ESA-CCI-GHG-URD, 2024: Chevallier, F., Marshall, J., et al., User Requirements Document (URD) for the Essential Climate Variable (ECV) Greenhouse Gases (GHG), ESA Climate Change Initiative (CCI) GHG-CCI+ project, Version 4.0, 16-May-2024, pp. 40, 2024. Link: https://www.iup.uni-bremen.de/carbon_ghg/docs/GHG-CCIplus/URDv4/URDv4.0_GHG-CCI+.pdf
ESOTC GHG, 2023: European State of the Climate: Greenhouse gas concentrations, compiled by the Copernicus Climate Change Service (C3S) and the World Meteorological Organization (WMO). Link: https://climate.copernicus.eu/esotc/2023/greenhouse-gas-concentrations
GCOS-154: Global Climate Observing System (GCOS): SYSTEMATIC OBSERVATION REQUIREMENTS FOR SATELLITE-BASED DATA PRODUCTS FOR CLIMATE - 2011 Update - Supplemental details to the satellite-based component of the "Implementation Plan for the Global Observing System for Climate in Support of the UNFCCC (2010 Update)", December 2011, prepared by World Meteorological Organization (WMO), Intergovernmental Oceanographic Commission, United Nations Environment Programme (UNEP), International Council for Science, Doc.: GCOS 154, link: http://cci.esa.int/sites/default/files/gcos-154.pdf, 2011.
GCOS-195: Status of the Global Observing System for Climate, GCOS-195, 2015. Link: https://library.wmo.int/doc_num.php?explnum_id=7213
GCOS-200: The Global Observing System for Climate: Implementation Needs, World Meteorological Organization (WMO), GCOS-200 (GOOS-214), pp. 325. Link: http://unfccc.int/files/science/workstreams/systematic_observation/application/pdf/gcos_ip_10oct2016.pdf, 2016.
GCOS-245: The 2022 GCOS ECVs Requirements, WMO, pp. 244, 2022. Link: https://library.wmo.int/doc_num.php?explnum_id=11318
Gier et al., 2020: Gier, B. K., Buchwitz, M., Reuter, M., Cox, P. M., Friedlingstein, P., and Eyring, V.: Spatially resolved evaluation of Earth system models with satellite column-averaged CO2, Biogeosciences, 17, 6115-6144, https://doi.org/10.5194/bg-17-6115-2020
, 2020.
Lauer et al., 2017: Lauer, A., Eyring, V., Righi, M., Buchwitz, M., Defourny, P., Evaldsson, M., Friedlingstein, P., de Jeu, R., de Leeuw, G., Loew, A., Merchant, C. J., Mueller, B., Popp, T., Reuter, M., Sandven, S., Senftleben, D., Stengel, M., Van Roozendael, M., Wenzel, S., and Willen, U.: Benchmarking CMIP5modelswith a subset of ESA CCI Phase 2 data using the ESMValTool, Remote Sensing of Environment 203, 9-39, http://dx.doi.org/10.1016/j.rse.2017.01.007
, 2017.
Laughner et al., 2024: Laughner, J. L., Toon, G. C., Mendonca, J., Petri, C., Roche, S., Wunch, D., Blavier, J.-F., Griffith, D. W. T., Heikkinen, P., Keeling, R. F., Kiel, M., Kivi, R., Roehl, C. M., Stephens, B. B., Baier, B. C., Chen, H., Choi, Y., Deutscher, N. M., DiGangi, J. P., Gross, J., Herkommer, B., Jeseck, P., Laemmel, T., Lan, X., McGee, E., McKain, K., Miller, J., Morino, I., Notholt, J., Ohyama, H., Pollard, D. F., Rettinger, M., Riris, H., Rousogenous, C., Sha, M. K., Shiomi, K., Strong, K., Sussmann, R., Té, Y., Velazco, V. A., Wofsy, S. C., Zhou, M., and Wennberg, P. O.: The Total Carbon Column Observing Network's GGG2020 data version, Earth Syst. Sci. Data, 16, 2197–2260, https://doi.org/10.5194/essd-16-2197-2024, 2024.
National Research Council, 2004: National Research Council, Climate Data Records from Environmental Satellites: Interim Report 2004, 150 pp., ISBN: 978-0-309-09168-8, DOI: {+}https://doi.org/10.17226/10944+
, 2004.
Parkinson et al., 2006: Parkinson, C., A. Ward and M. King, Earth Science Reference Handbook, NASA, Washington DC, 2006.
PQAR MTGHG, 2024: Crevoisier, C., Meilhac, N., C3S Greenhouse Gas (GHG: MTCO2 v10.1 & MTCH4 v10.2): Product Quality Assessment Report (PQAR)
PUGS MTGHG, 2024: Crevoisier, C., Meilhac, N., C3S Greenhouse Gas (GHG: MTCO2 v10.1 & MTCH4 v10.2): Product User Guide and Specification (PUGS)
PUGS XGHG, 2026: Reuter , M., Fuentes Andrade, B., Buchwitz, M., C3S Greenhouse Gas (GHG: CO2 & CH4) v5.1: Product User Guide and Specification (PUGS), C3S project C3S2_313a_DLR, 2025. Link: https://confluence.ecmwf.int/x/H6iRGw
Reuter et al., 2011: M. Reuter, H. Bovensmann, M. Buchwitz, J. P. Burrows, B. J. Connor, N. M. Deutscher, D. W. T. Griffith, J. Heymann, G. Keppel-Aleks, J. Messerschmidt, J. Notholt, C. Petri, J. Robinson, O. Schneising, V. Sherlock, V. Velazco, T. Warneke, P. O. Wennberg, D. Wunch: Retrieval of atmospheric CO2 with enhanced accuracy and precision from SCIAMACHY: Validation with FTS measurements and comparison with model results. Journal of Geophysical Research - Atmospheres, 116, D04301, doi: 10.1029/2010JD015047, 2011.
Reuter et al., 2020: M. Reuter, M. Buchwitz, O. Schneising, S. Noël, H. Bovensmann, J.P. Burrows, H. Boesch, A. Di Noia, J. Anand, R.J. Parker, P. Somkuti, L. Wu, O.P. Hasekamp, I. Aben, A. Kuze, H. Suto, K. Shiomi, Y. Yoshida, I. Morino, D. Crisp, C.W. O'Dell, J. Notholt, C. Petri, T. Warneke, V.A. Velazco, N.M. Deutscher, D.W.T. Griffith, R. Kivi, D.F. Pollard, F. Hase, R. Sussmann, Y.V. Té, K. Strong, S. Roche, M.K. Sha, M. De Mazière, D.G. Feist, L.T. Iraci, C.M. Roehl, C. Retscher, and D. Schepers: Ensemble-based satellite-derived carbon dioxide and methane column-averaged dry-air mole fraction data sets (2003-2018) for carbon and climate applications, Atmos. Meas. Tech., https://www.atmos-meas-tech.net/13/789/2020
, 2020.
Rodgers, 2000: Rodgers, C. D.: Inverse Methods for Atmospheric Sounding: Theory and Practice, World Scientific Publishing, Singapore, 2000.
TR-GAD GHG, 2024: Buchwitz, M., et al., Target Requirement and Gap Analysis Document, Copernicus Climate Change Service (C3S) project on satellite-derived Essential Climate Variable (ECV) Greenhouse Gases (CO2 and CH4) data products (project C3S2_312a_Lot2), Version 5.6, 22-Mar-2024, pp. 87, 2024. Latest version: http://wdc.dlr.de/C3S_312b_Lot2/Documentation/GHG/C3S2_312a_Lot2_TRD-GAD_GHG_latest.pdf
Werscheck, 2015: Werscheck, M., EUMETSAT Satellite Application Facility on Climate Monitoring, C3S Climate Data Store workshop, Reading, UK, 3-6 March 2015. {+}http://www.ecmwf.int/sites/default/files/elibrary/2015/13546-existing-solutions-eumetsat-satellite-application-facility-climate-monitoring.pdf+![]()
Wunch et al. 2010: Wunch, D., Toon, G. C., Wennberg, P. O., Wofsy, S. C., Stephens, B. B., Fischer, M. L., Uchino, O., Abshire, J. B., Bernath, P., Biraud, S. C., Blavier, J.-F. L., Boone, C., Bowman, K. P., Browell, E. V., Campos, T., Connor, B. J., Daube, B. C., Deutscher, N. M., Diao, M., Elkins, J. W., Gerbig, C., Gottlieb, E., Griffith, D. W. T., Hurst, D. F., Jiménez, R., Keppel-Aleks, G., Kort, E. A., Macatangay, R., Machida, T., Matsueda, H., Moore, F., Morino, I., Park, S., Robinson, J., Roehl, C. M., Sawa, Y., Sherlock, V., Sweeney, C., Tanaka, T., and Zondlo, M. A.: Calibration of the Total Carbon Column Observing Network using aircraft profile data, Atmospheric Measurement Techniques, 3, 1351–1362, doi:10.5194/amt-3-1351-2010, URL http://www.atmos-meas-tech.net/3/1351/2010/
, 2010.
Wunch et al., 2011: Wunch, D., Toon, G. C., Blavier, J.-F. L., Washenfelder, R. A., Notholt, J., Connor, B. J., Griffith, D. W. T., Sherlock, V., and Wennberg, P. O.: The Total Carbon Column Observing Network (TCCON), Phil. Trans. R. Soc. A, 369, 2087–2112, doi:10.1098/rsta.2010.0240, 2011.
Wunch et al. 2015: Wunch, D., Toon, G.C., Sherlock, V., Deutscher, N.M., Liu, X., Feist, D.G., Wennberg, P.O., The Total Carbon Column Observing Network's GGG2014 Data Version. Carbon Dioxide Information Analysis Center, Oak Ridge National Laboratory, Oak Ridge, Tennessee, USA (available at: doi:10.14291/tccon.ggg2014.documentation.R0/1221662), 2015.
This document has been produced in the context of the Copernicus Climate Change Service (C3S). The activities leading to these results have been contracted by the European Centre for Medium-Range Weather Forecasts, operator of C3S on behalf of the European Union (Delegation Agreement signed on 11/11/2014 and Contribution Agreement signed on 22/07/2021). All information in this document is provided "as is" and no guarantee or warranty is given that the information is fit for any particular purpose. The users thereof use the information at their sole risk and liability. For the avoidance of all doubt , the European Commission and the European Centre for Medium - Range Weather Forecasts have no liability in respect of this document, which is merely representing the author's view. |