You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Current »

ECMWF open data is packed to travel: the number of bits used to store each value is set per parameter, so files are smaller without losing the information people use. From 20 October 2026, every field is set by the precision it actually needs, rather than inherited from the production and archive settings. The same per-parameter packing applies to all open data — 0.25° and 0.1°, IFS and AIFS.

What "bits per value" means

Every value, at every grid point, is stored in a fixed number of bits. More bits means finer steps between the values that can be represented — and larger files. Fewer bits means coarser steps and smaller files. The question is never "more or fewer" in the abstract; it is how fine each field actually needs to be.

Bits per valueDistinct levelsEffect
8256Coarsest steps, smallest files
124,096Fine steps
1665,536Finest steps, largest files

Why it is set per parameter

For a field you read directly — 2 m temperature, 10 m wind — a few bits are plenty: the rounding is far below the accuracy of the forecast itself (about 0.25 K for temperature, 0.3 hPa for mean sea-level pressure). But the same rounding behaves very differently once you compute with the field. Taking gradients — winds from pressure, dynamics from geopotential — amplifies small-scale rounding, and the smoother the field, the more it is amplified.

FieldTypical useHow much 8-bit rounding is amplified
2 m temperatureRead directlyabout 10×
Mean sea-level pressurePressure gradientsabout 20×
500 hPa geopotentialSmooth, dynamicalabout 130×

The field's own values barely move at low precision; the derivatives do. So fields read directly can use fewer bits, while smooth dynamical fields keep more. One blanket setting cannot serve both.

How each field is set

Every field is set to the fewest bits its use allows, and no fewer. Of 73 parameters:

  • 60 are reduced to a lower bit count — the removed bits sit below the field's useful precision, so the values people read, and compute with, are unchanged to well within their own accuracy.
  • 8 are kept at their current precision — gradient-sensitive fields (pressure, geopotential), categorical fields (precipitation type) and a few measured exceptions.
  • 5 static fields (land-sea mask, orography, bathymetry) are left unchanged for now — they are sent once per cycle, so the volume is negligible.

Precision-sensitive and dynamical fields keep the bits they need; nothing drops below the level where the field carries meaning.

Per-parameter settings

The full list. Bits per value is the setting from 20 October 2026; Previously shows the earlier value where it changed.

ParameterNameLevelsBits per valuePreviously
Kept at current precision (8)
ghGeopotential height14 pressure levels12unchanged
zGeopotential14 pressure levels12unchanged
mslMean sea-level pressuresurface12unchanged
spSurface pressuresurface12unchanged
ptypePrecipitation typesurface16unchanged
ewssEastward turbulent surface stresssurface12unchanged
nsssNorthward turbulent surface stresssurface12unchanged
asnSnow albedosurface8unchanged
Temperature, humidity & cloud (11)
tTemperature14 pressure levels9was 12
qSpecific humidity14 pressure levels9was 12
rRelative humidity14 pressure levels7was 8
2t2 m temperaturesurface9was 12
2d2 m dewpoint temperaturesurface9was 12
sktSkin temperaturesurface9was 12
sotSoil temperature4 soil layers9was 12
vswVolumetric soil water4 soil layers9was 12
tcwTotal column watertotal column9was 12
tcwvTotal column water vapourtotal column9was 12
tccTotal cloud covertotal column7was 8
Wind (6)
uU wind component14 pressure levels11was 12
vV wind component14 pressure levels11was 12
10u10 m U windsurface11was 12
10v10 m V windsurface11was 12
100u100 m U windsurface11was 16
100v100 m V windsurface11was 16
Dynamical fields (3)
wVertical velocity14 pressure levels12was 16
voRelative vorticity14 pressure levels12was 16
dDivergence14 pressure levels12was 16
Ocean, ice & snow (7)
zosSea surface heightocean surface10was 16
sithickSea ice thicknesssea ice10was 16
sveEastward sea-water velocityocean surface11was 16
svnNorthward sea-water velocityocean surface11was 16
rsnSnow densitysurface9was 16
sdSnow depth (water equivalent)surface9was 16
mucapeMost-unstable CAPEsurface10was 16
Waves (12)
swhSignificant wave heightwave (sea points)10was 16
h1012Sig. wave height, 10–12 swave (sea points)10was 16
h1214Sig. wave height, 12–14 swave (sea points)10was 16
h1417Sig. wave height, 14–17 swave (sea points)10was 16
h1721Sig. wave height, 17–21 swave (sea points)10was 16
h2125Sig. wave height, 21–25 swave (sea points)10was 16
h2530Sig. wave height, 25–30 swave (sea points)10was 16
mwpMean wave periodwave (sea points)10was 16
pp1dPeak wave periodwave (sea points)10was 16
mp2Mean zero-crossing wave periodwave (sea points)10was 16
cdwwCoefficient of drag with waveswave (sea points)10was 16
mwdMean wave directionwave (sea points)10was 16
Accumulations & extremes (16)
tpTotal precipitationsurface12was 16
tprateTotal precipitation ratesurface12was 16
sfSnowfall (water equivalent)surface11was 16
ssrSurface net shortwave radiationsurface10was 16
ssrdSurface downward shortwave radiationsurface10was 16
strSurface net longwave radiationsurface10was 16
strdSurface downward longwave radiationsurface10was 16
ttrTop net longwave radiationtop of atmosphere10was 16
mn2t3Minimum 2 m temperature (3 h)surface9was 12
mn2t6Minimum 2 m temperature (6 h)surface9was 12
mx2t3Maximum 2 m temperature (3 h)surface9was 12
mx2t6Maximum 2 m temperature (6 h)surface9was 12
10fgMaximum 10 m wind gustsurface10was 16
10fg3Maximum 10 m wind gust (3 h)surface10was 16
10fg6Maximum 10 m wind gust (6 h)surface10was 16
roRunoffsurface11was 12
Static fields (unchanged for now) (5)
lsmLand-sea masksurface8unchanged
z_sfcGeopotential (orography)surface16unchanged
sdorSt. dev. of sub-grid orographysurface16unchanged
slorSlope of sub-grid orographysurface16unchanged
wmbModel bathymetrywave16unchanged
AIFS-only fields (5)
cpConvective precipitationsurface12was 16
roweRunoff water equivalentsurface11was 12
lccLow cloud coversurface7was 8
mccMedium cloud coversurface7was 8
hccHigh cloud coversurface7was 8

What it means for file sizes

Setting bits by evidence makes files noticeably smaller — modest for upper-air-heavy streams, large for wave data (roughly a quarter to two-thirds smaller, depending on the stream). Most of the saving comes from stepping the 16-bit fields down to where they need to be; the fields reduced to 7–9 bits add the rest. A blanket low setting would save more, but would damage the multi-level dynamical fields that carry most of the volume and most need the precision.

Is anything lost?

Nothing that is used. The bits removed sit below the level at which each field carries meaningful information, so the values people read, and the fields they compute with, are unchanged to well within their own accuracy. The data stays in GRIB2 with CCSDS compression; only the precision is tuned, per parameter, as every major provider does. The rounding is uniform and bounded at each grid point, with no bias or artefacts.

  • No labels