Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The CDS enforces constraints to the number of field fields per request that are retrievable for each dataset. The reason is to keep the system responsive for as many users as possible. The consequence is that you cannot download the whole dataset in one go, but you will need to device a retrieve strategy to, for example, loop over certain fields and retrieve the dataset in chunks.

...

In Table 2, we list the maximum fields that you can retrieve for each dataset and the corresponding downloaded data size, assuming GRIB2 file format and that no cropping has been performed. Also, we provide a short description of the request strategy and the link to  a script that you can use to perform the request.

...

Table 2 - Request strategy

Dataset
API field limitsDownloaded data size
N. of fields per requestRequest strategyCorresponding  file size per request (loop)Link to example script
GloFAS climatology500
2 GB
Loop over years2 GBscript
GloFAS forecast60
8.1 GB
loop over years, months, days8.1 GBscript

GloFAS reforecast

950
32 GB

loop over months, days

Crop

Consider cropping to ROI

32 GB
GloFAS seasonal forecast125
31.5 GB

Loop over years, months

Crop

Consider cropping to ROI

31.5 GB
GloFAS seasonal reforecast125
31.5 GB

Loop over years, months

Crop

Consider cropping to ROI

31.5 GB
EFAS climatology

1000



script
EFAS forecast1000

script
EFAS reforecast200loop over years, months, days2.3 GB
EFAS seasonal forecast220loop over months, days13.1 GB
EFAS seasonal reforecast220
13.1 GB

Whilst submitting multiple requests can improve download time, overloading the system with too many requests will eventually slow down the overall system performance.

...