Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

In this page we summarise:

  • The reasons underpinning the CDS queuing time  
  • The size of the CEMS-Flood datasets stored on MARS and accessible through the CDS
  • The best practices to to maximise efficiency and minimise waiting time.

type
Table of Contents
flat


CDS Request times: the reasons underpinning the CDS queuing time

CDS Queuing can be monitored from the 'Your Requests' or using the 'CDS Live'

...

The Figure -1  shows a period of high user activity. GloFAS and EFAS products are served by the adaptor.mars.external service, you can see that the active users (blue line) is well above the green line of 50 slots allocated to the GLoFAS and EFAS requests. When the blue line falls again below the green line then the total queued users start decreasing until eventually there is no queuing time for any user request.


Figure - 1 

CEMS-Flood data on MARS: the size of the CEMS-Flood datasets stored on MARS and accessible through the CDS

Table 1 - 

DatasetCDS Catalogue FormOverall SizeDays on Disk
GloFAS climatologyhttps://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-historical?tab=overview86GB30
GloFAS forecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-forecast7.6TB15

GloFAS reforecast

https://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-reforecast6TB0 (unless recently requested)
GloFAS seasonal forecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-seasonal0.5TB10 days for most recent forecast
GloFAS seasonal reforecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-seasonal-reforecast8.75TB0 (unless recently requested)
EFAS climatologyhttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-historical

817GB

30
EFAS forecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-forecast26.49TB10
EFAS reforecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-reforecast25.95TB0 (unless recently requested)
EFAS seasonal forecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-seasonal0.5TB10 days for most recent forecast
EFAS seasonal reforecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-seasonal-reforecast13.25 TB0 (unless recently requested)


Request strategy: the best practices to to maximise efficiency and minimise waiting time.

Table 2 - Summary

DatasetAPI field limitsDownloaded data sizeRequest strategyLink to example script
GloFAS climatology5002 GBLoop over years
GloFAS forecast608.1 GBloop over years, months, days

GloFAS reforecast

95032 GB

loop over months, days

Subset to ROI


GloFAS seasonal forecast12531.5 GB

Loop over years, months

Subset to ROI


GloFAS seasonal reforecast12531.5 GB

Loop over years, months

Subset to ROI


EFAS climatology

1000

to be confirmedto be confirmedto be confirmed
EFAS forecast1000to be confirmedto be confirmedto be confirmed
EFAS reforecast200to be confirmedto be confirmedto be confirmed
EFAS seasonal forecast220to be confirmedto be confirmedto be confirmed
EFAS seasonal reforecast220to be confirmedto be confirmedto be confirmed

...

Whilst submitting multiple requests can improve download time, overloading the system with too many requests will eventually slow down the overall system performance.

...