Versions Compared

Old Version 3

changes.mady.by.user Unknown User (maif)

Saved on

compared with

New Version 4

changes.mady.by.user Unknown User (maif)

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

page under construction ------------------------------

A large volume of data (100s of TB) is downloaded everyday from the CDS.

...

CEMS-Flood data on MARS

Table 1 - 

DatasetCDS Catalogue FormOverall SizeDays on Disk
GloFAS climatologyhttps://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-historical?tab=overview86GB30
GloFAS forecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-forecast7.6TB15

GloFAS reforecast

https://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-reforecast6TB0 (unless recently requested)
GloFAS seasonal forecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-seasonal0.5TB10 days for most recent forecast
GloFAS seasonal reforecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-seasonal-reforecast8.75TB0 (unless recently requested)
EFAS climatologyhttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-historical

817GB

30
EFAS forecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-forecast26.49TB10
EFAS reforecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-reforecast25.95TB0 (unless recently requested)
EFAS seasonal forecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-seasonal0.5TB10 days for most recent forecast
EFAS seasonal reforecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-seasonal-reforecast13.25 TB0 (unless recently requested)


Request strategy

Table 2 - Summary

DatasetCDS Catalogue FormAPI field limitsFinal data sizeRequest strategyLink to example script
GloFAS climatologyhttps://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-historical?tab=overview5002 GBLoop over yearsAPI request
GloFAS forecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-forecast608.1 GBloop over years, months, daysAPI request

GloFAS reforecast

https://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-reforecast95032 GB

loop over months, days

Subset to ROI

API request
GloFAS seasonal forecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-seasonal12531.5 GB

Loop over years, months

Subset to ROI

API request
GloFAS seasonal reforecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/cems-glofas-seasonal-reforecast12531.5 GB

Loop over years, months

Subset to ROI

API request
EFAS climatologyhttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-historical

to be confirmed

to be confirmedto be confirmedto be confirmed
EFAS forecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-forecastto be confirmedto be confirmedto be confirmedto be confirmed
EFAS reforecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-reforecastto be confirmedto be confirmedto be confirmedto be confirmed
EFAS seasonal forecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-seasonalto be confirmedto be confirmedto be confirmedto be confirmed
EFAS seasonal reforecasthttps://cds.climate.copernicus.eu/cdsapp#!/dataset/efas-seasonal-reforecastto be confirmedto be confirmedto be confirmedto be confirmed

Speed up retrieval through concurrency:

...