Best practise to iterate over all hindcastDates of several hindcastYears for CMA
Table of Contents
What is the objective of this page?
Info | ||
---|---|---|
| ||
To help users to improve S2S CMA MARS requests performance via the WebAPI.
|
How the S2S data is organised in MARS?
...
In general it is organised, as a huge tree, with the indentation below, showing different levels down that tree:
- centre (CMA, ECMWF, NCEP, JMA, ...)
- realtime or reforecast
- type of data (control forecast or perturbed forecast)
- type of level (single level or pressure level or potential temperature)
- model version date (2014-05-01 or ...)
- hindcast dates (2014-01-01 or 2014-01-02 or 2014-01-03, ...)
- time-steps
- members (for perturbed forecast)
- levels (for pl or pt)
- parameters
- levels (for pl or pt)
- members (for perturbed forecast)
- time-steps
- hindcast dates (2014-01-01 or 2014-01-02 or 2014-01-03, ...)
- model version date (2014-05-01 or ...)
- type of level (single level or pressure level or potential temperature)
- type of data (control forecast or perturbed forecast)
- realtime or reforecast
...
What would be the natural way to group requests?
Info |
---|
Following the previous paragraph, the natural way to group requests would be:
|
What is the best approach to loop over several HindcastDates for a CMA request?
...
title | The main idea in brief: |
---|
...
What is the best approach to get all HindcastDays for several HindcastYears ?
Info |
---|
|
...
|
...
|
...
|
...
|
...
|
Info | ||
---|---|---|
for hindcastYear in hindcastYears | ||
Info | ||
| ||
for HindcastYear in HindcastYears |
An example to request Control forecast, sfc, for HindcastYears 2010 to 2014 for 2 HindcastMonths (eg April and June)
hindcastDate) |
Web-API examples:
A CMA reforecast request for all the available hindcastDates
Info |
---|
Please note:
|
Code Block | ||
---|---|---|
| ||
#!/usr/bin/env python
import calendar
from ecmwfapi import ECMWFDataServer
server = ECMWFDataServer()
origin = "babj"
modelVersionDate = "2014-05-01"
def retrieve_cma_reforecast():
"""
| ||
Info | ||
| ||
for HindcastYear from 2010 to 2014 |
A Control forecast, sfc, S2S-request example
Code Block | ||
---|---|---|
| ||
#!/usr/bin/env python
from ecmwfapi import ECMWFDataServer
server = ECMWFDataServer()
server.retrieve({
"class": "s2",
"dataset": "s2s",
"date": ModelVersionDate, (ie "2014-05-01"),
"expver": "prod",
"hdate": HindcastDate, (ie the selected HindcastDate eg "2014-04-01"),
"levtype": "sfc",
"origin": "babj",
"param": "165",
"step": "0",
"stream": "enfh",
"target": "CHANGEME",
"time": "00",
"type": "cf",
}) |
If the request is "small" you may request more HindcastDates in one go.
Do you need more CMA re-forecast examples?
A Control forecast, sfc, S2S-request example with iteration over hindcastYears, hindcastMonths and hindcastDays
Please note that the objective of the python script below is only to demonstrate how to make a MARS request efficient via hindcastYears, hindcastMonths and hindcastDays iterations. You need to adapt it to your needs.
Code Block | ||
---|---|---|
| ||
#!/usr/bin/env python from ecmwfapi import ECMWFDataServer server = ECMWFDataServer() def retrieve_data(hindcastDate): target = "target_s2s__%s.grb", hindcastDate2014 hindcastMonthStart = 1 hindcastMonthEnd = 12 for hindcastYear in list(range(hindcastYearStart, hindcastYearEnd + 1)): for hindcastMonth in list(range(hindcastMonthStart, hindcastMonthEnd + 1)): numberOfDays = calendar.monthrange(hindcastYear, hindcastMonth)[1] for hindcastDay in list(range(numberOfDays)): hindcastDate = '%04d%02d%02d' % ( hindcastYear, hindcastMonth, hindcastDay + 1) target = "%s%s.grb" % (origin, hindcastDate) cma_reforecast_request(hindcastDate, target) def cma_reforecast_request(hindcastDate, target): """ A CMA reforecast request. Change the keywords below to adapt it to your needs. """ server.retrieve({ "class": "s2", "dataset": "s2s", "date": "2014-05-01"modelVersionDate, "expver": "prod", "hdate": hindcastDate, "levtype": "sfc", "origin": "babj"origin, "param": "165/166", "step": "024/to/1440/by/24", "stream": "enfh", "target": target, "time": "00", "typenumber": "cf1/2/3", }) for hindcastYear in ["2012", "2013"]: for hindcastMonth in ["08", "09"]: for hindcastDay in ["01", "02"]:type": "pf", }) if hindcastDate = hindcastYear+hindcastMonth+hindcastDay __name__ == '__main__': retrieve_cma_datareforecast(hindcastDate)) |
Useful links
Info |
---|