| Table of Contents |
|---|
Identify the data you want
- SFC, 6 parameters
- Time: 00, March 2017
- all steps (0/to/90/by/1, 93/to/144/by/3 and 150/to/360/by/6)
- all numbers (1/to/50)
Use MARS list to find out the size
| Code Block |
|---|
LIST,
CLASS = OD,
TYPE = PF,
STREAM = ENFO,
EXPVER = 0001,
LEVTYPE = SFC,
PARAM = 134.128/151.128/165.128/166.128/246.228/247.228,
DATE = 20170301/to/20170331,
TIME = 0000,
STEP = 0/1/2/3/4/5/6/7/8/9/10/11/12/13/14/15/16/17/18/19/20/21/22/23/24/25/26/27/28/29/30/31/32/33/34/35/36/37/38/39/40/41/42/43/44/45/46/47/48/49/50/51/52/53/54/55/56/57/58/59/60/61/62/63/64/65/66/67/68/69/70/71/72/73/74/75/76/77/78/79/80/81/82/83/84/85/86/87/88/89/90/93/96/99/102/105/108/111/114/117/120/123/126/129/132/135/138/141/144/150/156/162/168/174/180/186/192/198/204/210/216/222/228/234/240/246/252/258/264/270/276/282/288/294/300/306/312/318/324/330/336/342/348/354/360,
NUMBER = 1/to/50,
OUTPUT = cost,
TARGET = list.txt |
...
| Warning |
|---|
The data is too large: 4.48 TB and split across 32 tapes. |
Use the MARS catalogue to know the data distribution in files and tapes
Using the MARS catalogue we browse the data we want to get until we get to the final stage which gives us a selection and several options: http://apps.ecmwf.int/mars-catalogue/?stream=enfo&levtype=sfc&time=00%3A00%3A00&expver=1&month=mar&year=2017&date=2017-03-01&type=pf&class=od
...
Now that we know the size of the data that we want to retrive in one go from the same hypercube we can start the study of the way to iterate to get the full month.
Split the request in sensible chunks iterating through the correct keywords
Using the browser we know how the data is distributed in the MARS tree. Now we focus on the current selection section. In this case:
...