Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The Data Handling System (DHS), providing the MARS and ECFS services, needs to be moved to Bologna before the new Atos HPCF will produce an increased archive load. A detailed migration timeline is shown in the transition plan below where all events are relative to day D, the day when the MARS and ECFS service will stop accessing the Main-DHS-Reading. Instead the MARS and ECFS service will be provided by a temporary DHS which has been pre-filled with essential data , necessary to continue operational and time-critical activities at ECMWF, with the aim to minimise the impact of the DHS move. After 6 days we will start filling the new Main-DHS-Blank with the data from the Temporary-DHS-prod and from the Main-DHS-Reading. At the end of the DHS-Move, expected to take 28 days, a new main DHS will become operational in Bologna.  In preparation of the DHS move we will conduct a number of dry-runs during which the access to the main DHS in Reading will be blocked. The purpose of the dry runs is to verify that the Temporary-DHS does contain all essential data necessary to continue all critical activities during the move. Some of the dry-runs will last for 1-2 days. A final longer dry-run, lasting 5-7 days, is expected to happen 4 weeks before the move and will help to establish the exact date of day D.

...

EventDateDurationImpact
Dry-run 1September 2021, TBC12 hoursdegraded access to non-essential data
Dry-run 2September 2021, TBC24 hoursdegraded access to non-essential datadata
............
Final dry-runOctober 2021, TBC5-7 daysdegraded access to non-essential data
DHS-MoveNovember 2021, TBC28 daysdegraded access to non-essential data,
with data becoming gradually available again during the move

...

User groupImpact
Member State User (fully registered computer user)

mars-client/WebAPI/ECFS - Access limited to essential available data 
mars-client/WebAPI - No access to historical operational data and IFS research experiments
mars-client/WebAPI - No access to public datasets (TIGGE/, S2S, etc.) 

Web User (registered by MS)

WebAPI - Access limited to essential available data 
WebAPI - No access to historical operational data and IFS research experiments
WebAPI - No access to public datasets (TIGGE/, S2S, etc.) 

Commercial and research user (maxch*, comarc*, resarc*, nm*)

WebAPI - No access to historical operational data and IFS research experiments
WebAPI - No access to public datasets (TIGGE/, S2S, etc.) 

Public usersWebAPI - No access to public datasets (TIGGE/, S2S, etc.) 


Note

Commercial users (comarc_*) with a valid licence during the outage will have the equivalent length of the outage added to their existing contract length. 

Users may also opt to terminate their licence with 4 weeks notice. 

...

Panel
borderColorgrey
bgColorlightgreen
borderStylesolid

No impact expected

The following essential services/data are list of available data, not expected to be impacted by the during dry-runs and the DHS-Move, will be updated in light of further migration progress: 

  • Recent output (~ one month) from operational production systems: All products listed in the Catalogue of ECMWF real-time products, ERA5T (near real-time), CAMS, …
  • Observations, analysis input, tropical cyclones for the entire period

  • ERA5 data required as initial conditions for the operational hindcasts (20 years for the relevant weeks)

The following services are not expected to be impacted by dry-runs and the DHS-Move:

  • Archiving into MARS
  • MS Time-critical suites
  • Atos HPC testing

...

Panel
borderColorgrey
bgColorlightsalmon
borderStylesolid

Degradation of service/data access

Non-essential services Services and access to data degraded during dry-runs and the DHS-Move:

  • Retrieval via the WebAPI by MS-registered and commercial users will be limited to the essential available data listed above
  • Retrieval via the MARS client on ECMWF computers will be limited to the essential available data listed above


Panel
borderColorgrey
bgColorsalmon
borderStylesolid

Unavailability of service/data

The following services/data will not be available during dry-runs and the DHS-Move:

  • Public datasets
  • ADS/CDS data served by MARS
  • IFS Research experiments
  • Historical operational data, non-essential ERA5 data
  • ADS/CDS data served by MARS

Impact to ECFS service

During dry-runs and the DHS move access to ECFS data archived in ECFS which has not been identified as essential necessary to continue operational and time-critical activities will not be available. However, archiving into ECFS should not be affected by the DHS migration.

...

  • Users of MARS and ECFS are urged to check if and how their work might be affected by the DHS-Move and plan accordingly.
  • Major changes to production processes etc. are best avoided during this period. For some activities the best course of action might be to avoid the migration period entirely...
  • Users ECMWF computer users missing access to data for any critical activity during the DHS-move should contact ServiceDesk us at their earliest convenience with their requirements via the ECMWF Support Portal.