Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.



We are in the process of preparing the final phases to complete the migration to our new data centre in Bologna, Italy.

Whilst the migration has progressed with a minimum level of disruption to date, we are now approaching a phase when some degradation of the services is to be expected.

Here we will keep ECMWF users informed about the data centre move to Bologna, update

Warning

This is work in progress. More information will be added as soon as it becomes available.

Table of Contents

Warning

To get notified of any changes to this page, please log in and click on  Image Removed in the upper right.

The purpose of this space is to keep users of ECMWF services informed about the move to our new data centre in Bologna, Italy, update them on any service disruptions or degradation this might cause and to highlight any action their you might need to take.

General

HPCF (and ecgate)

The Atos system...

Image Removed

Who is affected?

Action to take

We will also engage with you to participate in the testing and migration when services you use start running in parallel in Bologna, for you to test and facilitate the migration.

Please check the information provided below for any service you might use.


DHS Move

DHS move

(MARS and ECFS)

Transition plan

The Data Handling System

(DHS)

,

providing

which provides the MARS and ECFS services,

needs to be moved to Bologna before the new Atos HPCF will produce an increased archive load. A detailed migration timeline is shown in the transition plan where all events are relative to day D, the day when the MARS and ECFS service will stop accessing the Main-DHS-Reading. Instead the MARS and ECFS service will be provided by a temporary DHS which has been pre-filled with essential data, necessary to continue operational and time-critical activities, to minimise the impact of the DHS move. After 6 days we will start to fill the new Main-DHS-Blank with the data from the Temporary-DHS-prod and from the Main-DHS-Reading. At the end of the DHS-Move, expected to take 28 days, there will be a new operational DHS in Bologna.  In preparation of the DHS move we will conduct a number of dry-runs, during which the access to the main DHS in Reading will be blocked. The purpose of the dry runs is to verify that the Temporary-DHS does contain all essential data necessary to continue all critical activities during the move. Some of the dry-runs will last for 1-2 days. A final longer dry-run, lasting 5-7 days, is expected to happen 4 weeks before the move and will help to establish the exact date of day D.

Image Removed

Main service disruptions

The table below gives an indication on the service disruptions foreseen as part of the DHS-Move.

DateDurationImpactDry-run 1September 2021, TBC12 hoursdegraded access to non-essential dataDry-run 2September 2021, TBC24 hoursdegraded access to non-essential data......Final dry-runOctober 2021, TBC5-7 daysdegraded access to non-essential dataDHS-MoveNovember 2021, TBC28 daysdegraded access to non-essential data,
with data becoming gradually available again during the move

Summary of impact to users: 

User typeImpact during migrationMember State User

mars-client/WebAPI - limited to essential data 

mars-client/WebAPI - No access to historical operational data and IFS research experiments

mars-client/WebAPI - No access to public datasets (TIGGE/S2S, etc.) 

Web User (registered by MS)

WebAPI - limited to essential data 
WebAPI - No access to historical operational data and IFS research experiments
WebAPI - No access to public datasets (TIGGE/S2S, etc.) 

Commercial and research user (maxch*, comarc*, resarc*, nm*)

WebAPI - No access to historical operational data and IFS research experiments
WebAPI - No access to public datasets (TIGGE/S2S, etc.) 

Public usersWebAPI - No access to public datasets (TIGGE/S2S, etc.) 
Note

Commercial users (comarc_*) with a valid licence during the outage will have the equivalent length of the outage added to their existing contract length. 
Users may also opt to terminate their licence with 4 weeks notice. 

Impact to MARS service

No impact expected

The following essential services/data are not expected to be impacted by the dry-runs and the DHS-Move:

  • Recent output (~ one month) from operational production systems: All products listed in the Catalogue of ECMWF real-time products, ERA5T (near real-time), CAMS, …
  • Observations, analysis input, tropical cyclones for the entire period

  • ERA5 data required as initial conditions for the operational hindcasts (20 years for the relevant weeks)
  • Archiving into MARS
  • MS Time-critical suites
  • Atos HPC testing
  • Access to non-essential services/data will be affected as described below. 

    Degradation of service/data access

    Non-essential services and access to data degraded during dry-runs and the DHS-Move:

    • Retrieval via the WebAPI by MS-registered and commercial users will be limited to the essential data listed above
    • Retrieval via the MARS client on ECMWF computers will be limited to the essential data listed above

    Unavailability of service/data

    The following services/data will not be available during dry-runs and the DHS-Move:

    • Public datasets
    • ADS/CDS data served by MARS
    • IFS Research experiments
    • Historical operational data, non-essential ERA5 data

    Impact to ECFS service

    During dry-runs and the DHS move access to data archived in ECFS which has not been identified as essential is not expected to be available. However, archiving into ECFS should not be affected by the DHS migration.

    Recommended user action

    • Users of MARS and ECFS are urged to check if and how their work might be affected by the DHS-Move and plan accordingly.
    • Major changes to production processes etc. are best avoided during this period. For some activities the best course of action might be to avoid the migration period entirely...
    • Users missing access to data for any critical activity during the DHS-move should contact ServiceDesk at their earliest convenience with their requirements.

    Recent space activity

    Recently Updated
    typespage, comment, blogpost
    max5
    hideHeadingtrue
    themesocial

    is one of the few data centre components which will physically move from Reading to Bologna. In particular the move of tapes will inevitably cause some degradation to these services. See how the DHS-Move might affect your data access >>

    Migration of data dissemination (ECPDS) 

    As part of our Data Centre move we have started the installation of ECPDS, the ECMWF Production Data Store, in Bologna, Italy. The migration of this system will affect all sites receiving ECMWF data via the dissemination and requires some changes on the user's side. See Migration of data dissemination (ECPDS) >>

    Migration to Atos HPC 

    The new Atos will not only replace the current HPC service provided by the Cray XC40 systems, but also all Linux servers, e.g. ecgateMigration to Atos HPC >>

    Migration of the operational forecast to Atos 

    In preparation of the switch of the operational forecast production from the Cray to the Atos HPC, pre-operational test data will be provided well ahead of the switch, see Implementation of IFS Cycle 47r3 on Atos >>

    Space contributors

    Contributorsmodelistscopedescendantslimit5showLastTimetrueorderupdate