IMPORTANT ANNOUNCEMENT
Dissemination migration dates announced. To get notified of any changes to this page, please log in and click on 
in the upper right.
NEWS
IMPORTANT ANNOUNCEMENT: Dissemination migration dates announced.
Test dates & availability of release candidate test data announced.
Migration timeline updated.
Migration timeline changed and test period extended.
Changes to migration timeline and further testing.
Announcement of ECPDS migration.
Data Dissemination
The installation and testing of ECPDS, the ECMWF Production Data Store, in Bologna is now complete. ECPDS, which is described in a Newsletter article, takes care of both the dissemination and acquisition of data.
Migration Dates
The migration of the dissemination service will take place gradually over a two-week period, starting on Tuesday 4th October and finishing on Tuesday 18th October.
The following migration dates are available for eligible* users to choose:
- Tuesday 4th October
- Wednesday 5th October
- Thursday 6th October
- Tuesday 11th October ←
If we do not hear from you, we will migrate your destination(s) on Tuesday 11th October - Wednesday 12th October
- Thursday 13th October
- Tuesday 18th October ← this is the last possible migration date. The following users will migrate on Tuesday 18th October If you are not sure if this applies to you, please contact our Data Support Team through the Support Portal for assistance.
- Users receiving files >1GB
- Users receiving data via our proxy
- Users receiving any data which is not included in the following list
On the date selected, users will be migrated to ECPDS in Bologna from the 06 run on the specified day. If you do not normally receive products with the 06 run, the changes will take effect with the next successive run that you receive data for (12 or 18 on the same day, or 00 the next day). Once your dissemination has been migrated, your operational data will be disseminated from ECPDS in Bologna and you will no longer receive your operational data from ECPDS in Reading.
* Eligible users are those receiving ECMWF real-time data via dissemination. For users receiving other sources of data, the migration will take place on 18th October.
Choosing a migration date
Please note that the earlier you migrate, the more time we will have to support you in case of any unexpected issues. However, please also be aware of the risks associated with an earlier migration. Whilst we have endeavoured to stress test ECPDS in Bologna as much as possible by disseminating release candidate test data in a semi-operational capacity, we cannot guarantee the support level of external network links or the performance of the system at full capacity. In case of any unforeseen issues with these early migrations, we may revert back to disseminate products from ECPDS in Reading.
If you choose to wait until Tuesday 18th October, there will be no fall-back option and if you fail to receive products from ECPDS in Bologna on this day, you will not receive your products until the issues have been solved. Please also note that the Data Support team will have a limited capacity to help all users on this final migration day.
Important note
We remind users that the migration of ECPDS is taking place separately to the migration of the operational forecast.
Users who migrate to ECPDS in Bologna before October 18th will receive their current operational data, produced by IFS run on the Cray HPC in Reading, via ECPDS in Bologna.
Then, on October 18th, IFS Cycle 47r3 run on the Atos HPC in Bologna will become operational. On this date, the release candidate data that users having been testing, with filenames ending '77', will become operational. Please note, the '77' filename is only for testing purposes. When IFS Cycle 47r3 becomes operational, your operational filenames will not change.
What do I need to do before the migration?
- Please contact the Data Support Team via the Support Portal to inform them of your preferred migration date from the list of dates above.
- We will conduct a final connectivity test to your operational hosts on Tuesday 27th September, transferring two files named "ecmwf-tst.bol" and "ecmwf-tst.md5"
- To facilitate a smooth migration, we encourage users to avoid making changes to their requirements between Tuesday 4th and Tuesday 18th October. Please note that a change freeze will be in place from Sunday 16th October.
- In preparation for this migration, we have asked users to participate in a series of tests. If you have not completed the steps in the table below, please contact us immediately to arrange testing.
Step | Action |
|---|---|
| 1 | Make changes to your network setup to allow connections from the Bologna Data Centre. |
| 2 | Participate in transfer tests of two test files "ecmwf-tst.bol" and "ecmwf-tst.md5" from the Bologna Data Centre. |
| 3 | Participate in scheduled tests to receive release candidate test data from the Bologna Data Centre. |
| 4 | Migration of dissemination services to the Bologna Data Centre. Once you have migrated, you will receive your operational data from ECPDS in Bologna.
|
What do I need to do on migration day?
The migration of dissemination users to ECPDS in Bologna will start on Tuesday 4th October 2022, from the 06 run over a two-week period. Please ensure that you have followed our setup instructions below before this date. You will no longer be able to receive your operational data from Reading after Tuesday 18th October.
Guidelines for users receiving ECMWF Real-time Forecast Data
Note: For users receiving any other sources of data (not included in the following list), the migration will take place on 18th October. If you are not sure if this applies to you, please contact our Data Support Team through the Support Portal for assistance.
Internet Dissemination
Please ensure that your firewall has been updated to accept connections from the following IPs of our Bologna Data Centre. You may need to consult with your organisation’s network or firewall administrators.
Internet:
- 136.156.192.0/26
- 136.156.193.0/26
For ftp we support the following ports:
21 (standard)
2121 (non standard)
For sftp we support:
22 (standard)
2222 (non standard)
Please prepare these changes to all of your internet hosts, including any backup hosts
RMDCN Dissemination
Please ensure that your firewall has been updated to accept connections from the following IPs of our Bologna Data Centre. You may need to consult with your organisation’s network or firewall administrators.
RMDCN:
- 136.156.196.0/26
- 136.156.197.0/26
For ftp we support the following ports:
21 (standard)
2121 (non standard)
For sftp we support:
22 (standard)
2222 (non standard)
Please prepare these changes to all of your RMDCN hosts, including any backup hosts
Pull (Data Retrieval)
For users retrieving ECMWF real-time data, on your selected migration day, from the 06 run, you will need to retrieve your data from diss.ecmwf.int. Your data will no longer be available from dissemination.ecmwf.int.
Before the migration, please try connecting to the host diss.ecmwf.int with the same credentials that you use to access ECPDS in Reading:
- https://diss.ecmwf.int
sftp <userid>@diss.ecmwf.intftp diss.ecmwf.int
Other Data Pull Datasets
WMO essential (migrating on 11th October 06 run)
- Users accessing WMO Essential data will need to access data from https://diss.ecmwf.int/ from 11th October 06 run
- Users can try accessing this link now and should find two test files, ecmwf-tst.bol and ecmwf-tst.md5
WMO additional (migrating on 11th October 06 run)
- Users accessing WMO Additional data will need to access data from https://diss.ecmwf.int/ from 11th October 06 run
- Users can try accessing this link now and should find two test files, ecmwf-tst.bol and ecmwf-tst.md5
ACMAD (migrating on 11th October 06 run)
- Users accessing ACMAD datasets will need to access data from https://data.ecmwf.int from 18th October 06 run
Open Data (migrating on 18th October 06 run)
- Users accessing ECMWF Open Data will need to access data from https://diss.ecmwf.int/ecpds/home/opendata/ from 18th October 06 run
CAMS
- Please refer to the instructions at Accessing CAMS 47r3 technical test data (ATOS)
For users retrieving other types of data (not included in this list), your dissemination will migrate to Bologna on Tuesday 18th October. From the 06 run on Tuesday 18th October you will need to retrieve your data from aux.ecmwf.int.
If you are not sure if this applies to you, please contact our Data Support Team through the Support Portal for assistance.
Proxy
All users receiving data via the proxy in Washington DC will migrate on Tuesday 18th October.
EWCloud
No action is required. The European Weather Cloud has not yet been migrated to Bologna. Products will continue to be uploaded to the European Weather Cloud in Reading. Please continue to access your products as normal.
LAN
On your selected migration day*, your data will be available on our ATOS supercomputer in Bologna. User Services are setting up all LAN dissemination to the ATOS and will arrange testing with you. Please contact us via the Support Portal if you have not heard from us.
Your data will no longer be available from the CRAY supercomputer in Reading after you migrate to Bologna.
*Or on 18th October for destinations with large files.
ECaccess
Users have two options
- ECMWF have now made available a new release of the ECaccess gateway for users. We encourage users to prepare these changes for the migration. Full details are provided on the following page: Releases - Gateway package.
- Alternatively, on your selected migration day, you will need to point your existing ECaccess gateway to retrieve data from Bologna. Please contact User Services via the Support Portal (software and computing) for instruction if you choose to do this.
User Services are contacting relevant users with instructions for ECaccess. Please contact us via the Support Portal if you have not heard from us.
What should I do in case of problems?
Users with access to the ECPDS monitoring interface can also access the service in Bologna. Please use your username and security token to access the following link: https://diss-monitor.ecmwf.int/do/start - you will be able to monitor your transfers on this interface.
Please be aware that you may notice different transfer rates compared with your usual rates from Reading. We encourage all users to test the dissemination of real-time data from ECPDS in Bologna prior to migration by testing the release candidate phase test data.
If you experience any issues during your testing or during the migration, please contact our Data Support Team through our Support Portal for assistance.
If you require immediate assistance outside of UK working hours, please contact ECMWF Operators at operators@ecmwf.int for assistance.
We encourage users to follow the ECMWF Service Status page, where all updates will be posted throughout the migration period. We do not anticipate any issues with the migration, but we will keep users informed and reserve the right to amend the migration dates if needed.
Thank you for your ongoing participation and preparations for our migration to Bologna. To stay informed of any further updates, please watch this page.