Borrowing terminology used in software testing, we will from now on consistently use the terms alpha, beta and release candidate testing to describe the significant stages of the pre-operational testing of the IFS. They are:
- Alpha testing:
initial testing by Research Department to establish the content and performance of the next IFS cycle for implementation in Operations. During this testing stage regular modifications and updates of the experiments are quite common, and users should not use these experimental data sets for their own tests.
- Beta testing:
Once a cycle has passed this initial stage it will be passed to the Forecast Department for further tests to evaluate the potential impact on Operations. At this stage a technical test data set will be made available to users to test the technical impact on user's applications and tools. This testing stage is usually prone to starts minor updates and restarts and users should not rely on the availability of these test data sets for their own tests before the next stage of testing has been reached.
- Release candidate testing: One months for normal changes, and three months before the planned implementation of a high-impact change (e.g. resolution upgrades) the test system will be frozen and the test suite will run close to real-time. A full set of product services (e.g. dissemination, ecCharts) will be offered during the whole period. At this stage we will also declare which of the Beta test data sets can be used to acquire longer time series of test data.
These terms apply to the IFS direct model output. Post processed forecast products and charts are gradually incorporated during the beta testing phase.