Below is the list of all releases with their new features:
Version 1.5.1 (22/07/2024)
- JMA fetch data process to use monthly directory listing on JMA server to discover available data.
- Data insertion split into chunks to lower memory profile.
- Increased Cron-job active deadline to allow for longer execution time.
Version 1.5.0 (09/07/2024)
- Surface marine quality component for 6h and daily periods.
- Revised about page and new menu structure.
- Enhancements of the operational environment.
Version 1.4.6.1 (08/05/2024)
- Improved loading speed of maps.
- 6h aggregation to become available as soon as all centers have provided files.
- Download link to return 400 error code if data is not yet available.
- Upper-air NWP download API accepts an additional URL parameter “extra_columns=nr_complete” to return the number of complete observations in addition to the number of received.
- Bugfixes in daily and monthly download, database status, alerting and monthly surface quality.
- Improved internal architecture by introducing a repository pattern for fetching data from NWP centers.
Version 1.4.6 (30/04/2024)
- Monthly aggregation feature for (NWP) both surface and upper-air.
- Aggregation of a number of Gross Errors in daily reports to calculate monthly Gross Error percentage.
- Bugfix so that upper-air quality station popup correctly displays the best centre.
- Definition of internal floating point precision to 6 digits to improve accuracy and predictability.
- Improved system logging by capturing timeout-related warnings, enhancing error tracking and system diagnostics.
Version 1.4.5.1 (20/03/2024)
- Improved error handling and logging.
- Bugfix for OSCAR/Surface interface bug addressing higher resolution of datetime.
- Updated the map disclaimer and link.
Version 1.4.5 (06/03/2024)
Technology stack upgrade, Phase II.
- Update of key libraries (Python 2.7 to 3.9.18, Django 1.8 to 4.2, and Pandas 0.24 to 2.1.3).
- Streamlining of development platform: Simplification of Dockerfiles, Docker Compose-based development environment, introduction of Poetry for reproducible dependency management.
Hotfix 1.4.4.1 (21/02/2024)
- Hotfix to handle SSL certificate validation of JMA files.
Version 1.4.4 (07/12/2023)
- Internal adjustment to code-list update in OSCAR/Surface for humidity variable.
Version 1.4.3 (10/10/2023)
- Simplified tile-server architecture.
- 6h and daily NWP reports only activate if data from enough centers is available.
Version 1.4.2 (12/07/2023)
- Migration to new API report to fetch schedules from OSCAR/Surface
- Bugfix to prevent the station from showing twice in case of metadata changes during daily aggregation.
- Update API endpoint to improve better monitoring of data ingestion
- Changed the NWP-ID label of the yellow station to be either “TSI” or “WSI” according to the id.
Version 1.4.1 (29/05/2023)
- GBON report period is only activated once enough data has been ingested.
- GBON defaults to a daily period.
- Faster internal processing.
- Aggregation process better handles metadata changes for daily aggregations.
Version 1.4.0 (17/05/2023)
- Functional
- New GBON module for surface and upper air. Daily and monthly aggregation and 6h for surface. Data are available from 1/5/2023.
- The datetime of the last synchronization with Oscar/Surface is shown on the database status page.
- New API endpoint to help monitor missing files by center.
- New API endpoint to monitor internal processing
- Non Functional
- Integration testing framework.
- Update of file DWD format for GCOS data ingestion.
- More efficient internal processing and logging make data available earlier.
- More robust exception handling of database connectivity loss
Hotfix 1.3.4.1 (08/08/2022)
- Hotfix to deal with the date format changes in the schedule files fetched from OSCAR/Surface.
Version 1.3.4 (26/07/2022)
- Fix the discontinuity caused by null values for background departures (bg_dep) in the time-series line chart for the daily quality average O-B.
...
- Consider higher status and aggregation by WSI for Surface and Upper-air observations.
- Enhance performance to decrease the execution time of the aggregation process for surface observations by 40%.
Version 1.3.3 (08/06/2022)
- Handling of multiple WIGOS Station Identifiers (WSIs) and assignment of observations to the Primary WSI.
- Improve the Search by enabling Secondary WSI search as well.
- Correct the time-series chart for stations that simultaneously have observations from the Primary and Secondary WSIs.
...
Version 1.3.2 (05/10/2021)
- Implementation of the algorithm to calculate the monthly assessed status of the GOS and RBSN affiliated stations available on WDQMS.
...