Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Data processing frameworks in python:
    • numpy/xarray: should we embrace rich functionality of frameworks like xarray or use pure numpy API solutions for compatibility?

    • how to write data back to grib and other data formats.
    • Metadata and grid information in the framework.

    • Evaluate and learn from typical member state operators and grids for data processing.

    • Dask and task scheduling: How to parallelize the dags.

    • Performance evaluations: dask, numba, GPU.

    • Event driven processing.

  • FDB: 
    • How to deploy a FDB server in order to deploy data out of the HPC center.
    • Learn from operational aspects of deployments of FDB at ECMWF.
    • Analysis of FDB performance for the MeteoSwiss data deployment
  • polytope:
    • Design of the data bridge design using polytope serving FDB data.
  • MARS language: for COSMO/ICON data of the MeteoSwiss operational data.


Conclusions and results of the different activities are summarized in the following sections of the quarterly report.


FDB


Jupyter Viewer
notebookUrlhttps://github.com/MeteoSwiss-APN/fdb-tools/blob/benchmarking/FDB/benchmarking/fdb-bench-results.ipynb