Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Aviso is a system developed at ECMWF with the aim of:

  • Notifying for data availability
    • Real-Time Model Output Data
    • Product dissemination via ECPDS
  • Meant for automated systems
  • Based on an Event system supporting a mechanism When <this> … Do <that> …

It allows users to:

  • Define which events to be notified of.
  • Define the triggers to be executed once a notification is received.
  • Dispatch notifications to the notification server.

...

  1. Install AVISO following instructions on: https://pyaviso.readthedocs.io/en/latest/guide/getting_started.html#installing 

  2. Configure MARS credentials following instructions on Access MARS

  3. Create a configuration file in the default location ~/.aviso/config.yaml

    Code Block
    languageyml
    username_file: ~/.marsrc/mars.email
    key_file: ~/.marsrc/mars.token
    notification_engine:
      type: etcd_rest
      host: aviso.ecmwf.int
      port: 443
      https: true
    configuration_engine:
      type: etcd_rest
      host: aviso.ecmwf.int
      port: 443
      https: true
    schema_parser: ecmwf
    remote_schema: True
    auth_type: ecmwf 


  4. Create ~/.marsrc/mars.email and ~/.marsrc/mars.token files. mars.email file should contain “email” listed here: https://api.ecmwf.int/v1/key and mars.token file should contain “key” shown on the same page.

  5. Crate a your listener configuration file(s) with following content:
    1. Example for dissemination:
      Code Block
      languageyml
      titlelistener_diss.yaml
      listeners:
        - event: dissemination
          request:
            destination: <user_destination>
            class: od
            expver: 1
            domain: g
            stream: enfo
            step: [1,2,3]
          triggers:
            - type: echo
      Note the dissemination event listener. request describes for which dissemination event users want to execute the triggers. It is made of a set of fields. Users have to specify only the fields they wants to use as filters. destination is a mandatory field and it is associated to one or more destinations which are linked to the user's ECMWF account. Only the notifications complying with all the fields defined will execute the trigger. The trigger in this example is echo. This will simply print out the notification to the console output.

    2. Example for MARS:
      Code Block
      languageyml
      titlelistener_mars.yaml
      listeners:
        - event: mars
          request:
            class: od
            expver: 1
            domain: g
            stream: enfo
            step: [1,2,3]
          triggers:
            - type: echo
      Note, in the MARS event listener, destination field is not present.

  6. If AVISO is installed in conda or Python virtual environment, activate the environment first:
    1. Python virtual environment: "myenv"
      Code Block
      languagebash
      source {PATH_TO_MY_ENV}/myenv/bin/activate
    2. Conda:
      Code Block
      languagebash
      conda activate


  7. Launch the AVISO application to listen ECMWF defined in your configuration file:
    Code Block
    languagebash
    aviso listen listener_diss.yaml
    #or
    aviso listen listener_mars.yaml

...