You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 2 Next »

On the EUMETSAT side of European Weather Cloud, we have an instance that you can provision to install the Data Tailor Standalone with all available plugins on a Rocky Linux. Below is a small guide showing the installation and minimal post installation process. 

The Data Tailor is a product customization toolbox designed to allow users to modify satellite data according to their specific needs. It provides the capabilities to subset and aggregate data products in space and time, filter layers, generate quick looks, re-project onto new coordinate reference systems, and reformat data into common Geographic Information System (GIS) formats such as netCDF and GeoTIFF and image formats such as JPEG and PNG. The Data Tailor currently can customise various collections of METOP, MSG and Sentinel-3 satellites. There are two types of the Data Tailor. The Data Tailor Web Service (DTWS) allows users to perform customizations on products in the EUMETSAT Data Store before they are downloaded. The Data Tailor Standalone on the other hand is an application that you can install to your machine and customise products. Comparing to Data Tailor Web Services that you can use with  EUMDAC or through https://tailor.eumetsat.int, the Data Tailor standalone is generally faster and don't have the limitations like maximum concurrent jobs or workspace size. For more information on capabilities of the Data Tailor, please refer to Data Tailor Standalone Guide on User Portal and for more information about the available products and customisations inside the Data Tailor, please go to Products and Customisations Available in the Data Tailor page.

Current limitations

  • The two of the Data Tailor plugins, epct_plugin_umarf and epct_plugin_netcdf_generator, are currently not available, hence they're not installed as default. We will put these plugins back in the installations as soon as they become available again.
  • Due to design of the software, only one linux user is able to use the software without additonal settings. When a user runs the application for the first time, various configuration files are created with permissions only editable by that user.

Installation

Provisioning:

  • Create the Data Tailor standalone instance by clicking on + ADD button on your Morpheus Dashboard.

  • SSH into your VM and add conda environment to your shell.
    • Check conda installation and environments.
      $ conda env list
      # conda environments:
      #
      base                  *  /usr/local/miniconda
      dt_3_3                   /usr/local/miniconda/envs/dt_3_3
    • Integrate conda in your shell and restart your shell.  

      $ conda init
      no change     /usr/local/miniconda/condabin/conda
      no change     /usr/local/miniconda/bin/conda
      no change     /usr/local/miniconda/bin/conda-env
      no change     /usr/local/miniconda/bin/activate
      no change     /usr/local/miniconda/bin/deactivate
      no change     /usr/local/miniconda/etc/profile.d/conda.sh
      no change     /usr/local/miniconda/etc/fish/conf.d/conda.fish
      no change     /usr/local/miniconda/shell/condabin/Conda.psm1
      no change     /usr/local/miniconda/shell/condabin/conda-hook.ps1
      no change     /usr/local/miniconda/lib/python3.11/site-packages/xontrib/conda.xsh
      no change     /usr/local/miniconda/etc/profile.d/conda.csh
      modified      /home/USERNAME/.bashrc

      ==> For changes to take effect, close and re-open your current shell. <==

    • Activate the conda environment.
      $ conda activate dt_3_3
    • Test the Data Tailor standaloe installation.
      (dt_3_3) $ epct info
      epct_version: 3.3.0
      etc_dir: /usr/local/miniconda/envs/dt_3_3/etc/epct
      workspace_dir: /usr/local/miniconda/envs/dt_3_3/var/cache/epct
      customisations_log_dir: /usr/local/miniconda/envs/dt_3_3/var/log/epct
      output_dir: /
      installed_plugins:
        - epct-plugin-ncarrays, 1.1.0
        - epct-plugin-gis, 3.2.0
      registered_backends:
        - epct_1d_array
        - epct_2d_array
        - epct_ascatl1szf
        - epct_eps_gome2l1b
        - epct_eps_grasl1
        - epct_eps_iasil1c
        - epct_eps_iasisnd02
        - epct_eps_native
        - epct_eps_native_gome2l1_iasisnd02
        - epct_gis
        - epct_gis_eps
        - epct_gis_eps_grib2
        - epct_gis_glbsst
        - epct_gis_glbsst_grib2
        - epct_gis_grib2
        - epct_gis_hrit
        - epct_gis_hrit_grib2
        - epct_gis_msg
        - epct_gis_msg_meteo_bufr
        - epct_or1sww025


  • No labels