Uploaded image for project: 'JASMIN CIS'
  1. JASMIN CIS
  2. JASCIS-233

Cannot use group of aggregated stations as sample

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Reduction
    • Labels:
      None

      Description

      It is possible (though slow) to colocate ECHAM model data to native AERONET data, using wildcards to designate the AERONET files:

      cis col od550aer:/group_workspaces/jasmin/cis/data/ECHAM_fixed/2007_2D_3hr/od550aer.nc /group_workspaces/jasmin/cis/data/aeronet/AOT/LEV20/ALL_POINTS/*:colocator=lin

      I wish to speed up this process, by first aggregating the AERONET sites over 6 hours. This is done station by station, e.g.:

      cis aggregate AOT_440:cabauw.lev20 t=[2007-01-01T00,2008-01-01T00,PT6H] -o aggregated_stations/cabauw

      I cannot colocate ECHAM data to these aggregated station data using wildcards:

      cis col od550aer:od550aer.nc aggregated_stations/*:colocator=lin -o echam_on_aggregate

      this yields:

      Traceback (most recent call last):
        File "/group_workspaces/jasmin/cis/cis_dev_venv/bin/cis", line 6, in <module>
          main()
        File "/group_workspaces/jasmin/cis/cis_dev_venv/lib/python2.7/site-packages/jasmin_cis/cis.py", line 309, in main
          parse_and_run_arguments()
        File "/group_workspaces/jasmin/cis/cis_dev_venv/lib/python2.7/site-packages/jasmin_cis/cis.py", line 288, in parse_and_run_arguments
          cmd(arguments)
        File "/group_workspaces/jasmin/cis/cis_dev_venv/lib/python2.7/site-packages/jasmin_cis/cis.py", line 130, in col_cmd
          sample_data = data_reader.read_coordinates(main_arguments.samplefiles, main_arguments.sampleproduct)
        File "/group_workspaces/jasmin/cis/cis_dev_venv/lib/python2.7/site-packages/jasmin_cis/data_io/data_reader.py", line 142, in read_coordinates
          return self._get_coords_func(filenames, product)
        File "/group_workspaces/jasmin/cis/cis_dev_venv/lib/python2.7/site-packages/jasmin_cis/data_io/products/AProduct.py", line 191, in get_coordinates
          % (product_cls.__name__, type(e).__name__, e.message), e)
      jasmin_cis.data_io.products.AProduct.ProductPluginException: An error occurred retrieving coordinates using the product default_NetCDF. Check that this is the correct product plugin for your chosen data. Exception was InvalidVariableError: Variable not found: AOT_440_num_points

      Note that colocation to a single aggregated station works fine. The above problem is likely related to the fact that aggregated data are gridded objects.

        Attachments

          Activity

            People

            Assignee:
            matthew.kendall@tessella.com Matthew Kendall
            Reporter:
            schutgens@atm.ox.ac.uk Nick Schutgens
            Participants:
            Watchers:
            0 Start watching this issue

              Dates

              Created:
              Updated: