Skip to content

Releases: pytroll/satpy

Version 0.37.0 (2022/08/05)

05 Aug 18:20
aa7f0dd
Compare
Choose a tag to compare

Issues Closed

  • Issue 2163 - ValueError: time data '2022-07-11T00:30:01Z' does not match format '%Y-%m-%dT%H:%M:%S.%fZ' (PR 2165 by @simonrp84)
  • Issue 2161 - Plotting Scene with Cartopy gives correct borders but red background
  • Issue 2155 - AVHRR CLASS Filename prefix prevents reading with Scene. (PR 2157 by @djhoese)
  • Issue 2145 - Could not calculate destination definition resolution
  • Issue 2143 - Save geotiff with keep_palette still add an alpha band
  • Issue 2139 - Hostname neo.sci.gsfc.nasa.gov not reachable anymore
  • Issue 2135 - Images are slightly different between scn.crop() and original one
  • Issue 2134 - scene.coarsest_area and scene.resample not working on MSG1/MSG2 in satpy 0.29
  • Issue 2130 - Can't install satpy with pip
  • Issue 2127 - Raised RuntimeError when trying to make HIMAWARI-8 true color image (PR 2128 by @mherbertson)
  • Issue 2112 - Trying to run scn.load(['true_color']) on GOES-16 ABI_L1b causes ValueError
  • Issue 2093 - Multiscene blend does not work well.
  • Issue 2089 - MultiScene.group doesn't work for differing identifier properties (PR 2099 by @sfinkens)
  • Issue 1996 - FCI dataset attributes are missing orbital parameters (PR 2110 by @ameraner)
  • Issue 1949 - keep delta_time instead of renaming to offset_time
  • Issue 1865 - navigation available for all L1b readers
  • Issue 1845 - Add parallax correction (PR 1904 by @gerritholl)
  • Issue 1699 - Remove compression argument from CF writer save_datasets
  • Issue 1638 - satpy_cf_nc reader not working with files written from seviri_l1b readers
  • Issue 1348 - 'AHIHSDFileHandler' object has no attribute 'area'
  • Issue 1308 - Error with yaml files during tutorial need example file I think
  • Issue 1015 - Add compute method to Scene (PR 1017 by @BENR0)

In this release 22 issues were closed.

Pull Requests Merged

Bugs fixed

  • PR 2165 - Update AGRI reader to deal with invalid valid_range HDF attribute (2163)
  • PR 2151 - Change default type of AWIPS tiled writer to int16 + _Unsigned
  • PR 2150 - Fix typos in reader table
  • PR 2142 - Fix MODIS readers applying add_offset incorrectly
  • PR 2141 - Fix expected test results for pyorbital 1.7.2
  • PR 2137 - Fix GPM IMERG reader.
  • PR 2128 - Fix AHI source file segment order after decompressing. (2127)
  • PR 2123 - Fix negative channel 3A slope calibration coefficient in AVHRR reader
  • PR 2122 - Fix yaml files for some seviri/abi/ahi BlackMarble background composites
  • PR 2115 - Update 'viirs_edr_active_fires' to work with newer Active Fires output
  • PR 2114 - Fix ACSPO 'sensor' attribute not being lowercase
  • PR 2107 - Fix 'ahi_hsd' reader crashing when 'observation_timeline' was invalid
  • PR 2103 - Update SEVIRI ICARE reader to properly use dask.
  • PR 2100 - Fix handling of non-existent reflectance bands in 'viirs_l1b' reader
  • PR 2099 - Fix MultiScene.group in case of differing identifier properties (2089)
  • PR 2098 - Fix Scene.coarsest/finest_area not returning consistent results
  • PR 1877 - Update SEVIRI native reader with 'time_parameters' metadata

Features added

  • PR 2160 - Add reader for ESA's Ocean Color CCI data
  • PR 2157 - Add filename pattern for CLASS subscription files (2155)
  • PR 2156 - Added filename pattern for CLASS subscription files.
  • PR 2147 - added the CRR-Ph files to the nwcsaf geo yaml file
  • PR 2146 - Update Metimage reader for L2 test data
  • PR 2140 - Add Natural Color / IR composites
  • PR 2133 - Rewrite 'apply_enhancement' as individual decorators to allow for easier dask map_blocks usage
  • PR 2110 - Add orbital_parameters to fci_l1c_nc reader (1996)
  • PR 2105 - Enable solar zenith angle caching for the DayNightCompositor
  • PR 2102 - Add more products to fci_l2_nc reader
  • PR 2097 - [pre-commit.ci] pre-commit autoupdate
  • PR 2096 - Convert remote files to FSFile objects automatically
  • PR 1919 - Implement adaptive FCI chunks padding and create a new GEOVariableSegmentYAMLReader class
  • PR 1904 - Add parallax correction via new ParallaxCorrectionModifier (1845,
  • PR 1769 - Add new composite (true_color_with_night_fires) to GOES/ABI: True color (day) with fires (night)
  • PR 1547 - Add support for fsspec files to seviri_l1b_nc reader
  • PR 1017 - Add pass through of xr compute, persist and chunk to Scene (1015)

Documentation changes

  • PR 2153 - Document alternative for deprecated get_min/max_area
  • PR 2138 - Add plugin functionality for readers, writers, and enhancements
  • PR 2108 - Functions to automatically generate reader table for documentation
  • PR 2104 - Improvements in custom reader documentation
  • PR 2091 - Fix link to rad2refl document in SEVIRI base reader
  • PR 1886 - Update quickstart documentation so that HRV channel is not loaded

In this release 40 pull requests were closed.

Version 0.36.0 (2022/04/14)

14 Apr 07:42
c20c3bb
Compare
Choose a tag to compare

Issues Closed

In this release 7 issues were closed.

Pull Requests Merged

Bugs fixed

  • PR 2084 - Fix CREFL using incorrect coefficients for MODIS
  • PR 2083 - Fix VIIRS L1B reader sensor not matching VIIRS SDR reader
  • PR 2080 - Ignore alpha when adding luminance in Sandwich compositor
  • PR 2079 - Remove marine_clean_aerosol from default AHI rayleigh_corrected modifier
  • PR 2077 - Fix missing 'rb' mode for opening files (2073)
  • PR 2070 - Fix lru_cache memory leaks and other linting errors
  • PR 2048 - Fix CMIC CRE product in nwcsaf yaml reader
  • PR 2016 - Fix the sensor name for msu_gsa_l1b reader
  • PR 1410 - Fix osisaf SST reader

Features added

  • PR 2086 - Update FCI reader for new test data release and add patches for IDPF data
  • PR 2078 - Add possibility to define the dataset rectification longitude in seviri_l2_bufr reader
  • PR 2076 - Support reading FSFiles in SEVIRI HRIT reader.
  • PR 2068 - Make sure RGBs do not have units attributes. (2066)
  • PR 2065 - Add filename to YAML for NASA NRT VIIRS files with creation date/time.
  • PR 2060 - Allow reading Bz2 hrit segments (1975)
  • PR 2057 - Add option to replace saturated MODIS L1b values with max valid value
  • PR 1980 - Adapt AAPP reader for generic chunk size
  • PR 1957 - Add RGBs for cloud phase (distinction) and type (1954)
  • PR 1410 - Fix osisaf SST reader

Documentation changes

  • PR 2075 - Add documentation on how the colorize enhancement can be used
  • PR 2071 - Add example to the documentation using multiple readers

Refactoring

  • PR 2087 - Refactor HRIT/LRIT format reader.

In this release 22 pull requests were closed.

Version 0.35.0 (2022/03/16)

16 Mar 15:09
e9caa3d
Compare
Choose a tag to compare

Issues Closed

  • Issue 2063 - Unable to commit changes due to bandit (use of subprocess module)
  • Issue 2037 - Why the lon/lat is interpolated to 1km while data are still 5km for MOD06 product
  • Issue 2012 - Define time metadata options and usage (PR 2031 by @djhoese)
  • Issue 1973 - Using cached geolocation and angles results in an error if chunk size not appropriately set. (PR 2041 by @djhoese)
  • Issue 1842 - Update needed for vii_l1b_nc reader to match a change to the Test Data and processor (PR 1979 by @pepephillips)
  • Issue 1110 - NWCSAF reader does not support GOES or HIMAWARI
  • Issue 1022 - Factorize area def computation in goes_imager_hrit (PR 1934 by @sfinkens)
  • Issue 956 - UnboundLocalError when passing "empty" generator as filenames
  • Issue 723 - Passing multiple readers fails if generic_image is among them
  • Issue 684 - Gracefully handle pykdtree's use of OpenMP (OMP_NUM_THREADS) with dask

In this release 10 issues were closed.

Pull Requests Merged

Bugs fixed

  • PR 2054 - Fix DifferenceCompositor not using metadata from YAML
  • PR 2049 - Fix dataset attribute typo and reduce amount of categorical dataset filtering in fci_l2_nc reader
  • PR 2044 - Fix unit handling in ERF DNB normalization's saturation correction
  • PR 2041 - Fix angle generation caching not working with irregular chunks (1973)
  • PR 2032 - Fix various metadata bugs in 'awips_tiled' writer (417)
  • PR 1933 - Change tested Python versions to 3.8, 3.9 and 3.10

Features added

  • PR 2056 - Update SLSTR calibration coefficients
  • PR 2055 - Skip dataset flipping in GEOFlippableFileYAMLReader in case of SwathDefinition data
  • PR 2047 - Add missing GOES-18 support to glm_l2 reader
  • PR 2034 - Update angle generation to prefer "actual" satellite position
  • PR 2033 - Remove use of legacy satellite position attributes
  • PR 2031 - Update AHI HSD reader with observation/scheduled times and nominal satellite position (2012)
  • PR 2030 - Add 'preference' option to 'get_satpos' utility
  • PR 2028 - Add 'colormap_tag' keyword argument to geotiff writer
  • PR 1993 - Add 'l2_flags' quality filtering to 'seadas_l2' reader
  • PR 1979 - Update VII reader for test data v2 (1842)
  • PR 1933 - Change tested Python versions to 3.8, 3.9 and 3.10
  • PR 1927 - Add support for more FCI L2 products and datasets

Refactoring

  • PR 2040 - Refactor composite generation to avoid unneeded warnings
  • PR 1934 - Factorize area computation in goes_imager_hrit (1022)

In this release 20 pull requests were closed.

Version 0.34.0 (2022/02/18)

18 Feb 21:48
a3fa4c4
Compare
Choose a tag to compare

Issues Closed

In this release 20 issues were closed.

Pull Requests Merged

Bugs fixed

  • PR 2027 - Include units with AVHRR EPS metadata (2026)
  • PR 2017 - Fix ABI rayleigh_corrected_crefl modifier using deprecated DEM specifier
  • PR 2015 - Fix various dask array bugs in CREFL modifier
  • PR 2013 - Fix angle generation caching occassionally swapping results (2010)
  • PR 2011 - Fix memory leak in cached_property backport (2008, 2008)
  • PR 2006 - Fix Scene not being serializable
  • PR 2002 - Update tests to be more flexible to CRS and enhancement changes
  • PR 1991 - Update reference to dask distributed setup page
  • PR 1988 - Update geometry.py docstring from compositor to modifier
  • PR 1987 - Check that time is not already a coordinate in CF writer
  • PR 1983 - More general filename filter for ascat soil moisture, allowing for Metop-B and Metop-C
  • PR 1982 - Fix ninjotiff writer from erraneous K to C conversion

Features added

  • PR 2025 - Allow skipping unit conversion in NinJoTIFF (2024)
  • PR 2007 - Update abi_l2_nc to include filename metadata similar to abi_l1b
  • PR 2005 - Add flag to MaskingCompositor to return RGBA for single-band input (2004)
  • PR 2000 - Add a reader for the MSU-GS/A + Arctica-M1 data (1999)
  • PR 1992 - Add support for CMIC product from PPSv2021
  • PR 1989 - read the "elevation" variable in slstr_l1b
  • PR 1986 - Add reader kwarg to 'ahi_hrit' to disable exact start_time (1384)
  • PR 1967 - Add ability to read comma-separated colormaps during enhancement
  • PR 1966 - Reduce MODIS L1b/L2 test case size for better test performance (1883)
  • PR 1962 - Use a dependency matrix for benchmarking

Documentation changes

  • PR 2020 - Clarify documentation regarding attributes used in get_angles
  • PR 1991 - Update reference to dask distributed setup page
  • PR 1988 - Update geometry.py docstring from compositor to modifier
  • PR 1969 - Improve modifier documentation
  • PR 1968 - Improve API documentation in CompositeBase
  • PR 1961 - Update documentation to refer to all EO satellite data
  • PR 1960 - Add release notes and security policy to documentation
  • PR 1950 - Fix formatting in configuration documentation

In this release 30 pull requests were closed.

Version 0.33.1

17 Dec 18:18
f901396
Compare
Choose a tag to compare

Version 0.33.1 (2021/12/17)

Issues Closed

  • Issue 1937 - Add SECURITY.md
  • Issue 1932 - warnings of invalid value encountered in true_divide and invalid value encountered in double_scalars in
  • Issue 1903 - MPEF Product Header record definition , in seviri_base.py, needs to be updated
  • Issue 1799 - Deprecate Scene.attrs property
  • Issue 1192 - Harmonize SEVIRI area definitions

In this release 5 issues were closed.

Pull Requests Merged

Bugs fixed

  • PR 1946 - Fix angle generation not working for StackedAreaDefinitions
  • PR 1942 - Fix dynamic_dnb composite converting NaNs to 0s
  • PR 1941 - Fix SAFE SAR azimuth noise array construction
  • PR 1918 - Fix geo interpolation for aapp data

Features added

  • PR 1674 - Feature add support for AHI True Color Reproduction

In this release 5 pull requests were closed.

Version 0.33.0

10 Dec 22:08
5ec9606
Compare
Choose a tag to compare

Issues Closed

In this release 2 issues were closed.

Pull Requests Merged

Bugs fixed

  • PR 1931 - When no fill value is used, write TransparentPixel=-1 in ninjogeotiff headers (1930)
  • PR 1926 - Update seadas_l2 chlor_a enhancement to use new log10 stretch
  • PR 1922 - Fix ABI cloud_phase composite recipe and enhancement

Features added

  • PR 1917 - Add support to read and visualize NOAA GOESR L2+ cloud mask products
  • PR 1912 - Add Frequency range
  • PR 1908 - Update AHI HSD calibration coefficients
  • PR 1905 - Updated mpef product header to include new fields
  • PR 1882 - Update GDAL_OPTIONS with driver= and COG-specific options
  • PR 1370 - Add support for reading AAPP level-1c MHS/AMSU-B data

Refactoring

  • PR 1910 - Refactor SZA and cos(SZA) generation to reduce duplicate computations

In this release 10 pull requests were closed.

Version 0.32.0

01 Dec 13:08
4950ccd
Compare
Choose a tag to compare

Issues Closed

In this release 10 issues were closed.

Pull Requests Merged

Bugs fixed

  • PR 1899 - Fix loading multi-sensor composites for manually added data (1898)
  • PR 1891 - Fix file handlers improperly matching some file types
  • PR 1884 - Fix nucaps reader failing when given multiple input files

Features added

  • PR 1901 - Update Scene.sensor_names to include sensors from readers and contained data (1900)
  • PR 1897 - Update AHI gridded reader to use HTTP instead of FTP
  • PR 1894 - Add 'seadas_l2' reader for 'chlor_a' product
  • PR 1892 - Add new pre-commit checks
  • PR 1888 - Optimize composite YAML loading
  • PR 1885 - Add optional on-disk zarr caching to sensor angle generation
  • PR 1881 - Add area definitions for GOES ABI FOR (1880)
  • PR 1797 - Allow loading of composites after Scene resampling (1752, 1749, 1747)

Documentation changes

  • PR 1873 - Fix a typo in the ninjogeotiff documentation

In this release 12 pull requests were closed.

Version 0.31.0

04 Nov 02:11
8c61f39
Compare
Choose a tag to compare

Issues Closed

  • Issue 1866 - Data Type of AHI NetCDF Output
  • Issue 1859 - Yaml UnsafeLoader ImportErrror on colab.google (PR 1860 by @abrammer)
  • Issue 1853 - ValueError: unexpected encoding for scipy backend: ['chunksizes']
  • Issue 1847 - Sentinel 2 new product version (msi_safe reader) (PR 1850 by @mraspaud)
  • Issue 1838 - Write NinJo tags in GeoTIFF according to newly defined interface (PR 1839 by @gerritholl)
  • Issue 1836 - If satpy config path set multiple times, scene creation fails with ValueError: Satpy config option 'config_path' must be a list, not '<class 'str'>'
  • Issue 1833 - Question about specific values with cloud compositor.
  • Issue 1811 - error in reading HRIT file
  • Issue 1742 - For group_files with multiple readers, allow user to configure behaviour if some groups have zero files for some readers (PR 1743 by @gerritholl)
  • Issue 1425 - toa_bidirectional_reflectance variable allow "float" or "int" NetCDF output instead of "double"
  • Issue 1345 - full list of simple_image image types
  • Issue 1138 - save_datasets does not save dependencies available due to unload=False (PR 1864 by @djhoese)

In this release 12 issues were closed.

Pull Requests Merged

Bugs fixed

  • PR 1868 - Fix MiRS reader not working with new versions of dask
  • PR 1860 - Catch ImportError on UnsafeLoader in composites/config_loader (1859)
  • PR 1855 - Fix 'acspo' reader producing non-y/x dimension names
  • PR 1854 - Fix 'awips_tiled' writer doing unnecessary attribute formatting
  • PR 1849 - Update AGRI reader to ensure that angles can be correctly loaded.

Features added

  • PR 1850 - Adapt msi-safe to the new product format (1847)
  • PR 1839 - Add ninjogeotiff writer to write GeoTIFFs including necessary NinJo tags in GDALMetadata (1838)
  • PR 1743 - Add option to configure group_files behaviour on empty groups in case of multiple readers (1742)

Documentation changes

  • PR 1867 - Update PDF metadata for sphinx documentation
  • PR 1864 - Update Scene.save_datasets to clarify what will be saved (1138)
  • PR 1862 - Correct phrasing of upside-down
  • PR 1852 - Fix reference to dask distributed setup page

In this release 12 pull requests were closed.

Version 0.30.1

29 Sep 01:09
8277ea3
Compare
Choose a tag to compare

Issues Closed

In this release 6 issues were closed.

Pull Requests Merged

Bugs fixed

  • PR1837 - Fix config path handling on Windows
  • PR1827 - Fix eumetsat urls in satpy/readers (1484)

Documentation changes

  • PR1837 - Fix config path handling on Windows
  • PR1830 - Move tests_require to special "tests" extra for easier installation (1829)
  • PR1827 - Fix eumetsat urls in satpy/readers (1484)

In this release 5 pull requests were closed.

Version 0.30.0

17 Sep 17:04
a6f26f3
Compare
Choose a tag to compare

Issues Closed

  • Issue 1821 - Resampling to true_color_with_night_ir_hires no longer works. (PR 1823)
  • Issue 1803 - how to xRITDecompress files for using satpy
  • Issue 1796 - Extend use of bz2 compression for input files for seviri_l1b_hrit (PR 1798)
  • Issue 1794 - ir_overview vs cloudtop
  • Issue 1793 - Different y_bounds and x_bounds shapes of TROPOMI MultiScene
  • Issue 1791 - Memory usage has increased drastically
  • Issue 1786 - The viirs_sdr reader does not function correctly with GMODO geolocation. (PR 1787)
  • Issue 1783 - Metadata name problem in HY-2B L2B reader (PR 1785)
  • Issue 1780 - What shoud I do if I only want to keep the day part of DayNightCompositor? (PR 1816)
  • Issue 1779 - piecewise_linear_stretch didn't work properly on GK-2A AMI data
  • Issue 1773 - [Question] Geolocation information of FengYun4A (FY-4A) AGRI L1B data (PR 1782)
  • Issue 1759 - Ask For Help: How to operate SunZenithCorrector manually?
  • Issue 1750 - MultiScene.blend does not document the interface for the blend function (PR 1751)
  • Issue 1745 - Resampling MODIS Level 1B data
  • Issue 1738 - available_dataset_names omits composites depending on more than one reader
  • Issue 1730 - geotiff writer ignores dtype argument, always writes float if enhance=False (PR 1733)
  • Issue 1728 - Unable to read HY-2B SCA L2B file
  • Issue 1727 - 'NoData' area is not black(clean) in the Sentinel-2 MSI output (PR 1628)
  • Issue 1722 - 'ModuleNotFoundError' when processing Sentinel-2 MSI data (PR 1723)
  • Issue 1718 - Raw metadata handling impacts performance (PR 1795)
  • Issue 1661 - Support for clavrx netcdf files (PR 1716)
  • Issue 1625 - Part of Sentinel-2 images missing when atmospheric corrected (PR 1628)
  • Issue 1584 - to_xarray_dataset on empty scene fails with TypeError (PR 1698)

In this release 23 issues were closed.

Pull Requests Merged

Bugs fixed

  • PR 1823 - Fix unify_chunks usage in compositors and fix image mode in BackgroundCompositor (1821)
  • PR 1814 - Add missing metadata to MODIS L1b and L2 readers
  • PR 1813 - Fix composites failing when inputs are different chunk sizes
  • PR 1808 - Fix ReflectanceCorrector (crefl) for MODIS data
  • PR 1804 - Fix consistency with nucaps sensor metadata (set/lowercase)
  • PR 1802 - Add warning in 'awips_tiled' writer when 'units' are too long
  • PR 1800 - Fix for missing attributes when requesting 'counts' calibration from ABI L1B reader.
  • PR 1792 - Maintain categorical clavrx data as integer arrays
  • PR 1787 - Fix 'viirs_sdr' repeating data when TC geolocation was not available (1786)
  • PR 1784 - Fix ABI readers not assigning 'platform_name' for GOES-18/19
  • PR 1782 - Update AGRI/L1 geolocation (1773)
  • PR 1777 - Fix mviri l1b fiduceo reader compatibility with newer xarray
  • PR 1776 - Fix 'awips_tiled' writer producing an invalid y coordinate
  • PR 1774 - Fix the seviri benchmarks
  • PR 1771 - Fix VIIRS SDR reader not handling multi-granule files with fewer scans
  • PR 1770 - Fix CLAVR-x reader and 'awips_tiled' writer to produce AWIPS-compatible output
  • PR 1744 - Fix VIRR reader handling valid_range when it is a numpy array
  • PR 1734 - Remove valid_range from attributes in VIRR L1b reader
  • PR 1733 - Fix geotiff writer ignoring dtype argument (1730, 1730)
  • PR 1724 - Replace doc references to PPP_CONFIG_DIR (1724)
  • PR 1723 - Fix package dependencies for the msi_safe reader (1722)
  • PR 1698 - Fix error when calling to_xarray_dataset on an empty scene (1584)
  • PR 1628 - Fix for transposed angles in safe-msi reader (1727, 1625)

Features added

  • PR 1824 - Add additional ACSPO reader file patterns
  • PR 1817 - Fix ninjotiff writer for mode P
  • PR 1816 - Add 'day_night' flag to DayNightCompositor for day-only or night-only results (1780)
  • PR 1815 - Add MODIS L2 products produced by IMAPP
  • PR 1805 - Add 'reader' name to all produced DataArrays
  • PR 1801 - added link to the GOES-2-go package in the docs as a download source.
  • PR 1798 - Add on-the-fly bz2 decompression for HRIT MSG PRO and EPI files (1796)
  • PR 1790 - Add ABI L1B benchmarks
  • PR 1785 - Feature handle data from HY-2B SCAT files directly from NSOAS (1783)
  • PR 1772 - Add access point to global_attrs to netCDF4FileHandler
  • PR 1760 - Add benchmarks for seviri hrit
  • PR 1720 - Add a test to ensure seviri hrv has priority over vis008 when requesting 0.8µm
  • PR 1717 - Add low resolution file patterns for AHI HSD reader
  • PR 1716 - Update Clavrx reader for netcdf files (1661)
  • PR 1692 - Add raw 'counts' calibration to 'abi_l1b' reader
  • PR 1297 - Add support for MCMIP GOES ABI L2 files (1162)

Documentation changes

  • PR 1819 - Fix invalid YAML syntax in enhancement documentation
  • PR 1801 - added link to the GOES-2-go package in the docs as a download source.
  • PR 1765 - Add missing demo data directory entry to config documentation
  • PR 1751 - Improve documentation for MultiScene.blend (1750)
  • PR 1726 - Point out get_area_def in resample documentation (1726)
  • PR 1724 - Replace doc references to PPP_CONFIG_DIR (1724)

In this release 45 pull requests were closed.