Applying n-bit floating point numbers and integers, and the n-bit filter of HDF5 to reduce file sizes of remote sensing products in memory-sensitive environments

详细信息    查看全文

• 作者：Stephan Zinke ^{stephan.zinke@eumetsat.int}Author Vitae
• 关键词：DNB ; Day and Night Band ; EARS ; EUMETSAT Advanced Retransmission Service ; EUMETSAT ; European Organisation for the Exploitation of Meteorological Satellites ; HDF5 ; Hierarchical Data Format version 5 ; NASA ; National Aeronautics and Space Agency ; NOAA ; National Oceanographic and Atmospheric Administration ; SDR ; Sensor Data Records ; S-NPP ; Suomi National Polar-orbiting Partnership ; VIIRS ; Visible Infrared Imager Radiometer Suite
• 刊名：Computers & Geosciences
• 出版年：2017
• 出版时间：February 2017
• 年：2017
• 卷：99
• 期：Complete
• 页码：155-158
• 全文大小：547 K
• 卷排序：99

文摘

HDF5 custom floating point numbers and integers and the n-bit filter reduce file sizes. The presented method is generic for any HDF5 file. The exponent can be determined automatically. The trailing significand size requires knowledge of the dataset. A compression factor of 1.96 could be reached without loss of significant information.