Articles | Volume 9, issue 9
https://doi.org/10.5194/gmd-9-3199-2016
https://doi.org/10.5194/gmd-9-3199-2016
Development and technical paper
 | 
19 Sep 2016
Development and technical paper |  | 19 Sep 2016

Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+)

Charles S. Zender

Related authors

The fully coupled regionally refined model of E3SM version 2: overview of the atmosphere, land, and river results
Qi Tang, Jean-Christophe Golaz, Luke P. Van Roekel, Mark A. Taylor, Wuyin Lin, Benjamin R. Hillman, Paul A. Ullrich, Andrew M. Bradley, Oksana Guba, Jonathan D. Wolfe, Tian Zhou, Kai Zhang, Xue Zheng, Yunyan Zhang, Meng Zhang, Mingxuan Wu, Hailong Wang, Cheng Tao, Balwinder Singh, Alan M. Rhoades, Yi Qin, Hong-Yi Li, Yan Feng, Yuying Zhang, Chengzhu Zhang, Charles S. Zender, Shaocheng Xie, Erika L. Roesler, Andrew F. Roberts, Azamat Mametjanov, Mathew E. Maltrud, Noel D. Keen, Robert L. Jacob, Christiane Jablonowski, Owen K. Hughes, Ryan M. Forsyth, Alan V. Di Vittorio, Peter M. Caldwell, Gautam Bisht, Renata B. McCoy, L. Ruby Leung, and David C. Bader
Geosci. Model Dev., 16, 3953–3995, https://doi.org/10.5194/gmd-16-3953-2023,https://doi.org/10.5194/gmd-16-3953-2023, 2023
Short summary
The E3SM Diagnostics Package (E3SM Diags v2.7): a Python-based diagnostics package for Earth system model evaluation
Chengzhu Zhang, Jean-Christophe Golaz, Ryan Forsyth, Tom Vo, Shaocheng Xie, Zeshawn Shaheen, Gerald L. Potter, Xylar S. Asay-Davis, Charles S. Zender, Wuyin Lin, Chih-Chieh Chen, Chris R. Terai, Salil Mahajan, Tian Zhou, Karthik Balaguru, Qi Tang, Cheng Tao, Yuying Zhang, Todd Emmenegger, Susannah Burrows, and Paul A. Ullrich
Geosci. Model Dev., 15, 9031–9056, https://doi.org/10.5194/gmd-15-9031-2022,https://doi.org/10.5194/gmd-15-9031-2022, 2022
Short summary
The role of föhn winds in eastern Antarctic Peninsula rapid ice shelf collapse
Matthew K. Laffin, Charles S. Zender, Melchior van Wessem, and Sebastián Marinsek
The Cryosphere, 16, 1369–1381, https://doi.org/10.5194/tc-16-1369-2022,https://doi.org/10.5194/tc-16-1369-2022, 2022
Short summary
SNICAR-ADv4: a physically based radiative transfer model to represent the spectral albedo of glacier ice
Chloe A. Whicker, Mark G. Flanner, Cheng Dang, Charles S. Zender, Joseph M. Cook, and Alex S. Gardner
The Cryosphere, 16, 1197–1220, https://doi.org/10.5194/tc-16-1197-2022,https://doi.org/10.5194/tc-16-1197-2022, 2022
Short summary
SNICAR-ADv3: a community tool for modeling spectral snow albedo
Mark G. Flanner, Julian B. Arnheim, Joseph M. Cook, Cheng Dang, Cenlin He, Xianglei Huang, Deepak Singh, S. McKenzie Skiles, Chloe A. Whicker, and Charles S. Zender
Geosci. Model Dev., 14, 7673–7704, https://doi.org/10.5194/gmd-14-7673-2021,https://doi.org/10.5194/gmd-14-7673-2021, 2021
Short summary

Related subject area

Numerical methods
ParticleDA.jl v.1.0: a distributed particle-filtering data assimilation package
Daniel Giles, Matthew M. Graham, Mosè Giordano, Tuomas Koskela, Alexandros Beskos, and Serge Guillas
Geosci. Model Dev., 17, 2427–2445, https://doi.org/10.5194/gmd-17-2427-2024,https://doi.org/10.5194/gmd-17-2427-2024, 2024
Short summary
HETerogeneous vectorized or Parallel (HETPv1.0): an updated inorganic heterogeneous chemistry solver for the metastable-state NH4+–Na+–Ca2+–K+–Mg2+–SO42−–NO3–Cl–H2O system based on ISORROPIA II
Stefan J. Miller, Paul A. Makar, and Colin J. Lee
Geosci. Model Dev., 17, 2197–2219, https://doi.org/10.5194/gmd-17-2197-2024,https://doi.org/10.5194/gmd-17-2197-2024, 2024
Short summary
Three-dimensional geological modelling of igneous intrusions in LoopStructural v1.5.10
Fernanda Alvarado-Neves, Laurent Ailleres, Lachlan Grose, Alexander R. Cruden, and Robin Armit
Geosci. Model Dev., 17, 1975–1993, https://doi.org/10.5194/gmd-17-1975-2024,https://doi.org/10.5194/gmd-17-1975-2024, 2024
Short summary
Estimating volcanic ash emissions using retrieved satellite ash columns and inverse ash transport modeling using VolcanicAshInversion v1.2.1, within the operational eEMEP (emergency European Monitoring and Evaluation Programme) volcanic plume forecasting system (version rv4_17)
André R. Brodtkorb, Anna Benedictow, Heiko Klein, Arve Kylling, Agnes Nyiri, Alvaro Valdebenito, Espen Sollum, and Nina Kristiansen
Geosci. Model Dev., 17, 1957–1974, https://doi.org/10.5194/gmd-17-1957-2024,https://doi.org/10.5194/gmd-17-1957-2024, 2024
Short summary
Accounting for uncertainties in forecasting tropical-cyclone-induced compound flooding
Kees Nederhoff, Maarten van Ormondt, Jay Veeramony, Ap van Dongeren, José Antonio Álvarez Antolínez, Tim Leijnse, and Dano Roelvink
Geosci. Model Dev., 17, 1789–1811, https://doi.org/10.5194/gmd-17-1789-2024,https://doi.org/10.5194/gmd-17-1789-2024, 2024
Short summary

Cited articles

Burtscher, M. and Ratanaworabhan, P.: FPC: A high-speed compressor for double-precision floating-point data, IEEE T. Comput., 58, 18–31, https://doi.org/10.1109/TC.2008.131, 2009.
Caron, J.: Compression by scaling and offset, available at: http://www.unidata.ucar.edu/blogs/developer/entry/compression_by_scaling_and_offfset (last access: 13 September 2016), 2014a.
Caron, J.: Compression by bit shaving, available at: http://www.unidata.ucar.edu/blogs/developer/entry/compression_by_bit_shaving (last access: 13 September 2016), 2014b.
Collet, Y.: LZ4 lossless compression algorithm, available at: http://lz4.org (last access: 13 September 2016), 2013.
Dennis, J. M., Edwards, J., Evans, K. J., Guba, O., Lauritzen, P. H., Mirin, A. A., St-Cyr, A., Taylor, M. A., and Worley, P. H.: CAM-SE: A scalable spectral element dynamical core for the Community Atmosphere Model, Int. J. High Perform. C., 26, 74–89, https://doi.org/10.1177/1094342011428142, 2012.
Download
Short summary
We introduce Bit Grooming, a lossy compression algorithm that removes the bloat due to false precision, those bits and bytes beyond the meaningful precision of the data. Bit Grooming is statistically unbiased, applies to all floating-point numbers, and is easy to use. Bit Grooming reduces data storage requirements by 25–80 %. Unlike its best-known competitor Linear Packing, Bit Grooming imposes no software overhead on users, and guarantees its precision throughout the whole floating-point range.