Articles | Volume 10, issue 1
https://doi.org/10.5194/gmd-10-413-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/gmd-10-413-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
The compression–error trade-off for large gridded data sets
Jeremy D. Silver
CORRESPONDING AUTHOR
School of Earth Sciences, University of Melbourne, Melbourne, Australia
Charles S. Zender
Departments of Earth System Science and of Computer Science, University of California, Irvine, CA, USA
Related authors
Yohanna Villalobos, Peter J. Rayner, Jeremy D. Silver, Steven Thomas, Vanessa Haverd, Jürgen Knauer, Zoë M. Loh, Nicholas M. Deutscher, David W. T. Griffith, and David F. Pollard
Atmos. Chem. Phys., 22, 8897–8934, https://doi.org/10.5194/acp-22-8897-2022, https://doi.org/10.5194/acp-22-8897-2022, 2022
Short summary
Short summary
We study the interannual variability in Australian carbon fluxes for 2015–2019 derived from OCO-2 satellite data. Our results suggest that Australia's semi-arid ecosystems are highly responsive to variations in climate drivers such as rainfall and temperature. We found that high rainfall and low temperatures recorded in 2016 led to an anomalous carbon sink over savanna and sparsely vegetated regions, while unprecedented dry and hot weather in 2019 led to anomalous carbon release.
Yohanna Villalobos, Peter J. Rayner, Jeremy D. Silver, Steven Thomas, Vanessa Haverd, Jürgen Knauer, Zoë M. Loh, Nicholas M. Deutscher, David W. T. Griffith, and David F. Pollard
Atmos. Chem. Phys., 21, 17453–17494, https://doi.org/10.5194/acp-21-17453-2021, https://doi.org/10.5194/acp-21-17453-2021, 2021
Short summary
Short summary
Semi-arid ecosystems such as those in Australia are evolving and might play an essential role in the future of climate change. We use carbon dioxide concentrations derived from the OCO-2 satellite instrument and a regional transport model to understand if Australia was a carbon sink or source of CO2 in 2015. Our research's main findings suggest that Australia acted as a carbon sink of about −0.41 ± 0.08 petagrams of carbon in 2015, driven primarily by savanna and sparsely vegetated ecosystems.
Robert G. Ryan, Jeremy D. Silver, Richard Querel, Dan Smale, Steve Rhodes, Matt Tully, Nicholas Jones, and Robyn Schofield
Atmos. Meas. Tech., 13, 6501–6519, https://doi.org/10.5194/amt-13-6501-2020, https://doi.org/10.5194/amt-13-6501-2020, 2020
Short summary
Short summary
Models have identified Australasia as a formaldehyde (HCHO) hotspot from vegetation sources, but few measurement studies exist to verify this. We compare, and find good agreement between, HCHO measurements using three – two ground-based and one satellite-based – different spectroscopic techniques in Australia and New Zealand. This gives confidence in using satellite observations to study HCHO and associated air chemistry and pollution problems in this under-studied part of the world.
Yohanna Villalobos, Peter Rayner, Steven Thomas, and Jeremy Silver
Atmos. Chem. Phys., 20, 8473–8500, https://doi.org/10.5194/acp-20-8473-2020, https://doi.org/10.5194/acp-20-8473-2020, 2020
Short summary
Short summary
Estimated carbon fluxes for Australia are subject to considerable uncertainty. We ran simulation experiments over Australia to determine how much these uncertainties can be constrained using satellite data. We found that the satellite data has the potential to reduce these uncertainties up to 80 % across the whole continent. For 1 month, this percentage corresponds to 0.51 Pg C y-1 for Australia. This method could lead to significantly more accurate estimates of Australia's carbon budget.
Alexander J. Norton, Peter J. Rayner, Ernest N. Koffi, Marko Scholze, Jeremy D. Silver, and Ying-Ping Wang
Biogeosciences, 16, 3069–3093, https://doi.org/10.5194/bg-16-3069-2019, https://doi.org/10.5194/bg-16-3069-2019, 2019
Short summary
Short summary
This study presents an estimate of global terrestrial photosynthesis. We make use of satellite chlorophyll fluorescence measurements, a visible indicator of photosynthesis, to optimize model parameters and estimate photosynthetic carbon uptake. This new framework incorporates nonlinear, process-based understanding of the link between fluorescence and photosynthesis, an advance on past approaches. This will aid in the utility of fluorescence to quantify terrestrial carbon cycle feedbacks.
Kathryn M. Emmerson, Jeremy D. Silver, Edward Newbigin, Edwin R. Lampugnani, Cenk Suphioglu, Alan Wain, and Elizabeth Ebert
Geosci. Model Dev., 12, 2195–2214, https://doi.org/10.5194/gmd-12-2195-2019, https://doi.org/10.5194/gmd-12-2195-2019, 2019
Short summary
Short summary
We present the first representation of grass pollen in a 3-D dispersion model in Australia, tested using observations from eight counting sites in Victoria. The technology was developed in response to the severe thunderstorm asthma event which took place in Melbourne in November 2016. A total of 10 pollen emission methodologies were developed and evaluated. The best results were obtained using statistical methods that included elements of the satellite derived enhanced vegetation index.
Alexander J. Norton, Peter J. Rayner, Ernest N. Koffi, Marko Scholze, Jeremy D. Silver, and Ying-Ping Wang
Biogeosciences Discuss., https://doi.org/10.5194/bg-2018-270, https://doi.org/10.5194/bg-2018-270, 2018
Revised manuscript has not been submitted
Short summary
Short summary
This study presents a global estimate of land carbon uptake through photosynthesis. We make use satellite chlorophyll fluorescence measurements, a visible indicator of photosynthesis, to optimize model parameters and then use the optimized model to estimate photosynthetic carbon uptake. This provides a new tool that can combine measurements and observations in a systematic way and maximise the use of chlorophyll fluorescence to improve our understanding of the land carbon cycle.
K. M. Hansen, J. H. Christensen, C. Geels, J. D. Silver, and J. Brandt
Atmos. Chem. Phys., 15, 6549–6559, https://doi.org/10.5194/acp-15-6549-2015, https://doi.org/10.5194/acp-15-6549-2015, 2015
J. Brandt, J. D. Silver, J. H. Christensen, M. S. Andersen, J. H. Bønløkke, T. Sigsgaard, C. Geels, A. Gross, A. B. Hansen, K. M. Hansen, G. B. Hedegaard, E. Kaas, and L. M. Frohn
Atmos. Chem. Phys., 13, 7725–7746, https://doi.org/10.5194/acp-13-7725-2013, https://doi.org/10.5194/acp-13-7725-2013, 2013
J. Brandt, J. D. Silver, J. H. Christensen, M. S. Andersen, J. H. Bønløkke, T. Sigsgaard, C. Geels, A. Gross, A. B. Hansen, K. M. Hansen, G. B. Hedegaard, E. Kaas, and L. M. Frohn
Atmos. Chem. Phys., 13, 7747–7764, https://doi.org/10.5194/acp-13-7747-2013, https://doi.org/10.5194/acp-13-7747-2013, 2013
E. Solazzo, R. Bianconi, G. Pirovano, M. D. Moran, R. Vautard, C. Hogrefe, K. W. Appel, V. Matthias, P. Grossi, B. Bessagnet, J. Brandt, C. Chemel, J. H. Christensen, R. Forkel, X. V. Francis, A. B. Hansen, S. McKeen, U. Nopmongcol, M. Prank, K. N. Sartelet, A. Segers, J. D. Silver, G. Yarwood, J. Werhahn, J. Zhang, S. T. Rao, and S. Galmarini
Geosci. Model Dev., 6, 791–818, https://doi.org/10.5194/gmd-6-791-2013, https://doi.org/10.5194/gmd-6-791-2013, 2013
Qi Tang, Jean-Christophe Golaz, Luke P. Van Roekel, Mark A. Taylor, Wuyin Lin, Benjamin R. Hillman, Paul A. Ullrich, Andrew M. Bradley, Oksana Guba, Jonathan D. Wolfe, Tian Zhou, Kai Zhang, Xue Zheng, Yunyan Zhang, Meng Zhang, Mingxuan Wu, Hailong Wang, Cheng Tao, Balwinder Singh, Alan M. Rhoades, Yi Qin, Hong-Yi Li, Yan Feng, Yuying Zhang, Chengzhu Zhang, Charles S. Zender, Shaocheng Xie, Erika L. Roesler, Andrew F. Roberts, Azamat Mametjanov, Mathew E. Maltrud, Noel D. Keen, Robert L. Jacob, Christiane Jablonowski, Owen K. Hughes, Ryan M. Forsyth, Alan V. Di Vittorio, Peter M. Caldwell, Gautam Bisht, Renata B. McCoy, L. Ruby Leung, and David C. Bader
Geosci. Model Dev., 16, 3953–3995, https://doi.org/10.5194/gmd-16-3953-2023, https://doi.org/10.5194/gmd-16-3953-2023, 2023
Short summary
Short summary
High-resolution simulations are superior to low-resolution ones in capturing regional climate changes and climate extremes. However, uniformly reducing the grid size of a global Earth system model is too computationally expensive. We provide an overview of the fully coupled regionally refined model (RRM) of E3SMv2 and document a first-of-its-kind set of climate production simulations using RRM at an economic cost. The key to this success is our innovative hybrid time step method.
Chengzhu Zhang, Jean-Christophe Golaz, Ryan Forsyth, Tom Vo, Shaocheng Xie, Zeshawn Shaheen, Gerald L. Potter, Xylar S. Asay-Davis, Charles S. Zender, Wuyin Lin, Chih-Chieh Chen, Chris R. Terai, Salil Mahajan, Tian Zhou, Karthik Balaguru, Qi Tang, Cheng Tao, Yuying Zhang, Todd Emmenegger, Susannah Burrows, and Paul A. Ullrich
Geosci. Model Dev., 15, 9031–9056, https://doi.org/10.5194/gmd-15-9031-2022, https://doi.org/10.5194/gmd-15-9031-2022, 2022
Short summary
Short summary
Earth system model (ESM) developers run automated analysis tools on data from candidate models to inform model development. This paper introduces a new Python package, E3SM Diags, that has been developed to support ESM development and use routinely in the development of DOE's Energy Exascale Earth System Model. This tool covers a set of essential diagnostics to evaluate the mean physical climate from simulations, as well as several process-oriented and phenomenon-based evaluation diagnostics.
Yohanna Villalobos, Peter J. Rayner, Jeremy D. Silver, Steven Thomas, Vanessa Haverd, Jürgen Knauer, Zoë M. Loh, Nicholas M. Deutscher, David W. T. Griffith, and David F. Pollard
Atmos. Chem. Phys., 22, 8897–8934, https://doi.org/10.5194/acp-22-8897-2022, https://doi.org/10.5194/acp-22-8897-2022, 2022
Short summary
Short summary
We study the interannual variability in Australian carbon fluxes for 2015–2019 derived from OCO-2 satellite data. Our results suggest that Australia's semi-arid ecosystems are highly responsive to variations in climate drivers such as rainfall and temperature. We found that high rainfall and low temperatures recorded in 2016 led to an anomalous carbon sink over savanna and sparsely vegetated regions, while unprecedented dry and hot weather in 2019 led to anomalous carbon release.
Matthew K. Laffin, Charles S. Zender, Melchior van Wessem, and Sebastián Marinsek
The Cryosphere, 16, 1369–1381, https://doi.org/10.5194/tc-16-1369-2022, https://doi.org/10.5194/tc-16-1369-2022, 2022
Short summary
Short summary
The collapses of the Larsen A and B ice shelves on the Antarctic Peninsula (AP) occurred while the ice shelves were covered with large melt lakes, and ocean waves damaged the ice shelf fronts, triggering collapse. Observations show föhn winds were present on both ice shelves and increased surface melt and drove sea ice away from the ice front. Collapsed ice shelves experienced enhanced surface melt driven by föhn winds, whereas extant ice shelves are affected less by föhn-wind-induced melt.
Chloe A. Whicker, Mark G. Flanner, Cheng Dang, Charles S. Zender, Joseph M. Cook, and Alex S. Gardner
The Cryosphere, 16, 1197–1220, https://doi.org/10.5194/tc-16-1197-2022, https://doi.org/10.5194/tc-16-1197-2022, 2022
Short summary
Short summary
Snow and ice surfaces are important to the global climate. Current climate models use measurements to determine the reflectivity of ice. This model uses physical properties to determine the reflectivity of snow, ice, and darkly pigmented impurities that reside within the snow and ice. Therefore, the modeled reflectivity is more accurate for snow/ice columns under varying climate conditions. This model paves the way for improvements in the portrayal of snow and ice within global climate models.
Mark G. Flanner, Julian B. Arnheim, Joseph M. Cook, Cheng Dang, Cenlin He, Xianglei Huang, Deepak Singh, S. McKenzie Skiles, Chloe A. Whicker, and Charles S. Zender
Geosci. Model Dev., 14, 7673–7704, https://doi.org/10.5194/gmd-14-7673-2021, https://doi.org/10.5194/gmd-14-7673-2021, 2021
Short summary
Short summary
We present the technical formulation and evaluation of a publicly available code and web-based model to simulate the spectral albedo of snow. Our model accounts for numerous features of the snow state and ambient conditions, including the the presence of light-absorbing matter like black and brown carbon, mineral dust, volcanic ash, and snow algae. Carbon dioxide snow, found on Mars, is also represented. The model accurately reproduces spectral measurements of clean and contaminated snow.
Yohanna Villalobos, Peter J. Rayner, Jeremy D. Silver, Steven Thomas, Vanessa Haverd, Jürgen Knauer, Zoë M. Loh, Nicholas M. Deutscher, David W. T. Griffith, and David F. Pollard
Atmos. Chem. Phys., 21, 17453–17494, https://doi.org/10.5194/acp-21-17453-2021, https://doi.org/10.5194/acp-21-17453-2021, 2021
Short summary
Short summary
Semi-arid ecosystems such as those in Australia are evolving and might play an essential role in the future of climate change. We use carbon dioxide concentrations derived from the OCO-2 satellite instrument and a regional transport model to understand if Australia was a carbon sink or source of CO2 in 2015. Our research's main findings suggest that Australia acted as a carbon sink of about −0.41 ± 0.08 petagrams of carbon in 2015, driven primarily by savanna and sparsely vegetated ecosystems.
Adrian Chappell, Nicholas Webb, Mark Hennen, Charles Zender, Philippe Ciais, Kerstin Schepanski, Brandon Edwards, Nancy Ziegler, Sandra Jones, Yves Balkanski, Daniel Tong, John Leys, Stephan Heidenreich, Robert Hynes, David Fuchs, Zhenzhong Zeng, Marie Ekström, Matthew Baddock, Jeffrey Lee, and Tarek Kandakji
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2021-337, https://doi.org/10.5194/gmd-2021-337, 2021
Revised manuscript not accepted
Short summary
Short summary
Dust emissions influence global climate while simultaneously reducing the productive potential and resilience of landscapes to climate stressors, together impacting food security and human health. Our results indicate that tuning dust emission models to dust in the atmosphere has hidden dust emission modelling weaknesses and its poor performance. Our new approach will reduce uncertainty and driven by prognostic albedo improve Earth System Models of aerosol effects on future environmental change.
Robert G. Ryan, Jeremy D. Silver, Richard Querel, Dan Smale, Steve Rhodes, Matt Tully, Nicholas Jones, and Robyn Schofield
Atmos. Meas. Tech., 13, 6501–6519, https://doi.org/10.5194/amt-13-6501-2020, https://doi.org/10.5194/amt-13-6501-2020, 2020
Short summary
Short summary
Models have identified Australasia as a formaldehyde (HCHO) hotspot from vegetation sources, but few measurement studies exist to verify this. We compare, and find good agreement between, HCHO measurements using three – two ground-based and one satellite-based – different spectroscopic techniques in Australia and New Zealand. This gives confidence in using satellite observations to study HCHO and associated air chemistry and pollution problems in this under-studied part of the world.
Adam M. Schneider, Charles S. Zender, and Stephen F. Price
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2020-247, https://doi.org/10.5194/gmd-2020-247, 2020
Preprint withdrawn
Short summary
Short summary
We enhance the Energy Exascale Earth System Model's land
component (ELM) to better represent multi-year snow (firn) on ice sheets. Our
developments reveal ELM deficiencies regarding firn density, a fundamental
property in glaciology. To improve firn density profiles, we fine tune
ELM's snowpack parameters using statistical modeling. Our findings demonstrate
how ELM can simulate both seasonal snow and firn on ice sheets and advance a
broader effort to better predict sea level rise.
Yohanna Villalobos, Peter Rayner, Steven Thomas, and Jeremy Silver
Atmos. Chem. Phys., 20, 8473–8500, https://doi.org/10.5194/acp-20-8473-2020, https://doi.org/10.5194/acp-20-8473-2020, 2020
Short summary
Short summary
Estimated carbon fluxes for Australia are subject to considerable uncertainty. We ran simulation experiments over Australia to determine how much these uncertainties can be constrained using satellite data. We found that the satellite data has the potential to reduce these uncertainties up to 80 % across the whole continent. For 1 month, this percentage corresponds to 0.51 Pg C y-1 for Australia. This method could lead to significantly more accurate estimates of Australia's carbon budget.
Cheng Dang, Charles S. Zender, and Mark G. Flanner
The Cryosphere, 13, 2325–2343, https://doi.org/10.5194/tc-13-2325-2019, https://doi.org/10.5194/tc-13-2325-2019, 2019
Alexander J. Norton, Peter J. Rayner, Ernest N. Koffi, Marko Scholze, Jeremy D. Silver, and Ying-Ping Wang
Biogeosciences, 16, 3069–3093, https://doi.org/10.5194/bg-16-3069-2019, https://doi.org/10.5194/bg-16-3069-2019, 2019
Short summary
Short summary
This study presents an estimate of global terrestrial photosynthesis. We make use of satellite chlorophyll fluorescence measurements, a visible indicator of photosynthesis, to optimize model parameters and estimate photosynthetic carbon uptake. This new framework incorporates nonlinear, process-based understanding of the link between fluorescence and photosynthesis, an advance on past approaches. This will aid in the utility of fluorescence to quantify terrestrial carbon cycle feedbacks.
Qi Tang, Stephen A. Klein, Shaocheng Xie, Wuyin Lin, Jean-Christophe Golaz, Erika L. Roesler, Mark A. Taylor, Philip J. Rasch, David C. Bader, Larry K. Berg, Peter Caldwell, Scott E. Giangrande, Richard B. Neale, Yun Qian, Laura D. Riihimaki, Charles S. Zender, Yuying Zhang, and Xue Zheng
Geosci. Model Dev., 12, 2679–2706, https://doi.org/10.5194/gmd-12-2679-2019, https://doi.org/10.5194/gmd-12-2679-2019, 2019
Kathryn M. Emmerson, Jeremy D. Silver, Edward Newbigin, Edwin R. Lampugnani, Cenk Suphioglu, Alan Wain, and Elizabeth Ebert
Geosci. Model Dev., 12, 2195–2214, https://doi.org/10.5194/gmd-12-2195-2019, https://doi.org/10.5194/gmd-12-2195-2019, 2019
Short summary
Short summary
We present the first representation of grass pollen in a 3-D dispersion model in Australia, tested using observations from eight counting sites in Victoria. The technology was developed in response to the severe thunderstorm asthma event which took place in Melbourne in November 2016. A total of 10 pollen emission methodologies were developed and evaluated. The best results were obtained using statistical methods that included elements of the satellite derived enhanced vegetation index.
Katherine J. Evans, Joseph H. Kennedy, Dan Lu, Mary M. Forrester, Stephen Price, Jeremy Fyke, Andrew R. Bennett, Matthew J. Hoffman, Irina Tezaur, Charles S. Zender, and Miren Vizcaíno
Geosci. Model Dev., 12, 1067–1086, https://doi.org/10.5194/gmd-12-1067-2019, https://doi.org/10.5194/gmd-12-1067-2019, 2019
Short summary
Short summary
A robust validation of ice sheet models is presented using LIVVkit, version 2.1. It targets ice sheet and coupled Earth system models, and handles datasets and operations that require high-performance computing and storage. We apply LIVVkit to a Greenland ice sheet simulation to show the degree to which it captures the surface mass balance. LIVVkit identifies a positive bias due to insufficient melting compared to observations that is focused largely around Greenland's southwest region.
Alexander J. Norton, Peter J. Rayner, Ernest N. Koffi, Marko Scholze, Jeremy D. Silver, and Ying-Ping Wang
Biogeosciences Discuss., https://doi.org/10.5194/bg-2018-270, https://doi.org/10.5194/bg-2018-270, 2018
Revised manuscript has not been submitted
Short summary
Short summary
This study presents a global estimate of land carbon uptake through photosynthesis. We make use satellite chlorophyll fluorescence measurements, a visible indicator of photosynthesis, to optimize model parameters and then use the optimized model to estimate photosynthetic carbon uptake. This provides a new tool that can combine measurements and observations in a systematic way and maximise the use of chlorophyll fluorescence to improve our understanding of the land carbon cycle.
Charles S. Zender
Geosci. Model Dev., 9, 3199–3211, https://doi.org/10.5194/gmd-9-3199-2016, https://doi.org/10.5194/gmd-9-3199-2016, 2016
Short summary
Short summary
We introduce Bit Grooming, a lossy compression algorithm that removes the bloat due to false precision, those bits and bytes beyond the meaningful precision of the data. Bit Grooming is statistically unbiased, applies to all floating-point numbers, and is easy to use. Bit Grooming reduces data storage requirements by 25–80 %. Unlike its best-known competitor Linear Packing, Bit Grooming imposes no software overhead on users, and guarantees its precision throughout the whole floating-point range.
Wenshan Wang, Charles S. Zender, Dirk van As, Paul C. J. P. Smeets, and Michiel R. van den Broeke
The Cryosphere, 10, 727–741, https://doi.org/10.5194/tc-10-727-2016, https://doi.org/10.5194/tc-10-727-2016, 2016
Short summary
Short summary
We identify and correct station-tilt-induced biases in insolation observed by automatic weather stations on the Greenland Ice Sheet. Without tilt correction, only 40 % of clear days have the correct solar noon time (±0.5 h). The largest hourly bias exceeds 20 %. We estimate the tilt angles based on solar geometric relationship between insolation observed on horizontal surfaces and that on tilted surfaces, and produce shortwave radiation and albedo that agree better with independent data sets.
K. M. Hansen, J. H. Christensen, C. Geels, J. D. Silver, and J. Brandt
Atmos. Chem. Phys., 15, 6549–6559, https://doi.org/10.5194/acp-15-6549-2015, https://doi.org/10.5194/acp-15-6549-2015, 2015
R. A. Scanza, N. Mahowald, S. Ghan, C. S. Zender, J. F. Kok, X. Liu, Y. Zhang, and S. Albani
Atmos. Chem. Phys., 15, 537–561, https://doi.org/10.5194/acp-15-537-2015, https://doi.org/10.5194/acp-15-537-2015, 2015
Short summary
Short summary
The main purpose of this study was to build a framework in the Community Atmosphere Models version 4 and 5 within the Community Earth System Model to simulate dust aerosols as their component minerals. With this framework, we investigate the direct radiative forcing that results from the mineral speciation. We find that adding mineralogy results in a small positive forcing at the top of the atmosphere, while simulations without mineralogy have a small negative forcing.
J. Brandt, J. D. Silver, J. H. Christensen, M. S. Andersen, J. H. Bønløkke, T. Sigsgaard, C. Geels, A. Gross, A. B. Hansen, K. M. Hansen, G. B. Hedegaard, E. Kaas, and L. M. Frohn
Atmos. Chem. Phys., 13, 7725–7746, https://doi.org/10.5194/acp-13-7725-2013, https://doi.org/10.5194/acp-13-7725-2013, 2013
J. Brandt, J. D. Silver, J. H. Christensen, M. S. Andersen, J. H. Bønløkke, T. Sigsgaard, C. Geels, A. Gross, A. B. Hansen, K. M. Hansen, G. B. Hedegaard, E. Kaas, and L. M. Frohn
Atmos. Chem. Phys., 13, 7747–7764, https://doi.org/10.5194/acp-13-7747-2013, https://doi.org/10.5194/acp-13-7747-2013, 2013
E. Solazzo, R. Bianconi, G. Pirovano, M. D. Moran, R. Vautard, C. Hogrefe, K. W. Appel, V. Matthias, P. Grossi, B. Bessagnet, J. Brandt, C. Chemel, J. H. Christensen, R. Forkel, X. V. Francis, A. B. Hansen, S. McKeen, U. Nopmongcol, M. Prank, K. N. Sartelet, A. Segers, J. D. Silver, G. Yarwood, J. Werhahn, J. Zhang, S. T. Rao, and S. Galmarini
Geosci. Model Dev., 6, 791–818, https://doi.org/10.5194/gmd-6-791-2013, https://doi.org/10.5194/gmd-6-791-2013, 2013
M. G. Tosca, J. T. Randerson, and C. S. Zender
Atmos. Chem. Phys., 13, 5227–5241, https://doi.org/10.5194/acp-13-5227-2013, https://doi.org/10.5194/acp-13-5227-2013, 2013
Related subject area
Numerical methods
A dynamical core based on a discontinuous Galerkin method for higher-order finite-element sea ice modeling
GStatSim V1.0: a Python package for geostatistical interpolation and conditional simulation
Leveraging Google's Tensor Processing Units for tsunami-risk mitigation planning in the Pacific Northwest and beyond
An improved subgrid channel model with upwind-form artificial diffusion for river hydrodynamics and floodplain inundation simulation
A model instability issue in the National Centers for Environmental Prediction Global Forecast System version 16 and potential solutions
A comparison of 3-D spherical shell thermal convection results at low to moderate Rayleigh number using ASPECT (version 2.2.0) and CitcomS (version 3.3.1)
LISFLOOD-FP 8.1: new GPU-accelerated solvers for faster fluvial/pluvial flood simulations
Fast approximate Barnes interpolation: illustrated by Python-Numba implementation fast-barnes-py v1.0
Strategies for conservative and non-conservative monotone remapping on the sphere
Modeling large‐scale landform evolution with a stream power law for glacial erosion (OpenLEM v37): benchmarking experiments against a more process-based description of ice flow (iSOSIA v3.4.3)
A mixed finite-element discretisation of the shallow-water equations
Multifidelity Monte Carlo estimation for efficient uncertainty quantification in climate-related modeling
Massively parallel modeling and inversion of electrical resistivity tomography data using PFLOTRAN
Parallelized domain decomposition for multi-dimensional Lagrangian random walk mass-transfer particle tracking schemes
The Intelligent Prospector v1.0: geoscientific model development and prediction by sequential data acquisition planning with application to mineral exploration
Predicting peak daily maximum 8 h ozone and linkages to emissions and meteorology in Southern California using machine learning methods (SoCAB-8HR V1.0)
Transfer learning for landslide susceptibility modeling using domain adaptation and case-based reasoning
ISMIP-HOM benchmark experiments using Underworld
spyro: a Firedrake-based wave propagation and full-waveform-inversion finite-element solver
Implementation and application of Ensemble Optimal Interpolation on an operational chemistry weather model for improving PM2.5 and visibility predictions
Spatial filtering in a 6D hybrid-Vlasov scheme to alleviate adaptive mesh refinement artifacts: a case study with Vlasiator (versions 5.0, 5.1, and 5.2.1)
A Bayesian data assimilation framework for lake 3D hydrodynamic models with a physics-preserving particle filtering method using SPUX-MITgcm v1
A fast, single-iteration ensemble Kalman smoother for sequential data assimilation
AutoQS v1: Automatic parameterization of QuickSampling based on training images analysis
Characterizing uncertainties of Earth system modeling with heterogeneous many-core architecture computing
Metrics for Intercomparison of Remapping Algorithms (MIRA) protocol applied to Earth system models
Impact of the numerical solution approach of a plant hydrodynamic model (v0.1) on vegetation dynamics
Islet: interpolation semi-Lagrangian element-based transport
Multi-dimensional hydrological–hydraulic model with variational data assimilation for river networks and floodplains
Assessing the robustness and scalability of the accelerated pseudo-transient method
Assessment of stochastic weather forecast of precipitation near European cities, based on analogs of circulation
University of Warsaw Lagrangian Cloud Model (UWLCM) 2.0: adaptation of a mixed Eulerian–Lagrangian numerical model for heterogeneous computing clusters
Prediction error growth in a more realistic atmospheric toy model with three spatiotemporal scales
On numerical broadening of particle-size spectra: a condensational growth study using PyMPDATA 1.0
Lossy checkpoint compression in full waveform inversion: a case study with ZFPv0.5.5 and the overthrust model
Blockworlds 0.1.0: a demonstration of anti-aliased geophysics for probabilistic inversions of implicit and kinematic geological models
Efficient high-dimensional variational data assimilation with machine-learned reduced-order models
Improved double Fourier series on a sphere and its application to a semi-implicit semi-Lagrangian shallow-water model
SciKit-GStat 1.0: a SciPy-flavored geostatistical variogram estimation toolbox written in Python
Flow-Py v1.0: a customizable, open-source simulation tool to estimate runout and intensity of gravitational mass flows
Emulation of high-resolution land surface models using sparse Gaussian processes with application to JULES
A three-dimensional variational data assimilation system for aerosol optical properties based on WRF-Chem v4.0: design, development, and application of assimilating Himawari-8 aerosol observations
Implementation of a Gaussian Markov random field sampler for forward uncertainty quantification in the Ice-sheet and Sea-level System Model v4.19
A method for assessment of the general circulation model quality using the K-means clustering algorithm: a case study with GETM v2.5
An explicit GPU-based material point method solver for elastoplastic problems (ep2-3De v1.0)
MagIC v5.10: a two-dimensional message-passing interface (MPI) distribution for pseudo-spectral magnetohydrodynamics simulations in spherical geometry
Machine-learning models to replicate large-eddy simulations of air pollutant concentrations along boulevard-type streets
Recalculation of error growth models' parameters for the ECMWF forecast system
How biased are our models? – a case study of the alpine region
B-flood 1.0: an open-source Saint-Venant model for flash-flood simulation using adaptive refinement
Thomas Richter, Véronique Dansereau, Christian Lessig, and Piotr Minakowski
Geosci. Model Dev., 16, 3907–3926, https://doi.org/10.5194/gmd-16-3907-2023, https://doi.org/10.5194/gmd-16-3907-2023, 2023
Short summary
Short summary
Sea ice covers not only the pole regions but affects the weather and climate globally. For example, its white surface reflects more sunlight than land. The oceans around the poles are therefore kept cool, which affects the circulation in the oceans worldwide. Simulating the behavior and changes in sea ice on a computer is, however, very difficult. We propose a new computer simulation that better models how cracks in the ice change over time and show this by comparing to other simulations.
Emma J. MacKie, Michael Field, Lijing Wang, Zhen Yin, Nathan Schoedl, Matthew Hibbs, and Allan Zhang
Geosci. Model Dev., 16, 3765–3783, https://doi.org/10.5194/gmd-16-3765-2023, https://doi.org/10.5194/gmd-16-3765-2023, 2023
Short summary
Short summary
Earth scientists often have to fill in spatial gaps in measurements. This gap-filling or interpolation can be accomplished with geostatistical methods, where the statistical relationships between measurements are used to inform how these gaps should be filled. Despite the broad utility of these methods, there are few freely available geostatistical software applications. We present GStatSim, a Python package for performing different geostatistical interpolation methods.
Ian Madden, Simone Marras, and Jenny Suckale
Geosci. Model Dev., 16, 3479–3500, https://doi.org/10.5194/gmd-16-3479-2023, https://doi.org/10.5194/gmd-16-3479-2023, 2023
Short summary
Short summary
To aid risk managers who may wish to rapidly assess tsunami risk but may lack high-performance computing infrastructure, we provide an accessible software package able to rapidly model tsunami inundation over real topography by leveraging Google's Tensor Processing Unit, a high-performance hardware. Minimally trained users can take advantage of the rapid modeling abilities provided by this package via a web browser thanks to the ease of use of Google Cloud Platform.
Youtong Rong, Paul Bates, and Jeffrey Neal
Geosci. Model Dev., 16, 3291–3311, https://doi.org/10.5194/gmd-16-3291-2023, https://doi.org/10.5194/gmd-16-3291-2023, 2023
Short summary
Short summary
A novel subgrid channel (SGC) model is developed for river–floodplain modelling, allowing utilization of subgrid-scale bathymetric information while performing computations on relatively coarse grids. By including adaptive artificial diffusion, potential numerical instability, which the original SGC solver had, in low-friction regions such as urban areas is addressed. Evaluation of the new SGC model through structured tests confirmed that the accuracy and stability have improved.
Xiaqiong Zhou and Hann-Ming Henry Juang
Geosci. Model Dev., 16, 3263–3274, https://doi.org/10.5194/gmd-16-3263-2023, https://doi.org/10.5194/gmd-16-3263-2023, 2023
Short summary
Short summary
The National Centers for Environmental Prediction Global Forecast System version 16 experienced model instability failures in real-time runs resolved by increasing the minimum thickness depth parameter. Further investigation revealed that the issue was caused by the advection of geopotential heights at the model's layer interfaces. By replacing high-order boundary conditions with zero-gradient boundary conditions for interface-wind reconstruction, the instability was effectively addressed.
Grant T. Euen, Shangxin Liu, Rene Gassmöller, Timo Heister, and Scott D. King
Geosci. Model Dev., 16, 3221–3239, https://doi.org/10.5194/gmd-16-3221-2023, https://doi.org/10.5194/gmd-16-3221-2023, 2023
Short summary
Short summary
Due to the increasing availability of high-performance computing over the past few decades, numerical models have become an important tool for research. Here we test two geodynamic codes that produce such models: ASPECT, a newer code, and CitcomS, an older one. We show that they produce solutions that are extremely close. As methods and codes become more complex over time, showing reproducibility allows us to seamlessly link previously known information to modern methodologies.
Mohammad Kazem Sharifian, Georges Kesserwani, Alovya Ahmed Chowdhury, Jeffrey Neal, and Paul Bates
Geosci. Model Dev., 16, 2391–2413, https://doi.org/10.5194/gmd-16-2391-2023, https://doi.org/10.5194/gmd-16-2391-2023, 2023
Short summary
Short summary
This paper describes a new release of the LISFLOOD-FP model for fast and efficient flood simulations. It features a new non-uniform grid generator that uses multiwavelet analyses to sensibly coarsens the resolutions where the local topographic variations are smooth. Moreover, the model is parallelised on the graphical processing units (GPUs) to further boost computational efficiency. The performance of the model is assessed for five real-world case studies, noting its potential applications.
Bruno K. Zürcher
Geosci. Model Dev., 16, 1697–1711, https://doi.org/10.5194/gmd-16-1697-2023, https://doi.org/10.5194/gmd-16-1697-2023, 2023
Short summary
Short summary
We present a novel algorithm to efficiently compute Barnes interpolation, which is a method for transforming data values recorded at irregularly spaced points into a corresponding regular grid. In contrast to naive implementations with an algorithmic complexity that depends on the product of the number of sample points and the number of grid points, our approach reduces this dependency to their sum.
David H. Marsico and Paul A. Ullrich
Geosci. Model Dev., 16, 1537–1551, https://doi.org/10.5194/gmd-16-1537-2023, https://doi.org/10.5194/gmd-16-1537-2023, 2023
Short summary
Short summary
Climate models involve several different components, such as the atmosphere, ocean, and land models. Information needs to be exchanged, or remapped, between these models, and devising algorithms for performing this exchange is important for ensuring the accuracy of climate simulations. In this paper, we examine the efficacy of several traditional and novel approaches to remapping on the sphere and demonstrate where our approaches offer improvement.
Moritz Liebl, Jörg Robl, Stefan Hergarten, David Lundbek Egholm, and Kurt Stüwe
Geosci. Model Dev., 16, 1315–1343, https://doi.org/10.5194/gmd-16-1315-2023, https://doi.org/10.5194/gmd-16-1315-2023, 2023
Short summary
Short summary
In this study, we benchmark a topography-based model for glacier erosion (OpenLEM) with a well-established process-based model (iSOSIA). Our experiments show that large-scale erosion patterns and particularly the transformation of valley length geometry from fluvial to glacial conditions are very similar in both models. This finding enables the application of OpenLEM to study the influence of climate and tectonics on glaciated mountains with reasonable computational effort on standard PCs.
James Kent, Thomas Melvin, and Golo Albert Wimmer
Geosci. Model Dev., 16, 1265–1276, https://doi.org/10.5194/gmd-16-1265-2023, https://doi.org/10.5194/gmd-16-1265-2023, 2023
Short summary
Short summary
This paper introduces the Met Office's new shallow water model. The shallow water model is a building block towards the Met Office's new atmospheric dynamical core. The shallow water model is tested on a number of standard spherical shallow water test cases, including flow over mountains and unstable jets. Results show that the model produces similar results to other shallow water models in the literature.
Anthony Gruber, Max Gunzburger, Lili Ju, Rihui Lan, and Zhu Wang
Geosci. Model Dev., 16, 1213–1229, https://doi.org/10.5194/gmd-16-1213-2023, https://doi.org/10.5194/gmd-16-1213-2023, 2023
Short summary
Short summary
This work applies a novel technical tool, multifidelity Monte Carlo (MFMC) estimation, to three climate-related benchmark experiments involving oceanic, atmospheric, and glacial modeling. By considering useful quantities such as maximum sea height and total (kinetic) energy, we show that MFMC leads to predictions which are more accurate and less costly than those obtained by standard methods. This suggests MFMC as a potential drop-in replacement for estimation in realistic climate models.
Piyoosh Jaysaval, Glenn E. Hammond, and Timothy C. Johnson
Geosci. Model Dev., 16, 961–976, https://doi.org/10.5194/gmd-16-961-2023, https://doi.org/10.5194/gmd-16-961-2023, 2023
Short summary
Short summary
We present a robust and highly scalable implementation of numerical forward modeling and inversion algorithms for geophysical electrical resistivity tomography data. The implementation is publicly available and developed within the framework of PFLOTRAN (http://www.pflotran.org), an open-source, state-of-the-art massively parallel subsurface flow and transport simulation code. The paper details all the theoretical and implementation aspects of the new capabilities along with test examples.
Lucas Schauer, Michael J. Schmidt, Nicholas B. Engdahl, Stephen D. Pankavich, David A. Benson, and Diogo Bolster
Geosci. Model Dev., 16, 833–849, https://doi.org/10.5194/gmd-16-833-2023, https://doi.org/10.5194/gmd-16-833-2023, 2023
Short summary
Short summary
We develop a multi-dimensional, parallelized domain decomposition strategy for mass-transfer particle tracking methods in two and three dimensions, investigate different procedures for decomposing the domain, and prescribe an optimal tiling based on physical problem parameters and the number of available CPU cores. For an optimally subdivided diffusion problem, the parallelized algorithm achieves nearly perfect linear speedup in comparison with the serial run-up to thousands of cores.
John Mern and Jef Caers
Geosci. Model Dev., 16, 289–313, https://doi.org/10.5194/gmd-16-289-2023, https://doi.org/10.5194/gmd-16-289-2023, 2023
Short summary
Short summary
In this work, we formulate the sequential geoscientific data acquisition problem as a problem that is similar to playing chess against nature, except the pieces are not fully observed. Solutions to these problems are given in AI and rarely used in geoscientific data planning. We illustrate our approach to a simple 2D problem of mineral exploration.
Ziqi Gao, Yifeng Wang, Petros Vasilakos, Cesunica E. Ivey, Khanh Do, and Armistead G. Russell
Geosci. Model Dev., 15, 9015–9029, https://doi.org/10.5194/gmd-15-9015-2022, https://doi.org/10.5194/gmd-15-9015-2022, 2022
Short summary
Short summary
While the national ambient air quality standard of ozone is based on the 3-year average of the fourth highest 8 h maximum (MDA8) ozone concentrations, these predicted extreme values using numerical methods are always biased low. We built four computational models (GAM, MARS, random forest and SVR) to predict the fourth highest MDA8 ozone in Southern California using precursor emissions, meteorology and climatological patterns. All models presented acceptable performance, with GAM being the best.
Zhihao Wang, Jason Goetz, and Alexander Brenning
Geosci. Model Dev., 15, 8765–8784, https://doi.org/10.5194/gmd-15-8765-2022, https://doi.org/10.5194/gmd-15-8765-2022, 2022
Short summary
Short summary
A lack of inventory data can be a limiting factor in developing landslide predictive models, which are crucial for supporting hazard policy and decision-making. We show how case-based reasoning and domain adaptation (transfer-learning techniques) can effectively retrieve similar landslide modeling situations for prediction in new data-scarce areas. Using cases in Italy, Austria, and Ecuador, our findings support the application of transfer learning for areas that require rapid model development.
Till Sachau, Haibin Yang, Justin Lang, Paul D. Bons, and Louis Moresi
Geosci. Model Dev., 15, 8749–8764, https://doi.org/10.5194/gmd-15-8749-2022, https://doi.org/10.5194/gmd-15-8749-2022, 2022
Short summary
Short summary
Knowledge of the internal structures of the major continental ice sheets is improving, thanks to new investigative techniques. These structures are an essential indication of the flow behavior and dynamics of ice transport, which in turn is important for understanding the actual impact of the vast amounts of water trapped in continental ice sheets on global sea-level rise. The software studied here is specifically designed to simulate such structures and their evolution.
Keith J. Roberts, Alexandre Olender, Lucas Franceschini, Robert C. Kirby, Rafael S. Gioria, and Bruno S. Carmo
Geosci. Model Dev., 15, 8639–8667, https://doi.org/10.5194/gmd-15-8639-2022, https://doi.org/10.5194/gmd-15-8639-2022, 2022
Short summary
Short summary
Finite-element methods (FEMs) permit the use of more flexible unstructured meshes but are rarely used in full waveform inversions (FWIs), an iterative process that reconstructs velocity models of earth’s subsurface, due to computational and memory storage costs. To reduce those costs, novel software is presented allowing the use of high-order mass-lumped FEMs on triangular meshes, together with a material-property mesh-adaptation performance-enhancing strategy, enabling its use in FWIs.
Siting Li, Ping Wang, Hong Wang, Yue Peng, Zhaodong Liu, Wenjie Zhang, Hongli Liu, Yaqiang Wang, Huicheng Che, and Xiaoye Zhang
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2022-207, https://doi.org/10.5194/gmd-2022-207, 2022
Revised manuscript accepted for GMD
Short summary
Short summary
Optimizing the initial state of atmospheric chemistry model chemistry is one of the essential methods to improve forecast accuracy. Considering the large computational load of the model, we introduce an ensemble optimal interpolation scheme (EnOI) for operational use and efficient updating of the initial fields of chemical components. The results suggest that EnOI provides a practical and cost-effective technique for improving the accuracy of chemical weather numerical forecasts.
Konstantinos Papadakis, Yann Pfau-Kempf, Urs Ganse, Markus Battarbee, Markku Alho, Maxime Grandin, Maxime Dubart, Lucile Turc, Hongyang Zhou, Konstantinos Horaites, Ivan Zaitsev, Giulia Cozzani, Maarja Bussov, Evgeny Gordeev, Fasil Tesema, Harriet George, Jonas Suni, Vertti Tarvus, and Minna Palmroth
Geosci. Model Dev., 15, 7903–7912, https://doi.org/10.5194/gmd-15-7903-2022, https://doi.org/10.5194/gmd-15-7903-2022, 2022
Short summary
Short summary
Vlasiator is a plasma simulation code that simulates the entire near-Earth space at a global scale. As 6D simulations require enormous amounts of computational resources, Vlasiator uses adaptive mesh refinement (AMR) to lighten the computational burden. However, due to Vlasiator’s grid topology, AMR simulations suffer from grid aliasing artifacts that affect the global results. In this work, we present and evaluate the performance of a mechanism for alleviating those artifacts.
Artur Safin, Damien Bouffard, Firat Ozdemir, Cintia L. Ramón, James Runnalls, Fotis Georgatos, Camille Minaudo, and Jonas Šukys
Geosci. Model Dev., 15, 7715–7730, https://doi.org/10.5194/gmd-15-7715-2022, https://doi.org/10.5194/gmd-15-7715-2022, 2022
Short summary
Short summary
Reconciling the differences between numerical model predictions and observational data is always a challenge. In this paper, we investigate the viability of a novel approach to the calibration of a three-dimensional hydrodynamic model of Lake Geneva, where the target parameters are inferred in terms of distributions. We employ a filtering technique that generates physically consistent model trajectories and implement a neural network to enable bulk-to-skin temperature conversion.
Colin Grudzien and Marc Bocquet
Geosci. Model Dev., 15, 7641–7681, https://doi.org/10.5194/gmd-15-7641-2022, https://doi.org/10.5194/gmd-15-7641-2022, 2022
Short summary
Short summary
Iterative optimization techniques, the state of the art in data assimilation, have largely focused on extending forecast accuracy to moderate- to long-range forecast systems. However, current methodology may not be cost-effective in reducing forecast errors in online, short-range forecast systems. We propose a novel optimization of these techniques for online, short-range forecast cycles, simultaneously providing an improvement in forecast accuracy and a reduction in the computational cost.
Mathieu Gravey and Grégoire Mariethoz
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2022-229, https://doi.org/10.5194/gmd-2022-229, 2022
Revised manuscript accepted for GMD
Short summary
Short summary
Multiple‐point geostatistics are widely used to simulate complex spatial structures based on a training image. The use of these methods relies on the possibility of finding optimal training images and parametrization of the simulation algorithms. Here, we propose finding an optimal set of parameters using only the training image as input. The main advantage of our approach is to remove the risk of overfitting an objective function.
Yangyang Yu, Shaoqing Zhang, Haohuan Fu, Lixin Wu, Dexun Chen, Yang Gao, Zhiqiang Wei, Dongning Jia, and Xiaopei Lin
Geosci. Model Dev., 15, 6695–6708, https://doi.org/10.5194/gmd-15-6695-2022, https://doi.org/10.5194/gmd-15-6695-2022, 2022
Short summary
Short summary
To understand the scientific consequence of perturbations caused by slave cores in heterogeneous computing environments, we examine the influence of perturbation amplitudes on the determination of the cloud bottom and cloud top and compute the probability density function (PDF) of generated clouds. A series of comparisons of the PDFs between homogeneous and heterogeneous systems show consistently acceptable error tolerances when using slave cores in heterogeneous computing environments.
Vijay S. Mahadevan, Jorge E. Guerra, Xiangmin Jiao, Paul Kuberry, Yipeng Li, Paul Ullrich, David Marsico, Robert Jacob, Pavel Bochev, and Philip Jones
Geosci. Model Dev., 15, 6601–6635, https://doi.org/10.5194/gmd-15-6601-2022, https://doi.org/10.5194/gmd-15-6601-2022, 2022
Short summary
Short summary
Coupled Earth system models require transfer of field data between multiple components with varying spatial resolutions to determine the correct climate behavior. We present the Metrics for Intercomparison of Remapping Algorithms (MIRA) protocol to evaluate the accuracy, conservation properties, monotonicity, and local feature preservation of four different remapper algorithms for various unstructured mesh problems of interest. Future extensions to more practical use cases are also discussed.
Yilin Fang, L. Ruby Leung, Ryan Knox, Charlie Koven, and Ben Bond-Lamberty
Geosci. Model Dev., 15, 6385–6398, https://doi.org/10.5194/gmd-15-6385-2022, https://doi.org/10.5194/gmd-15-6385-2022, 2022
Short summary
Short summary
Accounting for water movement in the soil and water transport within the plant is important for plant growth in Earth system modeling. We implemented different numerical approaches for a plant hydrodynamic model and compared their impacts on the simulated aboveground biomass (AGB) at single points and globally. We found care should be taken when discretizing the number of soil layers for numerical simulations as it can significantly affect AGB if accuracy and computational costs are of concern.
Andrew M. Bradley, Peter A. Bosler, and Oksana Guba
Geosci. Model Dev., 15, 6285–6310, https://doi.org/10.5194/gmd-15-6285-2022, https://doi.org/10.5194/gmd-15-6285-2022, 2022
Short summary
Short summary
Tracer transport in atmosphere models can be computationally expensive. We describe a flexible and efficient interpolation semi-Lagrangian method, the Islet method. It permits using up to three grids that share an element grid: a dynamics grid for computing quantities such as the wind velocity; a physics parameterizations grid; and a tracer grid. The Islet method performs well on a number of verification problems and achieves high performance in the E3SM Atmosphere Model version 2.
Léo Pujol, Pierre-André Garambois, and Jérôme Monnier
Geosci. Model Dev., 15, 6085–6113, https://doi.org/10.5194/gmd-15-6085-2022, https://doi.org/10.5194/gmd-15-6085-2022, 2022
Short summary
Short summary
This contribution presents a new numerical model for representing hydraulic–hydrological quantities at the basin scale. It allows modeling large areas at a low computational cost, with fine zooms where needed. It allows the integration of local and satellite measurements, via data assimilation methods, to improve the model's match to observations. Using this capability, good matches to in situ observations are obtained on a model of the complex Adour river network with fine zooms on floodplains.
Ludovic Räss, Ivan Utkin, Thibault Duretz, Samuel Omlin, and Yuri Y. Podladchikov
Geosci. Model Dev., 15, 5757–5786, https://doi.org/10.5194/gmd-15-5757-2022, https://doi.org/10.5194/gmd-15-5757-2022, 2022
Short summary
Short summary
Continuum mechanics-based modelling of physical processes at large scale requires huge computational resources provided by massively parallel hardware such as graphical processing units. We present a suite of numerical algorithms, implemented using the Julia language, that efficiently leverages the parallelism. We demonstrate that our implementation is efficient, scalable and robust and showcase applications to various geophysical problems.
Meriem Krouma, Pascal Yiou, Céline Déandreis, and Soulivanh Thao
Geosci. Model Dev., 15, 4941–4958, https://doi.org/10.5194/gmd-15-4941-2022, https://doi.org/10.5194/gmd-15-4941-2022, 2022
Short summary
Short summary
We evaluated the skill of a stochastic weather generator (SWG) to forecast precipitation at different time scales and in different areas of western Europe from analogs of Z500 hPa. The SWG has the skill to simulate precipitation for 5 and 10 d. We found that forecast weaknesses can be associated with specific weather patterns. The comparison with ECMWF forecasts confirms the skill of our model. This work is important because it provides information about weather forecasts over specific areas.
Piotr Dziekan and Piotr Zmijewski
Geosci. Model Dev., 15, 4489–4501, https://doi.org/10.5194/gmd-15-4489-2022, https://doi.org/10.5194/gmd-15-4489-2022, 2022
Short summary
Short summary
Detailed computer simulations of clouds are important for understanding Earth's atmosphere and climate. The paper describes how the UWLCM has been adapted to work on supercomputers. A distinctive feature of UWLCM is that air flow is calculated by processors at the same time as cloud droplets are modeled by graphics cards. Thanks to this, use of computing resources is maximized and the time to complete simulations of large domains is not affected by communications between supercomputer nodes.
Hynek Bednář and Holger Kantz
Geosci. Model Dev., 15, 4147–4161, https://doi.org/10.5194/gmd-15-4147-2022, https://doi.org/10.5194/gmd-15-4147-2022, 2022
Short summary
Short summary
A scale-dependent error growth described by a power law or by a quadratic hypothesis is studied in Lorenz’s system with three spatiotemporal levels. The validity of power law is extended by including a saturation effect. The quadratic hypothesis can only serve as a first guess. In addition, we study the initial error growth for the ECMWF forecast system. Fitting the parameters, we conclude that there is an intrinsic limit of predictability after 22 days.
Michael A. Olesik, Jakub Banaśkiewicz, Piotr Bartman, Manuel Baumgartner, Simon Unterstrasser, and Sylwester Arabas
Geosci. Model Dev., 15, 3879–3899, https://doi.org/10.5194/gmd-15-3879-2022, https://doi.org/10.5194/gmd-15-3879-2022, 2022
Short summary
Short summary
In systems such as atmospheric clouds, droplets undergo growth through condensation of vapor. The broadness of the resultant size spectrum of droplets influences precipitation likelihood and the radiative properties of clouds. One of the inherent limitations of simulations of the problem is the so-called numerical diffusion causing overestimation of the spectrum width, hence the term numerical broadening. In the paper, we take a closer look at one of the algorithms used in this context: MPDATA.
Navjot Kukreja, Jan Hückelheim, Mathias Louboutin, John Washbourne, Paul H. J. Kelly, and Gerard J. Gorman
Geosci. Model Dev., 15, 3815–3829, https://doi.org/10.5194/gmd-15-3815-2022, https://doi.org/10.5194/gmd-15-3815-2022, 2022
Short summary
Short summary
Full waveform inversion (FWI) is a partial-differential equation (PDE)-constrained optimization problem that is notorious for its high computational load and memory footprint. In this paper we present a method that combines recomputation with lossy compression to accelerate the computation with minimal loss of precision in the results. We show this using experiments running FWI with a variety of compression settings on a popular academic dataset.
Richard Scalzo, Mark Lindsay, Mark Jessell, Guillaume Pirot, Jeremie Giraud, Edward Cripps, and Sally Cripps
Geosci. Model Dev., 15, 3641–3662, https://doi.org/10.5194/gmd-15-3641-2022, https://doi.org/10.5194/gmd-15-3641-2022, 2022
Short summary
Short summary
This paper addresses numerical challenges in reasoning about geological models constrained by sensor data, especially models that describe the history of an area in terms of a sequence of events. Our method ensures that small changes in simulated geological features, such as the position of a boundary between two rock layers, do not result in unrealistically large changes to resulting sensor measurements, as occur presently using several popular modeling packages.
Romit Maulik, Vishwas Rao, Jiali Wang, Gianmarco Mengaldo, Emil Constantinescu, Bethany Lusch, Prasanna Balaprakash, Ian Foster, and Rao Kotamarthi
Geosci. Model Dev., 15, 3433–3445, https://doi.org/10.5194/gmd-15-3433-2022, https://doi.org/10.5194/gmd-15-3433-2022, 2022
Short summary
Short summary
In numerical weather prediction, data assimilation is frequently utilized to enhance the accuracy of forecasts from equation-based models. In this work we use a machine learning framework that approximates a complex dynamical system given by the geopotential height. Instead of using an equation-based model, we utilize this machine-learned alternative to dramatically accelerate both the forecast and the assimilation of data, thereby reducing need for large computational resources.
Hiromasa Yoshimura
Geosci. Model Dev., 15, 2561–2597, https://doi.org/10.5194/gmd-15-2561-2022, https://doi.org/10.5194/gmd-15-2561-2022, 2022
Short summary
Short summary
This paper proposes a new double Fourier series (DFS) method on a sphere that improves the numerical stability of a model compared with conventional DFS methods. The shallow-water model and the advection model using the new DFS method give stable results without the appearance of high-wavenumber noise near the poles. The model using the new DFS method is faster than the model using spherical harmonics (especially at high resolutions) and gives almost the same results.
Mirko Mälicke
Geosci. Model Dev., 15, 2505–2532, https://doi.org/10.5194/gmd-15-2505-2022, https://doi.org/10.5194/gmd-15-2505-2022, 2022
Short summary
Short summary
I preset SciKit-GStat, a well-documented and tested Python package for variogram estimation. The variogram is the core means of geostatistics, which almost all other methods rely on. Geostatistical interpolation and field generation are widely spread in geoscience, i.e., for data assimilation or modeling.
While SciKit-GStat focuses on effective and intuitive variogram estimation, it can interface with other prominent packages and make its variograms available for a multitude of methods.
Christopher J. L. D'Amboise, Michael Neuhauser, Michaela Teich, Andreas Huber, Andreas Kofler, Frank Perzl, Reinhard Fromm, Karl Kleemayr, and Jan-Thomas Fischer
Geosci. Model Dev., 15, 2423–2439, https://doi.org/10.5194/gmd-15-2423-2022, https://doi.org/10.5194/gmd-15-2423-2022, 2022
Short summary
Short summary
The term gravitational mass flow (GMF) covers various natural hazard processes such as snow avalanches, rockfall, landslides, and debris flows. Here we present the open-source GMF simulation tool Flow-Py. The model equations are based on simple geometrical relations in three-dimensional terrain. We show that Flow-Py is an educational, innovative GMF simulation tool with three computational experiments: 1. validation of implementation, 2. performance, and 3. expandability.
Evan Baker, Anna B. Harper, Daniel Williamson, and Peter Challenor
Geosci. Model Dev., 15, 1913–1929, https://doi.org/10.5194/gmd-15-1913-2022, https://doi.org/10.5194/gmd-15-1913-2022, 2022
Short summary
Short summary
We have adapted machine learning techniques to build a model of the land surface in Great Britain. The model was trained using data from a very complex land surface model called JULES. Our model is faster at producing simulations and predictions and can investigate many different scenarios, which can be used to improve our understanding of the climate and could also be used to help make local decisions.
Daichun Wang, Wei You, Zengliang Zang, Xiaobin Pan, Yiwen Hu, and Yanfei Liang
Geosci. Model Dev., 15, 1821–1840, https://doi.org/10.5194/gmd-15-1821-2022, https://doi.org/10.5194/gmd-15-1821-2022, 2022
Short summary
Short summary
This paper presents a 3D variational data assimilation system for aerosol optical properties, including aerosol optical thickness (AOT) retrievals and lidar-based aerosol profiles, which was developed for a size-resolved sectional model in WRF-Chem. To directly assimilate aerosol optical properties, an observation operator based on the Mie scattering theory was designed. The results show that Himawari-8 AOT assimilation can significantly improve model aerosol analyses and forecasts.
Kevin Bulthuis and Eric Larour
Geosci. Model Dev., 15, 1195–1217, https://doi.org/10.5194/gmd-15-1195-2022, https://doi.org/10.5194/gmd-15-1195-2022, 2022
Short summary
Short summary
We present and implement a stochastic solver to sample spatially and temporal varying uncertain input parameters in the Ice-sheet and Sea-level System Model, such as ice thickness or surface mass balance. We represent these sources of uncertainty using Gaussian random fields with Matérn covariance function. We generate random samples of this random field using an efficient computational approach based on solving a stochastic partial differential equation.
Urmas Raudsepp and Ilja Maljutenko
Geosci. Model Dev., 15, 535–551, https://doi.org/10.5194/gmd-15-535-2022, https://doi.org/10.5194/gmd-15-535-2022, 2022
Short summary
Short summary
A model's ability to reproduce the state of a simulated object is always a subject of discussion. A new method for the multivariate assessment of numerical model skills uses the K-means algorithm for clustering model errors. All available data that fall into the model domain and simulation period are incorporated into the skill assessment. The clustered errors are used for spatial and temporal analysis of the model accuracy. The method can be applied to different types of geoscientific models.
Emmanuel Wyser, Yury Alkhimenkov, Michel Jaboyedoff, and Yury Y. Podladchikov
Geosci. Model Dev., 14, 7749–7774, https://doi.org/10.5194/gmd-14-7749-2021, https://doi.org/10.5194/gmd-14-7749-2021, 2021
Short summary
Short summary
We propose an implementation of the material point method using graphical processing units (GPUs) to solve elastoplastic problems in three-dimensional configurations, such as the granular collapse or the slumping mechanics, i.e., landslide. The computational power of GPUs promotes fast code executions, compared to a traditional implementation using central processing units (CPUs). This allows us to study complex three-dimensional problems tackling high spatial resolution.
Rafael Lago, Thomas Gastine, Tilman Dannert, Markus Rampp, and Johannes Wicht
Geosci. Model Dev., 14, 7477–7495, https://doi.org/10.5194/gmd-14-7477-2021, https://doi.org/10.5194/gmd-14-7477-2021, 2021
Short summary
Short summary
In this work we discuss a two-dimensional distributed parallelization of MagIC, an open-source code for the numerical solution of the magnetohydrodynamics equations. Such a parallelization involves several challenges concerning the distribution of work and data. We detail our algorithm and compare it with the established, optimized, one-dimensional distribution in the context of the dynamo benchmark and discuss the merits of both implementations.
Moritz Lange, Henri Suominen, Mona Kurppa, Leena Järvi, Emilia Oikarinen, Rafael Savvides, and Kai Puolamäki
Geosci. Model Dev., 14, 7411–7424, https://doi.org/10.5194/gmd-14-7411-2021, https://doi.org/10.5194/gmd-14-7411-2021, 2021
Short summary
Short summary
This study aims to replicate computationally expensive high-resolution large-eddy simulations (LESs) with regression models to simulate urban air quality and pollutant dispersion. The model development, including feature selection, model training and cross-validation, and detection of concept drift, has been described in detail. Of the models applied, log-linear regression shows the best performance. A regression model can replace LES unless high accuracy is needed.
Hynek Bednář, Aleš Raidl, and Jiří Mikšovský
Geosci. Model Dev., 14, 7377–7389, https://doi.org/10.5194/gmd-14-7377-2021, https://doi.org/10.5194/gmd-14-7377-2021, 2021
Short summary
Short summary
Forecast errors in numerical weather prediction systems grow in time. To quantify the impacts of this growth, parametric error growth models may be employed. This study recalculates and newly defines parameters for several statistic models approximating error growth in the ECMWF forecasting system. Accurate values of parameters are important because they are used to evaluate improvements of the forecasting systems or to estimate predictability.
Denise Degen, Cameron Spooner, Magdalena Scheck-Wenderoth, and Mauro Cacace
Geosci. Model Dev., 14, 7133–7153, https://doi.org/10.5194/gmd-14-7133-2021, https://doi.org/10.5194/gmd-14-7133-2021, 2021
Short summary
Short summary
In times of worldwide energy transitions, an understanding of the subsurface is increasingly important to provide renewable energy sources such as geothermal energy. To validate our understanding of the subsurface we require data. However, the data are usually not distributed equally and introduce a potential misinterpretation of the subsurface. Therefore, in this study we investigate the influence of measurements on temperature distribution in the European Alps.
Geoffroy Kirstetter, Olivier Delestre, Pierre-Yves Lagrée, Stéphane Popinet, and Christophe Josserand
Geosci. Model Dev., 14, 7117–7132, https://doi.org/10.5194/gmd-14-7117-2021, https://doi.org/10.5194/gmd-14-7117-2021, 2021
Short summary
Short summary
The development of forecasting tools may help to limit the impacts of flash floods. Our purpose here is to demonstrate the possibility of using b-flood, which is a 2D tool based on shallow-water equations and adaptive mesh refinement.
Cited articles
Baker, A. H., Xu, H., Dennis, J. M., Levy, M. N., Nychka, D., Mickelson, S. A., Edwards, J., Vertenstein, M., and Wegener, A.: A methodology for evaluating the impact of data compression on climate simulation data, in: Proceedings of the 23rd International Symposium on High-performance Parallel and Distributed Computing, Vancouver, BC, Canada, 23–27 June 2014, ACM, 203–214, 2014.
Berger, T.: Rate-Distortion Theory, in: Wiley Encyclopedia of Telecommunications, John Wiley & Sons, Inc., https://doi.org/10.1002/0471219282.eot142, 2003.
Caron, J.: Converting GRIB to netCDF-4: Compression studies, presentation to the workshop "Closing the GRIB/netCDF gap", European Centre for Medium Range Weather Forecasts (ECMWF), 24–25 September 2014, Reading, UK, available at: http://www.ecmwf.int/sites/default/files/elibrary/2014/13711-converting-grib-netcdf-4.pdf, last access: 17 June 2016, 2014.
Dee, D., Uppala, S., Simmons, A., Berrisford, P., Poli, P., Kobayashi, S., Andrae, U., Balmaseda, M., Balsamo, G., Bauer, P., and Bechtold, P.: The ERA-Interim reanalysis: Configuration and performance of the data assimilation system, Q. J. Roy. Meteor. Soc., 137, 553–597, 2011.
Deutsch, L. P.: DEFLATE compressed data format specification version 1.3, Tech. Rep. IETF RFC1951, Internet Engineering Task Force, 2008.
Di, S. and Cappello, F.: Fast error-bounded lossy HPC data compression with SZ, in: 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS), 23–27 May 2016, Chicago, IL, USA, https://doi.org/10.1109/IPDPS.2016.11, 2016.
Goldberg, D.: What every computer scientist should know about floating-point arithmetic, ACM Comput. Surv., 23, 5–48, 1991.
HDF5 Group: Performance evaluation report: gzip, bzip2 compression with and without shuffling algorithm, available at: https://support.hdfgroup.org/HDF5/doc_resource/H5Shuffle_Perf.pdf, last access: 17 June 2016, 2002.
HDF5 Group: Filters, available at: www.hdfgroup.org/services/filters.html, last access: 17 June 2016.
Hübbe, N., Wegener, A., Kunkel, J. M., Ling, Y., and Ludwig, T.: Evaluating lossy compression on climate data, in: International Supercomputing Conference, Springer, 343–356, 2013.
Huffman, D.: A Method for the Construction of Minimum-Redundancy Codes, Proceedings of the IRE, 40, 1098–1101, https://doi.org/10.1109/JRPROC.1952.273898, 1952.
Robinson, N. H., Prudden, R., and Arribas, A. A.: A practical approach to spatiotemporal data compression, arXiv preprint, arXiv:1604.03688, 2016.
Skodras, A., Christopoulos, C., and Ebrahimi, T.: The JPEG 2000 still image compression standard, IEEE Signal Proc. Mag., 18, 36–58, 2001.
Unidata: The netCDF User's Guide, Tech. rep., Unidata, UCAR, Boulder, CO, USA, available at: www.unidata.ucar.edu/software/netcdf/docs/user_guide.html, last access: 17 June 2016.
Woodring, J., Mniszewski, S., Brislawn, C., DeMarle, D., and Ahrens, J.: Revisiting wavelet compression for large-scale climate data using JPEG 2000 and ensuring data precision, in: IEEE Symposium on Large Data Analysis and Visualization, IEEE, 31–38, 2011.
Zender, C. S.: Analysis of self-describing gridded geoscience data with netCDF Operators (NCO), Environ. Modell. Softw., 23, 1338–1342, 2008.
Zender, C. S.: Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+), Geosci. Model Dev., 9, 3199–3211, https://doi.org/10.5194/gmd-9-3199-2016, 2016.
Ziv, J. and Lempel, A.: A universal algorithm for sequential data compression, IEEE T. Inform. Theory, 23, 337–343, 1977.
Ziv, J. and Lempel, A.: Compression of individual sequences via variable-rate coding, IEEE T. Inform. Theory, 24, 530–536, https://doi.org/10.1109/TIT.1978.1055934, 1978.
Short summary
Many modern scientific research projects generate large amounts of data. Storage space is valuable and may be limited; hence compression is vital. We tested different compression methods for large gridded data sets, assessing the space savings and the amount of precision lost. We found a general trade-off between precision and compression, with compression well-predicted by the entropy of the data set. A method introduced here proved to be a competitive archive format for gridded numerical data.
Many modern scientific research projects generate large amounts of data. Storage space is...