Journal cover Journal topic
Geoscientific Model Development An interactive open-access journal of the European Geosciences Union
Journal topic

Journal metrics

Journal metrics

  • IF value: 4.252 IF 4.252
  • IF 5-year value: 4.890 IF 5-year 4.890
  • CiteScore value: 4.49 CiteScore 4.49
  • SNIP value: 1.539 SNIP 1.539
  • SJR value: 2.404 SJR 2.404
  • IPP value: 4.28 IPP 4.28
  • h5-index value: 40 h5-index 40
  • Scimago H index value: 51 Scimago H index 51
Volume 9, issue 2
Geosci. Model Dev., 9, 731-748, 2016
https://doi.org/10.5194/gmd-9-731-2016
© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.

Special issue: Model infrastructure integration and interoperability (MI3)

Geosci. Model Dev., 9, 731-748, 2016
https://doi.org/10.5194/gmd-9-731-2016
© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.

Development and technical paper 19 Feb 2016

Development and technical paper | 19 Feb 2016

Bitwise identical compiling setup: prospective for reproducibility and reliability of Earth system modeling

R. Li1,2, L. Liu1,3, G. Yang1,2,3, C. Zhang1,2, and B. Wang1,3,4 R. Li et al.
  • 1Ministry of Education Key Laboratory for Earth System Modeling, Center for Earth System Science (CESS), Tsinghua University, Beijing, China
  • 2Department of Computer Science and Technology, Tsinghua University, Beijing, China
  • 3Joint Center for Global Change Studies (JCGCS), Beijing, China
  • 4State Key Laboratory of Numerical Modeling for Atmospheric Sciences and Geophysical Fluid Dynamics (LASG), Institute of Atmospheric Physics, Chinese Academy of Sciences, Beijing, China

Abstract. Reproducibility and reliability are fundamental principles of scientific research. A compiling setup that includes a specific compiler version and compiler flags is an essential technical support for Earth system modeling. With the fast development of computer software and hardware, a compiling setup has to be updated frequently, which challenges the reproducibility and reliability of Earth system modeling. The existing results of a simulation using an original compiling setup may be irreproducible by a newer compiling setup because trivial round-off errors introduced by the change in compiling setup can potentially trigger significant changes in simulation results. Regarding the reliability, a compiler with millions of lines of code may have bugs that are easily overlooked due to the uncertainties or unknowns in Earth system modeling. To address these challenges, this study shows that different compiling setups can achieve exactly the same (bitwise identical) results in Earth system modeling, and a set of bitwise identical compiling setups of a model can be used across different compiler versions and different compiler flags. As a result, the original results can be more easily reproduced; for example, the original results with an older compiler version can be reproduced exactly with a newer compiler version. Moreover, this study shows that new test cases can be generated based on the differences of bitwise identical compiling setups between different models, which can help detect software bugs in the codes of models and compilers and finally improve the reliability of Earth system modeling.

Publications Copernicus
Special issue
Download
Short summary
In this paper, we show that different compiling setups can achieve exactly the same (bitwise identical) results in Earth system modeling, and a set of bitwise identical compiling setups of a model can be used across different compiler versions and different compiler flags. Moreover, we shows that new test cases can be generated based on differences of bitwise identical compiling setups between different models, which can help detect software bugs and finally improve the reliability.
In this paper, we show that different compiling setups can achieve exactly the same (bitwise...
Citation
Share