Bitwise identical compiling setup: prospective for reproducibility and  reliability of Earth system modeling

Li, R.; Liu, L.; Yang, G.; Zhang, C.; Wang, B.

doi:https://doi.org/10.5194/gmd-9-731-2016

Articles | Volume 9, issue 2

https://doi.org/10.5194/gmd-9-731-2016

© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.

Special issue:

Model infrastructure integration and interoperability (MI3)

https://doi.org/10.5194/gmd-9-731-2016

© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.

Articles | Volume 9, issue 2

Development and technical paper

|

19 Feb 2016

Development and technical paper |

| 19 Feb 2016

Bitwise identical compiling setup: prospective for reproducibility and reliability of Earth system modeling

R. Li, L. Liu, G. Yang, C. Zhang, and B. Wang

Download

Final revised paper (published on 19 Feb 2016)
Supplement to the final revised paper
Preprint (discussion started on 10 Nov 2015)
Supplement to the preprint

Interactive discussion

Status: closed

AC: Author comment | RC: Referee comment | SC: Short comment | EC: Editor comment

- Printer-friendly version

- Supplement

RC C3149: 'Reply to gmd-2015-214, R. Li et al.', Anonymous Referee #1, 02 Dec 2015
- AC C3724: 'Reply to referee #1', Ruizhe Li, 18 Jan 2016
RC C3523: 'Comments on "Bitwise Identical Compiling Setup: Prospective for Reproducibility and Reliability of Earth System Modeling"', Anonymous Referee #2, 30 Dec 2015
- AC C3726: 'Reply to Referee #2', Ruizhe Li, 18 Jan 2016

Peer-review completion

AR: Author's response | RR: Referee report | ED: Editor decision

AR by Ruizhe Li on behalf of the Authors (18 Jan 2016) Author's response Manuscript

ED: Publish as is (02 Feb 2016) by Olivier Marti

Short summary

In this paper, we show that different compiling setups can achieve exactly the same (bitwise identical) results in Earth system modeling, and a set of bitwise identical compiling setups of a model can be used across different compiler versions and different compiler flags. Moreover, we shows that new test cases can be generated based on differences of bitwise identical compiling setups between different models, which can help detect software bugs and finally improve the reliability.