Journal cover Journal topic
Geoscientific Model Development An interactive open-access journal of the European Geosciences Union
Geosci. Model Dev., 9, 1747-1802, 2016
https://doi.org/10.5194/gmd-9-1747-2016
© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.
Methods for assessment of models
10 May 2016
ESMValTool (v1.0) – a community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP
Veronika Eyring1, Mattia Righi1, Axel Lauer1, Martin Evaldsson2, Sabrina Wenzel1, Colin Jones3,4, Alessandro Anav5, Oliver Andrews6, Irene Cionni7, Edouard L. Davin8, Clara Deser9, Carsten Ehbrecht10, Pierre Friedlingstein5, Peter Gleckler11, Klaus-Dirk Gottschaldt1, Stefan Hagemann12, Martin Juckes13, Stephan Kindermann10, John Krasting14, Dominik Kunert1, Richard Levine4, Alexander Loew15,12, Jarmo Mäkelä16, Gill Martin4, Erik Mason14,17, Adam S. Phillips9, Simon Read18, Catherine Rio19, Romain Roehrig20, Daniel Senftleben1, Andreas Sterl21, Lambertus H. van Ulft21, Jeremy Walton4, Shiyu Wang2, and Keith D. Williams4 1Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
2Swedish Meteorological and Hydrological Institute (SMHI), 60176 Norrköping, Sweden
3University of Leeds, Leeds, UK
4Met Office Hadley Centre, Exeter, UK
5University of Exeter, Exeter, UK
6Tyndall Centre for Climate Change Research, School of Environmental Sciences, University of East Anglia, Norwich, UK
7Agenzia nazionale per le nuove tecnologie, l'energia e lo sviluppo economico sostenibile (ENEA), Rome, Italy
8ETH Zurich, Zurich, Switzerland
9National Center for Atmospheric Research (NCAR), Boulder, USA
10Deutsches Klimarechenzentrum, Hamburg, Germany
11Program for Climate Model Diagnosis and Intercomparison, Lawrence Livermore National Laboratory, Livermore, CA, USA
12Max Planck Institute for Meteorology, Hamburg, Germany
13National Centre for Atmospheric Science, British Atmospheric Data Centre, STFC Rutherford Appleton Laboratory, Didcot, UK
14Geophysical Fluid Dynamics Laboratory/NOAA, Princeton, NJ, USA
15Ludwig-Maximilians-Universität München, Munich, Germany
16Finnish Meteorological Institute, Helsinki, Finland
17Engility Corporation, Chantilly, VA, USA
18University of Reading, Reading, UK
19Institut Pierre Simon Laplace, Paris, France
20CNRM-GAME, Météo France and CNRS, Toulouse, France
21Royal Netherlands Meteorological Institute (KNMI), De Bilt, the Netherlands
Abstract. A community diagnostics and performance metrics tool for the evaluation of Earth system models (ESMs) has been developed that allows for routine comparison of single or multiple models, either against predecessor versions or against observations. The priority of the effort so far has been to target specific scientific themes focusing on selected essential climate variables (ECVs), a range of known systematic biases common to ESMs, such as coupled tropical climate variability, monsoons, Southern Ocean processes, continental dry biases, and soil hydrology–climate interactions, as well as atmospheric CO2 budgets, tropospheric and stratospheric ozone, and tropospheric aerosols. The tool is being developed in such a way that additional analyses can easily be added. A set of standard namelists for each scientific topic reproduces specific sets of diagnostics or performance metrics that have demonstrated their importance in ESM evaluation in the peer-reviewed literature. The Earth System Model Evaluation Tool (ESMValTool) is a community effort open to both users and developers encouraging open exchange of diagnostic source code and evaluation results from the Coupled Model Intercomparison Project (CMIP) ensemble. This will facilitate and improve ESM evaluation beyond the state-of-the-art and aims at supporting such activities within CMIP and at individual modelling centres. Ultimately, we envisage running the ESMValTool alongside the Earth System Grid Federation (ESGF) as part of a more routine evaluation of CMIP model simulations while utilizing observations available in standard formats (obs4MIPs) or provided by the user.

Citation: Eyring, V., Righi, M., Lauer, A., Evaldsson, M., Wenzel, S., Jones, C., Anav, A., Andrews, O., Cionni, I., Davin, E. L., Deser, C., Ehbrecht, C., Friedlingstein, P., Gleckler, P., Gottschaldt, K.-D., Hagemann, S., Juckes, M., Kindermann, S., Krasting, J., Kunert, D., Levine, R., Loew, A., Mäkelä, J., Martin, G., Mason, E., Phillips, A. S., Read, S., Rio, C., Roehrig, R., Senftleben, D., Sterl, A., van Ulft, L. H., Walton, J., Wang, S., and Williams, K. D.: ESMValTool (v1.0) – a community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP, Geosci. Model Dev., 9, 1747-1802, https://doi.org/10.5194/gmd-9-1747-2016, 2016.
Publications Copernicus
Download
Short summary
A community diagnostics and performance metrics tool for the evaluation of Earth system models (ESMs) in CMIP has been developed that allows for routine comparison of single or multiple models, either against predecessor versions or against observations.
A community diagnostics and performance metrics tool for the evaluation of Earth system models...
Share