Effectiveness and limitations of parameter tuning in reducing biases of top-of-atmosphere radiation and clouds in MIROC version 5

This study discusses how much of the biases in top-of-atmosphere (TOA) radiation and clouds can be removed by parameter tuning in the present-day simulation of a climate model in the Coupled Model Inter-comparison Project phase 5 (CMIP5) generation. We used output of a perturbed parameter ensemble (PPE) experiment conducted with an atmosphere–ocean general circulation model (AOGCM) without flux adjustment. The Model for Interdisciplinary Research on Climate version 5 (MIROC5) was used for the PPE experiment. Output of the PPE was compared with satellite observation data to evaluate the model biases and the parametric uncertainty of the biases with respect to TOA radiation and clouds. The results indicate that removing or changing the sign of the biases by parameter tuning alone is difficult. In particular, the cooling bias of the shortwave cloud radiative effect at low latitudes could not be removed, neither in the zonal mean nor at each latitude– longitude grid point. The bias was related to the overestimation of both cloud amount and cloud optical thickness, which could not be removed by the parameter tuning either. However, they could be alleviated by tuning parameters such as the maximum cumulus updraft velocity at the cloud base. On the other hand, the bias of the shortwave cloud radiative effect in the Arctic was sensitive to parameter tuning. It could be removed by tuning such parameters as albedo of ice and snow both in the zonal mean and at each grid point. The obtained results illustrate the benefit of PPE experiments which provide useful information regarding effectiveness and limitations of parameter tuning. Implementing a shallow convection parameterization is suggested as a potential measure to alleviate the biases in radiation and clouds.

Abstract.This study discusses how much of the biases in top-of-atmosphere (TOA) radiation and clouds can be removed by parameter tuning in the present-day simulation of a climate model in the Coupled Model Inter-comparison Project phase 5 (CMIP5) generation.We used output of a perturbed parameter ensemble (PPE) experiment conducted with an atmosphere-ocean general circulation model (AOGCM) without flux adjustment.The Model for Interdisciplinary Research on Climate version 5 (MIROC5) was used for the PPE experiment.Output of the PPE was compared with satellite observation data to evaluate the model biases and the parametric uncertainty of the biases with respect to TOA radiation and clouds.The results indicate that removing or changing the sign of the biases by parameter tuning alone is difficult.In particular, the cooling bias of the shortwave cloud radiative effect at low latitudes could not be removed, neither in the zonal mean nor at each latitudelongitude grid point.The bias was related to the overestimation of both cloud amount and cloud optical thickness, which could not be removed by the parameter tuning either.However, they could be alleviated by tuning parameters such as the maximum cumulus updraft velocity at the cloud base.On the other hand, the bias of the shortwave cloud radiative effect in the Arctic was sensitive to parameter tuning.It could be removed by tuning such parameters as albedo of ice and snow both in the zonal mean and at each grid point.The obtained results illustrate the benefit of PPE experiments which provide useful information regarding effectiveness and limitations of parameter tuning.Implementing a shallow convection parameterization is suggested as a potential measure to alleviate the biases in radiation and clouds.

Introduction
The climate models used in Coupled Model Intercomparison Project phase 5 (CMIP5) still exhibit significant biases in simulating present-day top-of-atmosphere (TOA) radiation, as in CMIP3 (Flato et al., 2013).The biases are especially large in the component of the shortwave cloud radiative effect (SCRE), namely the difference in shortwave radiation between all-sky and clear-sky values.The SCRE represents the radiative effect of clouds, which cool the climate system by reflecting shortwave radiation.Compared with satellite observations, however, the cooling effect of the SCRE tends to be overestimated over low-latitude oceans and underestimated over the Southern Ocean, suggesting that the models still have difficulties in simulating clouds in these re-Published by Copernicus Publications on behalf of the European Geosciences Union.
T. Ogura et al.: Effectiveness and limitations of parameter tuning gions (Nam et al., 2012;Bodas-Salcedo et al., 2014).Previous studies suggest that such biases in radiation and clouds might affect the simulated climate in remote regions or distort the cloud feedback in future projections (Trenberth and Fasullo, 2010;Ceppi et al., 2012).Therefore, alleviating the biases by developing climate models is important.
There are two factors which might contribute to the biases in climate simulated by the models: (a) inappropriate model structures, namely, equations representing the physical processes or spatial resolution of the model; and (b) inappropriate parameter values, which are specified in the equations.We therefore attempt to alleviate the biases by modifying factors (a) and (b) within the plausible range during the model development process.
How much of the existing biases can be explained by the second factor (b)? In other words, how much of the biases can be removed by modifying only specified parameter values (parameter tuning)?This issue is important when discussing the model development strategy because it helps to decide which factor, (a) or (b), should be given a priority to efficiently reduce the biases.If the biases in question can be completely explained by factor (b), the priority for parameter tuning would be high.In this case, removing the biases is relatively simple because parameter tuning is generally much easier than modifying the model structures.By contrast, if most of the biases cannot be explained by factor (b), modifying model structures should be given a high priority.
A perturbed parameter ensemble (PPE) experiment with a climate model is useful when discussing the above issue.In the PPE experiment, we can create different versions of a climate model in a systematic and comprehensive way by modifying the specified parameter values in the model within a plausible range (Murphy et al., 2004).If we evaluate the biases by comparing present-day climate with observation data in each version of the PPE models, we should be able to evaluate parametric uncertainty, namely, the inter-model difference of the biases due to parameter settings.This intermodel difference would also provide a measure regarding how much of the biases can be removed by parameter tuning only.
The benefit of PPE experiments, as discussed above, has been illustrated in previous studies.For example, Zhang et al. (2012) conducted a PPE experiment with an atmosphere general circulation model (AGCM) and evaluated the performance of cloud simulations compared with satellite observations over various tropical regions.The results indicate that the model performance in simulating clouds is sensitive to parameter tuning.Yokohata et al. (2012) focused on different PPE experiments conducted with an atmosphereocean GCM (AOGCM), two atmosphere-slab ocean GCMs (ASGCMs), and an AGCM, and evaluated the model performance in simulating the cloud radiative effect at TOA compared with observations.They found that the sensitivity of the model biases to parameter tuning varies widely among different regions.In the PPEs analyzed in the study, how-ever, the sea surface temperature (SST) bias was suppressed by applying flux adjustment at the sea surface in both the AOGCM and ASGCM.
In the present study, we attempt to better understand the parametric uncertainty of TOA radiation and cloud biases by using the PPE output of an AOGCM without flux adjustment.There is an advantage in using the AOGCM without flux adjustment because climate projections in the CMIP5 Multi-Model Ensemble (MME) are conducted with AOGCMs without flux adjustment and the biases of such AOGCMs are therefore directly relevant for future projections using CMIP5 (Flato et al., 2013).If we suppress the SST biases in the AOGCMs by applying flux adjustment, the TOA radiation and cloud biases in which we are interested might be obscured.In addition, the parametric uncertainty of the biases might be overestimated if we apply flux adjustment because it allows us to include AOGCMs with large radiative imbalance at the TOA as valid samples in the PPE, while such models are not used for future projections in the CMIP5 MME.
When evaluating biases in the simulated clouds, we use output of the Cloud Feedback Model Inter-comparison Project (CFMIP) Observation Simulator Package (COSP), which is incorporated into the AOGCM.The COSP is diagnostic software that processes the GCM outputs, such as the cloud amount, and simulates the signals that would be retrieved by satellites (Bodas-Salcedo et al., 2011).It increases the chances that the difference between the model output and observation reflects real biases in the model simulation rather than observational limitations.Therefore, COSP has been widely used in previous studies, which evaluate clouds simulated by the CMIP5 MME.The studies indicate that the optical thickness of the simulated clouds tends to be overestimated compared with the observation, as in the CMIP3 (Klein et al., 2013;Nam et al., 2012;Zhang et al., 2005).In the present study, we evaluate the parametric uncertainty of this too thick (bright) bias by analyzing the COSP output of the PPE experiment, and discuss how much of the bias can be removed by parameter tuning only.
Section 2 describes the AOGCM, design of the PPE experiment, and observation data used for the evaluation.In Sect.3, we identify the biases in the TOA radiation and discuss the parametric uncertainty of the biases.We then focus on cloud biases in Sect. 4 to examine whether the too thick bias can be controlled by parameter tuning.In addition, Sect. 5 describes which tuning parameters are effective in controlling the TOA cloud radiative effect.In Sect.6, we discuss implications and limitations of the present study, as well as the potential pathway towards model improvement.Finally, we summarize the conclusions in Sect.7.

Design of the perturbed parameter ensemble
We compared the output of the PPE experiment using the AOGCM in the pre-industrial control setting with the observation to evaluate the model biases.We used the Model for Inter-disciplinary Research on Climate version 5 (MIROC5) AOGCM.The atmospheric component has a horizontal resolution of T42 ( ∼ 2.8 • ) with 40 vertical levels.The ocean component is COCO4.5 with a horizontal resolution of ∼ 1 • and 49 vertical levels in addition to a bottom boundary layer.The model is the low-resolution version of the MIROC5 AOGCM, which is used in CMIP5 with a higher resolution of T85 (∼ 1.4 • ) in the atmosphere (Watanabe et al., 2010).We confirmed that the low-resolution version ran stably and did not suffer from significant climate drift in the pre-industrial control experiment without flux adjustment when the standard setting of the tuning parameters was specified.The model could also reproduce the characteristic biases of the TOA radiation and clouds of the T85 version used in CMIP5.
The cloud parameterization of MIROC5 employs a statistical scheme.We assume that there is small-scale fluctuation of total water Q t within the model grid box, which is described by a probability density function (PDF), G(Q t ).We also assume that the Q t exceeding supersaturation with respect to liquid, Q s , takes the form of cloud liquid.Then the cloud cover C and cloud liquid content Q c are diagnosed as the integral over the saturated part of the grid box, as follows: and Overbar denotes average over the grid box.The shape of the PDF is represented by a triangular function.The model predicts variance and skewness of the PDF, which are affected by cumulus convection, cloud microphysics, turbulent mixing, and advection.Details of the cloud parameterization are described by Watanabe et al. (2009).MIROC5 also uses a cloud microphysics parameterization following Wilson and Ballard (1999).The parameterization predicts ice water content using physically based tendency terms which represent nucleation, deposition and sublimation, riming, and ice melting, among others.
We should note that perturbing specified values of tuning parameters might increase the net radiation imbalance at TOA when conducting PPE with an AOGCM in the preindustrial control setting, which leads to a gradual change in climate different from the initial state (climate drift).Such a change would make the definition of the control climate difficult.In addition, the simulated climate might not be a valid example of pre-industrial control simulations.Applying flux adjustment at the sea surface would help to suppress the climate drift by reducing the SST biases.However, it might also cover up the biases in the TOA radiation and clouds, which are sensitive to the SST.What we need here is both stable climate and SST biases, as indicated in the CMIP5 preindustrial control experiments.Therefore, we used the output of the PPE experiment conducted in Shiogama et al. (2012), following the suppressed imbalance sampling (SIS) method, in the present study.The SIS is a method to subsample members of the PPE with a small imbalance in the TOA radiation and thus with small climate drift.This enables us to study stable climates of the PPE without applying flux adjustment.Other methods analogous to the SIS have been discussed in Jackson et al. (2012) and Yamazaki et al. (2013).
The details of the SIS method are described in Shiogama et al. (2012).For reference, we also present the summary in the following.First, we select 10 tuning parameters, which are considered important to the radiative forcing of CO 2 doubling, climate feedback, and climate sensitivity (Table 1).The selection is based on the results of sensitivity experiments using the atmospheric component of MIROC5, which shows that perturbing the 10 parameters has a large impact on the radiative forcing and climate feedback compared to other tuning parameters.The selected 10 parameters are related to cumulus convection, cloud, turbulence, aerosol, and land surface processes.The maximum and minimum values of the parameters are determined by expert judgement so that the parameters are within the plausible range, namely, they are consistent with the observation and current understanding of the climate system.Values of the 10 parameters are then selected from the maximum to minimum ranges and randomly paired to produce 5000 samples of 10-D vectors, following Latin hypercube sampling.Each vector corresponds to a set of input values for the 10 tuning parameters.We further select 56 members from the 5000 samples so that the TOA radiative imbalance of the selected members is close to that of the standard model.The selection of the 56 members is conducted with the following three steps: (1) we conduct a PPE experiment with the MIROC5 AGCM under pre-industrial conditions, in which tuning parameters are changed one at a time to the minimum and maximum values before running the AGCM for 6 years, (2) outputs of the PPE members are linearly interpolated to estimate the TOA radiative imbalance for the 5000 samples of the tuning parameters, and finally, (3) we select 56 members in which the TOA radiative imbalance is close to that of the standard model.The number of subsampled members, namely 56, is determined by the computational resources available.Note that the number increased from 35 in the previous study by Shiogama et al. (2012).Finally, we create 56 members of the MIROC5 AOGCM by specifying different members of the 10-D vectors for the model as input values for the tuning parameters.
We ran the 56 members of the MIROC5 AOGCM for 30 years with the pre-industrial control setting and confirmed www.geosci-model-dev.net/10/4647/2017/Geosci.Model Dev., 10, 4647-4664, 2017  that the changes in the simulated surface air temperature from the initial state (climate drift) were small.This was expected because the TOA radiative imbalance is close to that of the standard model.Years 1-10 of the simulation were considered to be a spin-up period during which the simulated climate adjusted to the modified tuning parameters.The output from years 11 to 30 was averaged to make a climatology.The model biases were defined as the difference of the climatology from observation data.The observation data used for the model evaluation originate in the period of 1983-2017 (Table 2).Therefore, the model output from the historical simulation of the same period is appropriate for comparison with the observation.However, conducting the historical simulation requires an extension for more than 150 years after the pre-industrial control simulation of 30 years.This means a more than 6-fold increase in computational cost, which we are not able to cover.Therefore, we decided to use the pre-industrial control simulation as a surrogate for the historical simulation, assuming that the former reproduces the biases in the latter, regarding TOA radiation and clouds.This assumption is supported by other simulation results.For example, we compared biases in the historical simulation with those in the pre-industrial control simulation using MIROC5 with the horizontal resolution of T85 (∼ 1.4 • ).We confirmed that the TOA radiation and cloud biases in the two simulations were similar to each other (not shown).

Observation data
Table 2 summarizes the observation data which are compared with the model output.They all are monthly mean data.We defined the model biases referring to multiple observations, namely three for TOA radiation and two for the cloud amount; therefore, the observation uncertainty can be taken into account.The biases are considered robust if they are commonly seen with respect to multiple observations.The observation data for TOA radiation are derived from CERES-EBAF (Loeb et al., 2009), ERBE-S9 (Barkstrom, 1984), and ISCCP-FD (Zhang et al., 2004).The data for the cloud amount are from the GCM simulator-oriented ISCCP cloud product (Pincus et al., 2012;Rossow et al., 1996) and CALIPSO-GOCCP (Chepfer et al., 2010).The cloud amount data of the ISCCP are custom-built daytime-only monthly averages, which are available from the CFMIP-OBS website (http://climserv.ipsl.polytechnique.fr/cfmip-obs).We first referred to the observation data to calculate the monthly climatology for the period in Table 2.We then interpolated the data linearly to the horizontal resolution of T42 and used them to calculate the difference from the model output.
When evaluating biases of clouds simulated by the MIROC5 AOGCM, we used the output of the COSP satellite simulation software (version 1.2.2), which was implemented in the model; COSP includes software simulating satellite observations of ISCCP (Klein and Jakob, 1999;Webb et al., 2001) and CALIOP lidar (Chepfer et al., 2008).We com- pared the cloud amount identified by the ISCCP simulator with the GCM simulator-oriented ISCCP cloud product and the one determined with the CALIOP lidar simulator with the CALIPSO-GOCCP data.We confirmed that the ISCCP simulator was implemented properly in the MIROC5 AOGCM following Zelinka et al. (2012), which means we calculated the total sum of the cloud amount from the ISCCP simulator for all cloud top pressure and optical thickness bins and confirmed that the sum is consistent with the "native" cloud amount identified in the MIROC5 AOGCM.Note that optically thin clouds with TAU < 0.3 are not included in this comparison because the available "native" cloud amount does not include such clouds.
3 Parametric uncertainty of the TOA radiation bias First, we present the outline of the TOA radiation bias of the MIROC5 PPE by discussing the global annual mean values in Fig. 1.The biases in the net radiation are small (Fig. 1a), which means that the values of all PPE members are within the range of the three observations and near the zero net radiation with no imbalance, indicated by the dashed line.This was expected because we selected these members when designing the PPE following the SIS method.If we focus on the components of the TOA radiation, however, we notice larger biases compared with the net radiation (Fig. 1b, c).The largest biases appear in the SCRE; the biases range from −11.8 to −5.8 W m −2 .All PPE members are more than 3.0 W m −2 smaller than either one of the three observations.Therefore, parameter tuning enables us to reduce the bias from −11.8 to −5.8 W m −2 by as much as 50 %; however, we cannot totally remove it or change its sign.The shortwave clear-sky component (SWclr) also exhibits large biases in which all PPE members are larger than either one of the three observations.Therefore, we cannot change the sign of the bias by parameter tuning only.
We should note that the SCRE biases are negatively correlated with the LCRE biases with the correlation coefficient of −0.82.Therefore, if we reduce the SCRE bias by making it more positive, the LCRE bias tends to be more negative.Next, we discuss the characteristics of the radiation bias on a smaller spatial scale, as shown by the zonal annual mean in Fig. 2. We especially focus on the cloud radiative effect, which illustrates the biases related to clouds.The negative SCRE biases, as observed in the global mean (Fig. 1c), are mostly attributable to the biases at low latitudes (Fig. 2a).At those latitudes, all PPE members are outside the range of the three observations.Therefore, the bias cannot be eliminated or change sign by parameter tuning, although it can be reduced by ∼ 30 %.In the Arctic, on the other hand, the inter-model difference among the PPE members tends to be larger compared with other latitudes; hence, the observations lie within the PPE spread.Here, the SCRE bias can be eliminated or change sign by parameter tuning.The biases of the longwave cloud radiative effect (LCRE) appear to be small at most latitudes (Fig. 2b).At least one of the PPE members is within the range of the three observations at most latitudes.
The characteristics on an even smaller spatial scale are illustrated by the geographical distribution of the annual mean cloud radiative effect biases in Fig. 3a and b.We used CERES-EBAF as the observation because it measures the radiative fluxes more directly than the ISCCP-FD and it also has various advantages over the ERBE-S9 such as scene identification (Wielicki et al., 1996;Loeb et al., 2009).We confirmed that similar results were obtained when using ISCCP-FD or ERBE-S9 (not shown).
The negative SCRE bias at the low latitudes, as observed in the zonal mean plot (Fig. 2a), appears pronounced over the oceans, exceeding −40 W m −2 in large areas (Fig. 3a).We also notice positive biases at middle to high latitudes over the Southern Ocean, the northwestern part of Eurasia, and the northeastern part of North America.They exceed 5 W m −2 in some places.On the other hand, if we measure the parametric uncertainty of the SCRE bias using the standard deviation among the PPE members, we notice that the uncertainty does not exceed 4 W m −2 in most areas (Fig. 3c).Therefore, removing or changing the sign of the SCRE bias at each grid point by parameter tuning only is difficult.This can be confirmed by the fractions of the PPE members, which have positive biases (Fig. 3e).At each grid point, we count the number of the PPE members which have a positive SCRE bias.Then we divide it by the total number of PPE members, which is 56.The resulting fractions are plotted in Fig. 3e, so that we can see whether the observation data lie within the range of the PPE spread at each grid point.In most areas of the globe, the fraction is 0 (blue) or 1 (orange), which means that observation data are outside the range of the PPE spread, or that all PPE members have the same sign of the SCRE bias.In this case, parameter tuning plays only a limited role in reducing the SCRE bias; in particular, the sign of the bias cannot be changed.An exception is the Arctic.Here, the SCRE bias is about 5 W m −2 and the standard deviation of the bias ranges from 6 to 8 W m −2 (Fig. 3a, c).The observation data are within the range of the PPE spread.Therefore, the biases of the PPE members can be either positive or negative, which is indicated by the green and yellow colours in Fig. 3e.Here, we can change the sign of the SCRE bias by parameter tuning.
The LCRE bias is smaller than the SCRE bias (Fig. 3a, b).It is smaller than 20 W m −2 in most areas.However, the standard deviation of the LCRE bias is even smaller (Fig. 3d), less than 5 W m −2 , except for the limited area in the tropics.Therefore, changing the sign of the LCRE bias is difficult in most regions except for the northern mid-latitudes and the South Pacific.This is illustrated by the fractions of the PPE members, which have positive biases (Fig. 3f).They are 0 (blue) or 1 (orange) in large areas including the Arctic.

Parametric uncertainty of the cloud bias
To better understand the origin of the cloud radiative effect bias, we examine the geographical distribution of the cloud amount bias in Fig. 4. In the following, we present results for the boreal summer season when the cloud amount bias is most pronounced in the Hawaiian Trade Cumulus Region, which we discuss later in this section.The cloud amount is overestimated over the Pacific and Atlantic at low latitudes (Fig. 4a, b), which contributes to the negative SCRE bias, as shown in Fig. 3a.The overestimation is a robust feature; it exists with respect to both ISCCP and CALIPSO observations.In addition, all members of the PPE have positive biases in those regions (Fig. 4c, d).Therefore, the biases cannot be removed by parameter tuning.We should note here that the multi-model mean ISCCP cloud amount (TAU > 1.3) from the CFMIP1 and CFMIP2 ensembles does not show such positive bias at low latitudes (Klein et al., 2013).Therefore, the bias might be a problem specific to the MIROC5 AOGCM.
The cloud amount bias can be decomposed into the contributions from different cloud top pressure and optical thickness bins, as illustrated for the Hawaiian Trade Cumulus Region (15-35 • N, 160 • E-140 • W) in Fig. 5.The region of focus is indicated by the black square in Fig. 4b.The MIROC5 PPE tends to overestimate optically thick clouds (TAU > 3.6) and underestimate optically thin clouds (TAU < 3.6) compared with the ISCCP observation (Fig. 5a, b, c).The contribution of the former outweighs that of the latter, which leads to the overestimation of the cloud amount.The overestimation is especially large in low-top clouds (PC > 680).The clouds of the MIROC5 PPE are biased towards optically thick clouds compared with the observation, which also contributes to the negative SCRE bias.
We further examined the signs of the cloud biases for each bin of the cloud top pressure and optical thickness categories.The fraction of the positive biases within the PPE members is 0 (blue) or 1 (orange) in 36 out of 42 bins (Fig. 5d); all PPE members have the same cloud bias sign in most (85 %) of the cloud top pressure and optical thickness bins.Therefore, removing the too thick bias by parameter tuning only is considered difficult in this model.
The overestimation of both the cloud amount and the optical thickness (too thick bias) contributes to the negative SCRE bias.To illustrate the importance of the too thick bias for the SCRE bias, we plot the relationship between the SCRE and the low-top cloud amount in Fig. 6.Note that we selected data of low-top clouds, which are   It is larger by ∼ 30 W m −2 , even if the models have the same cloud amount as the observation, which indicates that the optical thickness of low-top clouds is overestimated in the MIROC5 PPE.The above-mentioned characteristics are common to all PPE members and the observation is outside the range of the PPE.This again indicates that we cannot remove the too thick bias by parameter tuning only.

Characteristics of different tuning parameters
The results presented so far illustrate the difficulties in removing the TOA radiation and cloud biases by parameter tuning.At the same time, however, we also learned that parameter tuning enables us to control the model biases to some extent, demonstrating its benefit for model development.For example, the global mean SCRE bias can be reduced by as much as 50 % by tuning only (Fig. 1c).To obtain the desired effects by parameter tuning, we need to understand the characteristics of different tuning parameters.Therefore, in the following, we briefly describe the regions in which the tuning parameters in Table 1 control the model biases, focusing on the CRE.
We calculated the regression coefficients of the CRE on different tuning parameters for each latitude-longitude grid point, referring to the 56 members of the PPE, and plotted the geographical distribution of the coefficients in Figs.7 and 8.In addition, we calculated the regression of the ISCCP cloud properties (cloud amount, cloud optical thickness, and cloud top pressure) on the tuning parameters.The results are shown in Appendix Figs.A1, A2, and A3.Note that the tuning parameters were normalized to the range of 0.0 to 1.0; thus, the coefficients indicate the responses of the CRE and clouds to an increase in the tuning parameters from the minimum to the maximum values in Table 1.
The tuning parameters, which are especially effective in controlling the shortwave CRE, are wcbmax and albice; wcbmax and albice can change the SCRE by more than 10 W m −2 over low-latitude oceans and the Arctic, respectively (Fig. 7a, j).
The parameter wcbmax is the maximum cumulus updraft velocity at the cloud base.Increasing the parameter leads to an increase in the cloud amount over low-latitude oceans (Fig. A1a), which would increase the shortwave reflection by clouds and contribute to the negative increase in the SCRE, as indicated by the blue colour in Fig. 7a.Indeed, the geographical distribution of the changes in the cloud amount and SCRE are similar to each other, which is consistent with the above-mentioned argument (Figs.A1a and 7a).
Albice is the albedo of ice and snow.Increasing the parameter leads to an increase in the clear-sky albedo at high latitudes covered with ice and snow, which also decreases the albedo contrast between the clear-and all-sky components.Because the SCRE is proportional to this albedo contrast, it approaches zero by definition.Indeed, the SCRE shows a positive increase at high latitudes, as indicated by the red colour in Fig. 7j, which is consistent with the abovementioned argument.In addition, increasing the albice leads to the decrease in cloud amount and cloud optical thickness in the Arctic (Figs.A1j, A2j), which is also consistent with the change in SCRE (Fig. 7j).
We confirmed in Figs.2a and 3e that the parametric uncertainty of the SCRE bias is exceptionally large in the Arctic compared with other latitudes.In the Arctic, albice is the most effective parameter controlling the SCRE based on Fig. 7.We therefore surmise that the large uncertainty in the SCRE bias is mainly caused by perturbing the albice.
In addition to the wcbmax and albice, other parameters, such as clmd, vicec, b1, alp1, and ucmin, have a considerable impact on the SCRE (Fig. 7c, d, e, g, i).Tuning these parameters leads to changes in the SCRE, which are consistent with the changes in the cloud amount or cloud optical thickness or in both of them (Figs.A1, A2).To reduce the negative SCRE bias in low-latitude oceans, as shown in Fig. 3a, the tuning of wcbmax, clmd, vicec, and b1 would be effective.On the other hand, the impact of tuning precz0, faz1, and tnuw would be relatively small.
Focusing on the longwave CRE, we find that the most effective parameters are wcbmax and vicec; wcbmax and vicec can change the LCRE by more than 10 W m −2 at low latitudes (Fig. 8a, d).
Increasing the wcbmax leads to changes in the cloud top pressure, which decreases in tropical Africa, western tropical Pacific, and the South Pacific Convergence Zone, while it increases in the subtropics, especially around South and Southeast Asia (Fig. A3a).The decrease (increase) in the cloud top pressure would lead to a decrease (increase) in the cloud top temperature and upward longwave radiation, which would contribute to the increase (decrease) in the greenhouse effect of clouds and the LCRE.The geographical distribution of the changes in the cloud top pressure and LCRE are similar to each other, which is consistent with the above-mentioned argument (Figs.A3a, 8a).
The vicec parameter is a factor for the icefall speed.Increasing the parameter causes the increase in the icefall speed, decrease in the cloud amount (Fig. A1d), and increase in the cloud top pressure (Fig. A3d).Such changes in the cloud properties would contribute to the decrease in the greenhouse effect of clouds, which is consistent with the decrease in LCRE, as shown in Fig. 8d.

Discussion
The results of the present study have implications for the future development of MIROC.Parameter tuning has only a limited capability to control the SCRE biases over lowlatitude oceans and the Southern Ocean in MIROC5.Therefore, modifying the model structure should be given a high priority to effectively alleviate the biases.The results underline the importance of improving parameterizations based on cloud process studies.On the other hand, the SCRE bias in the Arctic can be fully controlled by tuning the albedo of snow and ice in the current model structure.However, we expect that the albedo will be predicted or diagnosed with a more physically based parameterization in the future rather than being specified as a tuning parameter, which would make the tuning of the SCRE more difficult.
Which part of the model structure is responsible for the SCRE biases in MIROC5?One possible factor is insufficient vertical mixing in the lower troposphere.In MIROC5, the overestimation of the low-top cloud amount over lowlatitude oceans is accompanied by the dry bias in the free troposphere above the low-top clouds, suggesting that vertical mixing in the lower troposphere, such as that caused by shallow convection, is insufficient.In order to test the idea, we implemented a shallow convection parameterization on the MIROC5 AGCM following Park and Bretherton (2009).We did some parameter tuning after the implementation to ensure that TOA radiation is balanced as before the implementation.The results show that the implementation (and the tuning) makes the SCRE more positive in low-latitude oceans, which alleviates the negative SCRE bias (Figs.3a  and 9).
As an illustration, we focus on a grid point in the eastern tropical Pacific and look at the vertical profile of cloud condensate (liquid plus ice) and its tendency in Fig. 10.We find a large maximum of cloud condensate at 850 hPa before the implementation of the shallow convection scheme (solid line in Fig. 10a).This maximum is maintained by increasing tendencies from condensation, evaporation, turbulent mixing, and convection (black and light blue lines in Fig. 10b), and also by decreasing tendency from precipitation (magenta line in Fig. 10b).After the implementation, those tendencies become smaller than before (Fig. 10c), and the maximum of cloud condensate at 850 hPa disappears (broken line in Fig. 10a).There appears an increasing tendency from shallow convection at upper levels around 600-800 hPa (orange line in Fig. 10c), but this does not lead to large increase in cloud condensate.The obtained results are consistent with the view that vertical mixing induced by shallow convection causes upward transport of total water in the lower troposphere, which dehydrates the low-cloud layer and decreases the low cloud condensate, thereby making the SCRE less negative.
As a next step, research concerning the impact of shallow convection on cloud feedback would also be useful.Previous studies indicate that simulated strength of convective mixing between the lower and middle tropical troposphere is related to cloud feedback and climate sensitivity in multi-model ensembles (Sherwood et al., 2014;Kamae et al., 2016).The results suggest that shallow convective mixing contributes to inter-model spread in climate sensitivity, which causes difficulty in assessing the impact of climate change.In order to test the hypothesis, a multi-model comparison is proposed in which climate feedback is estimated with shallow convection turned on and off in AGCMs.The comparison is called Selected Process On/Off Klima Inter-comparison Experiment (SPOOKIE) phase 2, which is under the framework of Cloud Feedback Model Inter-comparison Project (CFMIP, Webb et al., 2017).We expect that the SPOOKIE phase 2 will facilitate better understanding of the connection between shallow convection and cloud feedback.
The present study also has implications for the inter-model difference in the CRE simulated by the CMIP5 MME.The SCRE and LCRE simulated by the CMIP5 MME show a large inter-model spread.The spread is larger than that in the MIROC5 PPE; therefore, the observation data are within the range of the CMIP5 ensemble members for both the global mean and the zonal mean values (Dolinar et al., 2015;Flato et al., 2013).This large spread in the CMIP5 MME stems from the inter-model difference in both the model structure and specified parameter settings.The results of the present study indicate that specified parameter settings can explain only a small part of the inter-model spread in the CMIP5 MME, suggesting that most of the spread is attributable to the difference in the model structure.This is consistent with the view that modifying the model structure is important for alleviating the biases in SCRE and LCRE.
However, we should note that the results of the model evaluation presented here depend on the design of the PPE experiment.For example, we restricted the number of perturbed parameters to 10 and that of the PPE members to 56 based on the number of available computational resources.If we increased the number of perturbed parameters and PPE members, the inter-model difference of the TOA radiation and cloud biases might be larger than that of the present study.The importance of the PPE design in obtaining large intermodel spread is illustrated by Yamazaki et al. (2013), who conducted a PPE experiment with an AOGCM, HadCM3.They perturbed 33 parameters to create 20 000 members in the PPE experiment.Although they subsampled the PPE members so that the TOA radiation balance is close to the observation, as was done by Shiogama et al. (2012), they showed that the inter-model difference of the climate sensitivity is larger than that of the MIROC5 PPE or the CMIP MME.
The choice of the model used for the PPE experiment is another important factor.If we employed a model other than MIROC5, the biases in the TOA radiation and clouds would be notably different from what we presented.Klein et al. (2013) reported that the bias of having too many optically thick clouds has been reduced from CFMIP1 to CFMIP2 MME, with the best models having eliminated this bias.If we used a model with a very small bias in optically thick clouds, we might be able to change the sign of the bias by parameter tuning only.Therefore, the dominance of structure-oriented bias as illustrated by the MIROC5 PPE does not necessarily indicate unimportance of the parameter-oriented bias in general, as the latter is a function of the former.
Another issue is whether we should include models with a large TOA radiation imbalance in the PPE members.We did not include such models, assuming that TOA radiation must be balanced in the pre-industrial climate simulations.However, such models could also be included in the PPE if we applied flux adjustment at the sea surface to suppress climate drift, which might increase the parametric uncertainty of the biases compared with the present study.For example, Yamazaki et al. (2013) reported that the parametric uncertainty of the climate sensitivity increases by adopting models with a large TOA radiation imbalance in their PPE experiment using the HadCM3 AOGCM.Collins et al. (2006) also conducted a PPE experiment using the HadCM3 AOGCM with flux adjustment.They showed that the parametric uncertainty of the TOA shortwave radiation in the global and annual mean is ∼ 20 W m −2 , which is much larger than the results in the present study.
If we did not adopt the SIS method in the MIROC5 PPE, namely, if we included PPE members with large TOA radiation imbalance by applying flux adjustment, how much larger would the inter-model spread become compared with this study?To address this issue, we estimated inter-model spread of the TOA net radiation in the MIROC5 PPE for two sets of ensemble members: (1) 5000 members created with Latin hypercube sampling, which include members with large TOA radiative imbalance, and (2) 56 members with small TOA radiative imbalance, which are selected with the SIS method from the 5000 members in (1).We estimated the standard deviation for the two sets of ensemble members, and the ratio of (1) to (2) is 6.25 to 1.0.Therefore, inter-model spread of the TOA net radiation would be about 6 times larger if we did not adopt the SIS method.For the sake of argument, we now assume that the 6-fold increase in the inter-model spread occurs not only to the net radiation, but also to the SCRE.In this case, observation data would be within the range of the

Conclusions
To discuss how much of the biases in the TOA radiation and clouds can be removed by parameter tuning in the presentday simulation with a climate model of the CMIP5 generation, we used a low-resolution version of the MIROC5 AOGCM and compared the output of the PPE experiment in the pre-industrial control setting with satellite observation data.We evaluated the biases in the TOA radiation and clouds and quantified the parametric uncertainty of the biases.We used the output of the PPE experiment without flux adjustment, which is consistent with the experimental design of the CMIP5.The results indicate that removing or changing the sign of the biases by parameter tuning only is difficult.In particular, the cooling bias of the SCRE at low latitudes could not be removed, neither in the zonal mean nor at each latitude-longitude grid point.The bias was related to the overestimation of both the cloud amount and cloud optical thickness, which could not be removed by parameter tuning either.However, they could be alleviated by tuning parameters such as the maximum cumulus updraft velocity at the cloud base.On the other hand, the bias of the SCRE in the Arctic was sensitive to parameter tuning.It could be removed by tuning parameters such as the albedo of ice and snow both in the zonal mean and at each grid point.
As discussed in Sect.6, the obtained results of the PPE experiment are dependent on the model and experimental design.In particular, inter-model spread of the PPE is affected by employing the SIS method.Whether the results are applicable to other models or PPE experiments remains to be investigated further.However, the present study illustrates the benefit of PPE experiments, which provide useful information regarding the model development strategy, namely, the effectiveness and limitations of parameter tuning.Based on the results of the present study, a parameterization for shallow convection was implemented in MIROC6 to alleviate the cloud bias over low-latitude oceans.Conducting PPE experiments with the future versions of MIROC is advisable to update our knowledge about the parametric uncertainty, which depends on the model structure; PPE experiments without flux adjustment using AOGCMs other than MIROC5 would also be useful for evaluating the biases in the simulated present climates, which are relevant for future projections in the CMIP5 MME.
Code and data availability.Source code of MIROC5 associated with this study is available to those who conduct collaborative research with the model users under licence from copyright holders.For further information on how to obtain the code, please contact the corresponding author.The data from the model simulations and observations used in the analyses are available from the corresponding author upon request.

Figure 1 .
Figure 1.TOA radiation bias in the global annual mean for (a) net, (b) longwave and shortwave, (c) longwave clear-sky, shortwave clear-sky, longwave CRE, and shortwave CRE components.The biases are with respect to the average of three observational data, namely, ERBE-S9, ISCCP-FD, and CERES-EBAF.The net radiation of zero with no TOA imbalance is indicated by the dashed line in (a).The unit is W m −2 and the signs are positive downward.

Figure 2 .
Figure 2. TOA radiation in the zonal annual mean for the (a) shortwave CRE and (b) longwave CRE components.The unit is W m −2 and the signs are positive downward.

Figure 3 .
Figure 3. TOA radiation bias in the annual mean for the (a) shortwave CRE and (b) longwave CRE components.The biases are for the ensemble mean of the MIROC5 PPE with respect to CERES-EBAF.Standard deviation of the TOA radiation bias among the PPE ensemble members for the (c) shortwave CRE and (d) longwave CRE.Fraction of the PPE ensemble members, which have positive signs of the TOA radiation bias, for the (e) shortwave CRE and (f) longwave CRE.

Figure 4 .
Figure 4. Cloud amount bias in the July mean with respect to the (a) CALIPSO and (b) ISCCP observations.The biases are for the ensemble mean of the MIROC5 PPE.Fraction of the PPE ensemble members, which have positive signs of the cloud amount bias, with respect to (c) CALIPSO and (d) ISCCP observation.
not overlapped by middle-top or high-top clouds in the figure; hence, the SCRE is not affected by clouds other than the low-top clouds, which prevail in the Hawaiian Trade Cumulus Region.The figure shows that SCRE negatively increases as the low-top cloud amount increases in both the observation and the MIROC5 PPE.However, the MIROC5 PPE shows a negatively larger SCRE compared with the observation.

Figure 5 .
Figure 5. ISCCP cloud amount of the July mean for the Hawaiian Trade Cumulus Region (15-35 • N, 160 • E-140 • W), indicated by the black square in Figure 4b, for different categories of the cloud top pressure (PC) and cloud optical thickness (TAU).Each panel is for (a) ISCCP observation, (b) MIROC5 PPE ensemble mean, (c) model bias, namely (b) minus (a), and (d) fraction of the PPE ensemble members with positive bias.

Figure 6 .
Figure 6.Relationship between the non-overlapped low cloud amount and shortwave CRE of the July mean for the Hawaiian Trade Cumulus Region.

Figure 7 .
Figure 7. Regression coefficient of the annual mean TOA shortwave CRE on the tuning parameters calculated with the 56 samples of the MIROC5 PPE.The definition of the tuning parameters is shown in Table 1.The tuning parameters are normalized to the range of [0, 1].The black curves indicate the threshold of the statistical significance with the 5 % level.

Figure 8 .
Figure 8. Regression coefficient of the annual mean TOA longwave CRE on the tuning parameters calculated using the 56 samples of the MIROC5 PPE.The definition of the tuning parameters is shown in Table 1.The tuning parameters are normalized to the range of [0, 1].The black curves indicate the threshold of the statistical significance with the 5 % level.

Figure 9 .
Figure 9. Changes in annual mean TOA shortwave CRE induced by implementing a shallow convection parameterization and parameter tuning in the MIROC5 AGCM.The black square in the eastern tropical Pacific indicates the position of a grid point focused on in Fig. 10.

Figure 10 .
Figure 10.Vertical profile of annual mean (a) cloud condensate and (b, c) cloud condensate tendencies in the eastern tropical Pacific simulated by the MIROC5 AGCM.The data are from the grid point located at (114 • W, 5 • S), indicated by the black square in Fig. 9. (a) Cloud condensate simulated without shallow convection parameterization (solid line) and with the parameterization (broken line), (b) cloud condensate tendencies simulated without shallow convection parameterization, and (c) cloud condensate tendencies simulated with the parameterization.
PPE spread in the global mean SCRE, in contrast to what we have seen in Fig. 1c.However, as for the SCRE over the subtropical oceans as seen in Fig. 3a, the observation data would still be outside the range of the PPE.The above arguments are consistent with Yokohata et al. (2012), who evaluated the SCRE bias of PPE experiments under present climate conditions.They used output of the PPEs conducted with multiple GCMs, some of which employed flux adjustment, and find that the SCRE cooling bias over the subtropical oceans appears in almost all PPE members.

Figure A2 .
Figure A2.Regression coefficient of the annual mean ISCCP cloud optical thickness on the tuning parameters calculated using the 56 samples of the MIROC5 PPE.The definition of the tuning parameters is shown in Table 1.The tuning parameters are normalized to the range of [0, 1].The black curves indicate the threshold of the statistical significance with the 5 % level.

Figure A3 .
Figure A3.Regression coefficient of the annual mean ISCCP cloud top pressure on the tuning parameters calculated using the 56 samples of the MIROC5 PPE.The definition of the tuning parameters is shown in Table 1.The tuning parameters are normalized to the range of [0, 1].The black curves indicate the threshold of the statistical significance with the 5 % level.

Table 2 .
Observation data used for the model evaluation.All data are monthly means.