Incorporating Model Uncertainty into Policy Analysis Frameworks: A Bayesian Averaging Approach Combining Computable General Equilibrium (CGE) Model with Metamodelling Techniques
Future sustainable economic development depends heavily on public policy at regional, national, and global levels. Therefore, it is essential to conduct a thorough policy analysis that ensures consistent and effective policy guidance. However, a major challenge in traditional policy analysis is the uncertainty inherent in the models used. Both policymakers and analysts face fundamental uncertainty regarding which model accurately represents the natural, economic, or social phenomena being analyzed. In this paper, we present a comprehensive framework that explicitly incorporates model uncertainty into the policy decision-making process. Addressing this uncertainty typically requires significant computational resources. We utilize metamodeling techniques to reduce computational demands. We illustrate the impact of various metamodel types by applying a simplified model to the CAADP policy in Nigeria. Our findings highlight that neglecting model uncertainty can lead to inefficient policy decisions and substantial waste of public funds.
Copyright© 2024 The Author(s). This article is distributed under the terms of the license CC-BY 4.0., which permits any further distribution in any medium, provided the original work is properly cited.
Ekpeyong, P. G. (2024). Incorporating Model Uncertainty into Policy Analysis Frameworks: A Bayesian Averaging Approach Combining Computable General Equilibrium (CGE) Model with Metamodelling Techniques. Journal of Applied Economic Sciences, Volume XIX, Winter, 4(86), 387 – 403. https://doi.org/10.57017/jaes.v19.4(86).03
[1] Antunes, F., Amorim, M., Pereira, F., & Ribeiro, B. (2024). Active learning metamodelling for survival rate analysis of simulated emergency medical systems. Transportmetrica A: Transport Science, 20(1), 2046203. https://doi.org/10.1080/23249935.2022.2046203
[2] Benin, S., Thurlow, J., Diao, X., McCool, C., & Simtowe F. (2008). Agricultural growth and investment options for poverty reduction in Malawi. International Food Policy Research Institute (IFPRI), Discussion Paper 00794, 55. https://ebrary.ifpri.org/digital/collection/p15738coll2/id/13440/
[3] Bolarinwa, T. (2024). Computable General Equilibrium (CGE) Models: A comprehensive review and future directions. Management and Economics Review, 9(1), 158-167. https://mer.ase.ro/files/2024-1/9-1-10.pdf
[4] Davis, M. T. (2018). Optimization Techniques in Economic Modeling: A Practical Guide. Oxford University Press.
[5] Dede, G., Kamalakis, T., & Anagnostopoulos, D. (2022). A framework of incorporating confidence levels to deal with uncertainty in pairwise comparisons. Central European Journal of Operations Research, 30(4). https://doi.org/10.1007/s10100-020-00735-0
[6] Dixon, P.B., Koopman, R.B. & Rimmer, M.T. (2013). The MONASH style of computable general equilibrium modeling: A framework for practical policy analysis. In Handbook of computable general equilibrium modeling, Volume 1, 23-103. Elsevier. https://doi.org/10.1016/B978-0-444-59568-3.00002-X
[7] Garcia, L., & Torres, R. (2018). Metamodeling for Environmental Science: Techniques and Applications. Wiley.
[8] Hertel, T.W., Hummels, D., Ivanic, M., & Keeney, R. (2007). How confident can we be in CGE-based assessments of free trade agreements? Economic Modelling, 24(4), 611-635. https://doi.org/10.1016/j.econmod.2006.12.004
[9] Johnson, R.A., Miller, I.S., & Freund, J.E.(2021).Probability and Statistics for Engineers. Pearson. ISBN: 978-1-292-17601-7
[10] Kleijnen, J. P. C. (2018). Design and analysis of simulation experiments. Springer. In book: Statistics and Simulation, pp.3-22. DOI:10.1007/978-3-319-76035-3_1
[11] Lee, S., & Park, J. (2019). Optimization and Metamodeling in Engineering Applications. Cambridge University Press.
[12] Lofgren, H., Cicowiez, M., & Diaz-Bonilla, C. (2013). Maquette for MDG Simulations (MAMS): A computable general equilibrium model for developing country strategy analysis, in: Handbook of Computable General Equilibrium Modeling, Volume 1, 159-276. https://doi.org/10.1016/B978-0-444-59568-3.00004-3
[13] Manski, C.F. (2000). Identification problems and decisions under ambiguity: Empirical analysis of treatment response and policy decisions. Econometrica, 68(2), 267-291. https://doi.org/10.1016/S0304-4076(99)00045-7
[14] Marinacci, M. (2015). Model uncertainty and decisions. Journal of the European Economic Association, 13(6), 1023-1050. https://doi.org/10.1111/jeea.12170
[15] Maskaeva, A., Mmasa, J., Lema, N., & Msafiri, M. (2019). The impact of fiscal policy on income distribution in Tanzania: A computable general equilibrium analysis, Working Papers MPIA 2019-07, PEP-MPIA. http://dx.doi.org/10.2139/ssrn.3405460
[16] Massiani, J. (2018). Assessing the economic impact of mega events using Computable General Equilibrium models: Promises and compromises. Economic Modelling,75, (C), 1-9: https://doi.org/10.1016/j.econmod.2018.05.021
[17] Morris, M. D., & Mitchell, T. J. (1995). Exploring robust designs using computer experiments. Technometrics, 37(1), 60-69. https://doi.org/10.1016/0378-3758(94)00035-T
[18] Olekseyuk, Z., & Schürenberg-Frosch, H. (2019). Computable general equilibrium models for policy analysis in developing countries. Journal of Policy Modeling, 41(4), 731-751. https://doi.org/10.1016/j.jpolmod.2019.02.002
[19] Phimister, E., & Roberts, D. (2017). Modeling the regional economic impacts of wind farms: An application to North East Scotland. Regional Studies, 51(1), 109-122. . https://doi.org/10.1080/00343404.2015.1076075
[20] Ruben, R., & van Ruijven, B. (2021). Metamodeling in agricultural economics: A case study on policy impact analysis. Journal of Agricultural Economics, 72(4), 567-584.
[21] Sacks, J., Welch, W. J., Mitchell, T. J., & Wynn, H. P. (1989). Design and analysis of computer experiments. Statistical Science, 4(4), 409-423. https://doi.org/10.1214/ss/1177012413
[22] Smets, F., & Wouters, R. (2007). Shocks and frictions in US business cycles: A bayesian DSGE Approach. American Economic Review, 97(3), 586-606. https://doi.org/10.1257/aer.97.3.586
[23] Smith, A., & Brown, T. (2017). Applications of Metamodeling in the Natural Sciences. Oxford University Press.
[24] Smith, A., & Jones, B. (2019). Advanced Numerical Methods in Economic Policy Modeling. Cambridge University Press.
[25] Thompson, J., Lee, H., & Park, C. (2018). Advanced Metamodeling Techniques in Engineering Design. Springer.
[26] Villa-Vialaneix, N., Follador, M., Ratto, M., & Leip, A. (2012). Metamodels comparison for the simulation of N2O fluxes and N leaching from corn crops. Environmental Modeling & Software, 34, 51-66. https://www.researchgate.net/publication/ 52009818_Metamodels_comparison_for_the_simulation_of_N2O_fluxes_and_N_leaching_from_corn_crops
[27] Webster, M., Santen, N.R., & Reilly, J.M. (2012). Uncertainty in greenhouse gas emissions and costs of atmospheric stabilization. Climatic Change, 112(3-4), 601-618. https://doi.org/10.1007/s10584-011-0237-9
[28] Wilson, R., & Clark, D. (2019). Metamodels in Ecological Modeling and Analysis. Academic Press.
[29] Yildizoglu, M., Jullien, B., & Perrin, S. (2020). Applying metamodeling to economic models: Sensitivity analysis and optimization. Computational Economics, 56(2), 305-322.
[30] Zhang, L., Wang, H., & Li, X. (2020). Numerical Approximations and Their Applications in Economic Analysis. Springer.