Research Article | | Peer-Reviewed

Bayesian Latent Class Models for Multiple Imputation of Multivariate Categorical Data Under Ignorable Missingness Mechanism

Received: 10 August 2026     Accepted: 20 August 2026     Published: 20 September 2026
Views:       Downloads:
Abstract

Missing data are a pervasive challenge in the analysis of multivariate categorical data and can lead to biased estimation and reduced statistical efficiency when handled inappropriately. Bayesian latent class multiple imputation provides a flexible framework for addressing this problem by exploiting the underlying latent structure of the data. However, conventional Bayesian latent class imputation models generally assume that latent class membership is independent of observed covariates, potentially limiting estimation accuracy when covariates are informative of the latent class structure. This study proposes a covariate-dependent Bayesian latent class model for multiple imputation under the MAR mechanism. The proposed approach models latent class membership using multinomial logistic regression, allowing observed covariates to influence class allocation while preserving the latent class formulation for the response variables. Bayesian inference is performed using Gibbs sampling, with Pólya--Gamma data augmentation facilitating efficient posterior estimation of the regression coefficients. The performance of the proposed model was evaluated through a comprehensive simulation study under varying strengths of covariate effects and sample sizes, and compared with the conventional Bayesian latent class model. Performance was assessed using multiple imputation inference, latent class proportion recovery, regression coefficient recovery, posterior stability, and empirical coverage probabilities. The proposed model produced unbiased inference and demonstrated improved estimation accuracy when covariates were associated with latent class membership, while maintaining performance comparable to the conventional model when covariate effects were absent. Furthermore, RMSE decreased consistently as the sample size increased, providing empirical evidence of posterior concentration and improved estimation precision. These findings demonstrate that incorporating covariates into Bayesian latent class multiple imputation provides a practical and effective extension of the conventional latent class framework for multivariate categorical data with missing values under the MAR mechanism.

Published in American Journal of Theoretical and Applied Statistics (Volume 15, Issue 5)
DOI 10.11648/j.ajtas.20261505.14
Page(s) 231-242
Creative Commons

This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.

Copyright

Copyright © The Author(s), 2026. Published by Science Publishing Group

Keywords

Multiple Imputation, Latent Class Model, Missing at Random, Multivariate Categorical Data, Multinomial Logistic Regression, Bayesian Latent Class model, Covariate-dependent Latent Class Model

References
[1] O. F. Ayilara, L. Zhang, T. T. Sajobi, R. Sawatzky, E. Bohm, and L. M. Lix, "Impact of missing data on bias and precision when estimating change in patient-reported outcomes from a clinical registry," Health and Quality of Life Outcomes, vol. 17, no. 1, p. 106, 2019,
[2] T. B. Pepinsky, "A note on listwise deletion versus multiple imputation," Political Analysis, vol. 26, no. 4, pp. 480-488, 2018,
[3] D. B. Rubin, Multiple Imputation for Nonresponse in Surveys. New York: John Wiley & Sons, 1987,
[4] S. van Buuren, Flexible Imputation of Missing Data, 2nd ed. Boca Raton, FL: Chapman & Hall/CRC, 2018,
[5] C. K. Enders, Applied Missing Data Analysis. New York, NY: Guilford Publications, 2022.
[6] R. J. A. Little and D. B. Rubin, Statistical Analysis with Missing Data, 3rd ed. John Wiley & Sons, 2019,
[7] J. L. Schafer and R. M. Yucel, "Computational strategies for multivariate linear mixed-effects models with missing values," Journal of Computational and Graphical Statistics, vol. 11, no. 2, pp. 437-457, 2002,
[8] J. L. Schafer, Analysis of Incomplete Multivariate Data. Boca Raton, FL: Chapman & Hall/CRC, 1997,
[9] S. van Buuren and K. Groothuis-Oudshoorn, "mice: Multivariate imputation by chained equations in R," Journal of Statistical Software, vol. 45, no. 3, pp. 1-67, 2011,
[10] J. K. Vermunt, J. R. Van Ginkel, L. A. Van der Ark, and K. Sijtsma, "Multiple imputation of incomplete categorical data using latent class analysis," Sociological Methodology, vol. 38, no. 1, pp. 369-397, 2008,
[11] D. Vidotto, J. K. Vermunt, and K. Van Deun, "Bayesian latent class models for the multiple imputation of categorical data," Methodology, vol. 14, no. 2, pp. 56-68, 2018,
[12] G. J. McLachlan and D. Peel, Finite Mixture Models. John Wiley & Sons, 2000,
[13] D. W. van der Palm, L. A. van der Ark, and J. K. Vermunt, "Divisive latent class modeling as a density estimation method for categorical data," Journal of Classification, vol. 33, no. 1, pp. 52-72, 2016,
[14] R. J. A. Little and D. B. Rubin, Statistical Analysis with Missing Data, 2nd ed. New York: John Wiley & Sons, 2002,
[15] P. D. Allison, "Missing data," in The SAGE Handbook of Quantitative Methods in Psychology, R. E. Millsap and A. Maydeu-Olivares, Eds. Thousand Oaks, CA: SAGE Publications, 2009, pp. 72-89,
[16] M. Gebregziabher and S. M. DeSantis, "Latent class based multiple imputation approach for missing categorical data," Journal of Statistical Planning and Inference, vol. 140, no. 11, pp. 3252-3262, 2010,
[17] P. F. Lazarsfeld and N. W. Henry, Latent Structure Analysis. Boston: Houghton Mifflin, 1968.
[18] L. A. Goodman, "The analysis of systems of qualitative variables when some of the variables are unobservable. Part I: A modified latent structure approach," American Journal of Sociology, vol. 79, no. 5, pp. 1179-1259, 1974,
[19] M. Jankovi'c, E. Masthoff, M. Spreen, P. De Looff, and S. Bogaerts, "A latent class analysis of forensic psychiatric patients in relation to risk and protective factors," Frontiers in Psychology, vol. 12, p. 695354, 2021,
[20] B. Hoogerheide, E. Visser, E. T. Maas, S. H. Booij, and H. Riese, "Latent class analysis in a transdiagnostic psychiatric population to identify classes of psychosocial functioning: Using data from routine clinical practice," Journal of Affective Disorders, vol. 379, pp. 710-720, 2025,
[21] T. H. Bijmolt, L. J. Paas, and J. K. Vermunt, "Country and consumer segmentation: Multi-level latent class analysis of financial product ownership," International Journal of Research in Marketing, vol. 21, no. 4, pp. 323-340, 2004,
[22] C. C. Clogg, "New developments in latent structure analysis," in Factor Analysis and Measurement in Sociological Research, S. Leinhardt, Ed. Beverly Hills, CA: Sage Publications, 1981, pp. 215-246.
[23] K. Bandeen-Roche, D. L. Miglioretti, S. L. Zeger, and P. J. Rathouz, "Latent variable regression for multiple discrete outcomes," Journal of the American Statistical Association, vol. 92, no. 440, pp. 1375-1386, 1997,
[24] C. C. Clogg and L. A. Goodman, "Latent structure analysis of a set of multidimensional contingency tables," Journal of the American Statistical Association, vol. 79, no. 388, pp. 762-771, 1984,
[25] J. K. Vermunt and J. Magidson, "Latent class cluster analysis," in Applied Latent Class Analysis, J. A. Hagenaars and A. L. McCutcheon, Eds. Cambridge: Cambridge University Press, 2002, pp. 89-106,
[26] J. K. Vermunt, "Latent class modeling with covariates: Two improved three-step approaches," Political Analysis, vol. 18, no. 4, pp. 450-469, 2010,
[27] C. M. Dayton and G. B. Macready, "Concomitant-variable latent-class models," Journal of the American Statistical Association, vol. 83, no. 401, pp. 173-178, 1988,
[28] K. Nylund-Gibson and A. Y. Choi, "Ten frequently asked questions about latent class analysis," Translational Issues in Psychological Science, vol. 4, no. 4, pp. 440-461, 2018,
[29] A. Agresti, Categorical Data Analysis, 3rd ed. Hoboken, NJ: John Wiley & Sons, 2013,
[30] A. Gelman, J. B. Carlin, H. S. Stern, D. B. Dunson, A. Vehtari, and D. B. Rubin, Bayesian Data Analysis, 3rd ed. Boca Raton, FL: Chapman & Hall/CRC, 2013,
[31] C. P. Robert, The Bayesian Choice: From Decision-Theoretic Foundations to Computational Implementation, 2nd ed. New York, NY: Springer, 2007,
[32] D. B. Rubin, "Inference and missing data," Biometrika, vol. 63, no. 3, pp. 581-592, 1976,
[33] S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-6, no. 6, pp. 721-741, 1984,
[34] N. G. Polson, J. G. Scott, and J. Windle, "Bayesian inference for logistic models using P'olya-Gamma latent variables," Journal of the American Statistical Association, vol. 108, no. 504, pp. 1339-1349, 2013,
[35] J. L. Schafer, Analysis of Incomplete Multivariate Data. Boca Raton, FL: Chapman & Hall/CRC, 1997,
[36] K. P. Murphy, Probabilistic Machine Learning: An Introduction. Cambridge, MA: MIT Press, 2022.
[37] L. Wasserman, All of Statistics: A Concise Course in Statistical Inference, 1st ed. New York, NY: Springer, 2004,
[38] A. W. van der Vaart, Asymptotic Statistics, ser. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge, UK: Cambridge University Press, 1998,
[39] S. Ghosal and A. W. van der Vaart, Fundamentals of Nonparametric Bayesian Inference. Cambridge, UK: Cambridge University Press, 2017,
[40] L. S. T. Ho, B. T. Nguyen, V. Dinh, and D. Nguyen, "Posterior concentration and fast convergence rates for generalized Bayesian learning," arXiv preprint arXiv:2111.10243, 2021. [Online]. Available:
Cite This Article
  • APA Style

    Murithi, D. F., Ngure, J. N., Musau, V. M. (2026). Bayesian Latent Class Models for Multiple Imputation of Multivariate Categorical Data Under Ignorable Missingness Mechanism. American Journal of Theoretical and Applied Statistics, 15(5), 231-242. https://doi.org/10.11648/j.ajtas.20261505.14

    Copy | Download

    ACS Style

    Murithi, D. F.; Ngure, J. N.; Musau, V. M. Bayesian Latent Class Models for Multiple Imputation of Multivariate Categorical Data Under Ignorable Missingness Mechanism. Am. J. Theor. Appl. Stat. 2026, 15(5), 231-242. doi: 10.11648/j.ajtas.20261505.14

    Copy | Download

    AMA Style

    Murithi DF, Ngure JN, Musau VM. Bayesian Latent Class Models for Multiple Imputation of Multivariate Categorical Data Under Ignorable Missingness Mechanism. Am J Theor Appl Stat. 2026;15(5):231-242. doi: 10.11648/j.ajtas.20261505.14

    Copy | Download

  • @article{10.11648/j.ajtas.20261505.14,
      author = {Daniel Fundi Murithi and Josephine Njeri Ngure and Victor Muthama Musau},
      title = {Bayesian Latent Class  Models for Multiple Imputation of Multivariate Categorical Data Under Ignorable Missingness Mechanism},
      journal = {American Journal of Theoretical and Applied Statistics},
      volume = {15},
      number = {5},
      pages = {231-242},
      doi = {10.11648/j.ajtas.20261505.14},
      url = {https://doi.org/10.11648/j.ajtas.20261505.14},
      eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ajtas.20261505.14},
      abstract = {Missing data are a pervasive challenge in the analysis of multivariate categorical data and can lead to biased estimation and reduced statistical efficiency when handled inappropriately. Bayesian latent class multiple imputation provides a flexible framework for addressing this problem by exploiting the underlying latent structure of the data. However, conventional Bayesian latent class imputation models generally assume that latent class membership is independent of observed covariates, potentially limiting estimation accuracy when covariates are informative of the latent class structure. This study proposes a covariate-dependent Bayesian latent class model for multiple imputation under the MAR mechanism. The proposed approach models latent class membership using multinomial logistic regression, allowing observed covariates to influence class allocation while preserving the latent class formulation for the response variables. Bayesian inference is performed using Gibbs sampling, with Pólya--Gamma data augmentation facilitating efficient posterior estimation of the regression coefficients. The performance of the proposed model was evaluated through a comprehensive simulation study under varying strengths of covariate effects and sample sizes, and compared with the conventional Bayesian latent class model. Performance was assessed using multiple imputation inference, latent class proportion recovery, regression coefficient recovery, posterior stability, and empirical coverage probabilities. The proposed model produced unbiased inference and demonstrated improved estimation accuracy when covariates were associated with latent class membership, while maintaining performance comparable to the conventional model when covariate effects were absent. Furthermore, RMSE decreased consistently as the sample size increased, providing empirical evidence of posterior concentration and improved estimation precision. These findings demonstrate that incorporating covariates into Bayesian latent class multiple imputation provides a practical and effective extension of the conventional latent class framework for multivariate categorical data with missing values under the MAR mechanism.},
     year = {2026}
    }
    

    Copy | Download

  • TY  - JOUR
    T1  - Bayesian Latent Class  Models for Multiple Imputation of Multivariate Categorical Data Under Ignorable Missingness Mechanism
    AU  - Daniel Fundi Murithi
    AU  - Josephine Njeri Ngure
    AU  - Victor Muthama Musau
    Y1  - 2026/09/20
    PY  - 2026
    N1  - https://doi.org/10.11648/j.ajtas.20261505.14
    DO  - 10.11648/j.ajtas.20261505.14
    T2  - American Journal of Theoretical and Applied Statistics
    JF  - American Journal of Theoretical and Applied Statistics
    JO  - American Journal of Theoretical and Applied Statistics
    SP  - 231
    EP  - 242
    PB  - Science Publishing Group
    SN  - 2326-9006
    UR  - https://doi.org/10.11648/j.ajtas.20261505.14
    AB  - Missing data are a pervasive challenge in the analysis of multivariate categorical data and can lead to biased estimation and reduced statistical efficiency when handled inappropriately. Bayesian latent class multiple imputation provides a flexible framework for addressing this problem by exploiting the underlying latent structure of the data. However, conventional Bayesian latent class imputation models generally assume that latent class membership is independent of observed covariates, potentially limiting estimation accuracy when covariates are informative of the latent class structure. This study proposes a covariate-dependent Bayesian latent class model for multiple imputation under the MAR mechanism. The proposed approach models latent class membership using multinomial logistic regression, allowing observed covariates to influence class allocation while preserving the latent class formulation for the response variables. Bayesian inference is performed using Gibbs sampling, with Pólya--Gamma data augmentation facilitating efficient posterior estimation of the regression coefficients. The performance of the proposed model was evaluated through a comprehensive simulation study under varying strengths of covariate effects and sample sizes, and compared with the conventional Bayesian latent class model. Performance was assessed using multiple imputation inference, latent class proportion recovery, regression coefficient recovery, posterior stability, and empirical coverage probabilities. The proposed model produced unbiased inference and demonstrated improved estimation accuracy when covariates were associated with latent class membership, while maintaining performance comparable to the conventional model when covariate effects were absent. Furthermore, RMSE decreased consistently as the sample size increased, providing empirical evidence of posterior concentration and improved estimation precision. These findings demonstrate that incorporating covariates into Bayesian latent class multiple imputation provides a practical and effective extension of the conventional latent class framework for multivariate categorical data with missing values under the MAR mechanism.
    VL  - 15
    IS  - 5
    ER  - 

    Copy | Download

Author Information
  • Sections