Model fit and ppmc() with ordinal data

[ecmerkle]

Model fit and ppmc() with ordinal data

[ecmerkle]

Just some follow-ups, involving commit b0c191e from earlier today:

• I have turned off blavFitIndices() for ordinal models because I think some underlying code is assuming continuous data, and it will take some extra research to ensure this works on the ordinal side (the continuous metrics are based on recent publications, and I don't think the analogous publications exist for ordinal). This was an oversight on my part: in 0.4-1, I was focused on getting the Stan model working and did not test the fit indices as much as I should have.
• ppmc() should now be working better with the ordinal models. But there is still some unresolved ambiguity. For example, the default argument to that is fit.measures = c("srmr", "chisq"). This creates a lavaan object using each posterior sample, then computes the usual frequentist metrics of srmr and chisq. But chisq is ambiguous for ordinal models. Under the default ppmc() arguments, it computes the DWLS chi square statistic using lavaan. If you change the argument to just fit.measures="chisq" (leaving out srmr and any others), then it approximates the multinomial likelihood underlying the Bayesian model and does the usual likelihood ratio statistic. This is clearly not the best situation, and I need to find an intuitive way to distinguish between them.

[ecmerkle]

Hi Zezhen, thanks for the questions. I think that these issues are mostly due to the fact that ordinal models are very new to blavaan. I will have to look at 1 some more... it might well be that these metrics do not work well for ordinal data (they were developed for continuous data), but I cannot rule out a bug right now. I will let you know if I find something.

For 2, this is a bug and should be fixed soon.

For 3, the "MargLogLik" is the likelihood used for Bayes factors (marginal over all parameters, as opposed to marginal over only the latent variables... the llnsamp setting is only used to compute a likelihood that is marginal over latent variables). In the continuous case, blavaan uses a Lagrange approximation here that does not immediately work for ordinal. The ordinal models return NA for now because I have not gotten around to implementing it.

And I would recommend upgrading blavaan to 0.4-1, or to the github version.