Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug in TAM::tam.fit outfit t statistics on tam.jml object #25

Open
per-assessments opened this issue Aug 14, 2024 · 0 comments
Open

Bug in TAM::tam.fit outfit t statistics on tam.jml object #25

per-assessments opened this issue Aug 14, 2024 · 0 comments

Comments

@per-assessments
Copy link

per-assessments commented Aug 14, 2024

It appears that the outfit t statistics for tam.fit on a tam.jml object are too small by approximately a factor of 2.

The attached figure shows the TAM computed values of infit/outfit (on the x axis) and their TAM computed t transformations (on the y axis) for MMLE and JMLE models run on the same dataset. Note that the red dots (JMLE outfit) appear to be from a very different distribution than the other colors (MMLE infit/outfit and JMLE infit). Per my understanding, the t transformation should be roughly identical for all of these infit/outfit statistics because they are trained on the same model (same df, similar variance).

All values come from running tam.fit on, respectively, an object of either tam.mml or tam.jml.

I am happy to try to formulate a MWE if that will be helpful. Please feel free to reach out at josephine.meyer@colorado.edu. I am currently running R version 4.2.3 on macOS Catalina, TAM version 4.1-4.

Thanks!
Screen Shot 2024-08-14 at 12 55 09 PM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
1 participant