15. Fachgruppentagung Methoden & Evaluation
Digitale Tagung, 15.-17. September 2021 mit Postkonferenz-Workshops am 18. September
https://www.uni-mannheim.de/fgme2021/
15
thConference of the Section Methods & Evaluation
Digital conference, September 15
thto 17
th, 2021 with post-conference workshops on September 18
thhttps://www.uni-mannheim.de/en/fgme2021/
Wednesday, 15th September, 2021
Stage 1 Stage 2 Stage 3
8:45 ̶ 9:00 Login at the Digital Conference Platform
9:00 ̶ 9:30 Welcome and Introduction (Stage 1)
9:30 ̶ 11:00 Item Response Theory (Part I) Chair: Steffi Pohl
You are anchoring - Whether you know it or not
C. Strobl
Variations of score-based measurement invariance tests for multiple group Item Response Theory models
R. G. Debelak, S. Pawel, C. Strobl & E. C.
Merkle
Power analysis for the Wald, LR, score and gradient test in a marginal maximum likelihood framework: Applications in IRT F. Zimmer, C. Draxler & R. Debelak
A multidimensional IRTree model for dynamic extreme response style effects V. Merhof & T. Meiser
Extended competence modelling with process and product data: Analysis of log data from a computer-based simulated supermarket using the Finite State Machine P. L. Drake, M. Froitzheim, J. Hartig, G.
Mau, H. Schramm-Klein & M. Schuhen
Mathematical Psychology Chair: Philipp Doebler
Some considerations on the factorization of state probabilities in knowledge structures S. Noventa, J. Heller & L. Stefanutti
Can a diffusion model analysis reliably disentangle prior and dynamic biases?
Parameter recovery studies V. Lerche & M. Germar
Cognitive control, how do I measure thee? A comparison of latent joint models for
mathematical model parameters and electrophysiological correlates of selective attention
A.-L. Schubert, C. Löffler & D. Hagemann
Analyseansätze für Ereignis-korrelierte Potenziale als Spezialfälle von
Strukturgleichungsmodellen F. Scharf & S. Nestler
Ein Vergleich maschineller Lernverfahren zur automatisierten Bewertung von Divergent-Thinking-Tasks
P. Buczak, H. Huang, B. Forthmann & P.
Doebler
Symposium 1: Sequential Hypothesis Testing ̶ Improving Efficiency in Psychological Research
Chair: Martin Schnuerch
Curtailed sampling: A simple and efficient sampling plan for binomial tests
F. Reiber, M. Schnuerch & R. Ulrich
Where Wald and Jeffreys meet: A unified framework for sequential testing
A. Stefan, F. Schönbrodt, N. Evans & E.-J.
Wagenmakers
Waldian t tests: Controlling error
probabilities in sequential Bayesian t tests M. Schnuerch, D. W. Heck & E. Erdfelder
More than the math: Considering
psychological factors in sequential analyses J. W. B. Elsey
Summary and Discussion E. Erdfelder (Discussant)
11:00 ̶ 11:30 Coffee Break
11:30 ̶ 13:00 Item Response Theory (Part II) Chair: Eunike Wetzel
A flexible approach to modelling over-, under- and equidispersed count data in IRT:
The Two-Parameter Conway-Maxwell- Poisson Model
M. Beisemann
Estimating the fakability of multidimensional forced-choice blocks - The Faking Mixture Model
S. Frick
Verzerrt schnelles Raten den identifizierten Zusammenhang zwischen Fähigkeit und Geschwindigkeit?
T. Deribo, U. Kroehne & F. Goldhammer
Berücksichtigung der Messfehler in den Itemparametern beim computerisierten adaptiven Testen
A. Fink, A. Frey & C. König
Fest verankert: Eine Simulationsstudie zu den Voraussetzungen für robustes Test- Equating
D. Weber, M. Koch & N. Becker
Statistical Decision and Replicability Chair: Marie-Ann Sengewald
Misinterpretations of psychological methods - is frequentism still state of the art?
T. von Oertzen
Preregistration as code
A. Peikert, C. J. Van Lissa & A. M.
Brandmaier
Synthetic data as a tool to promote data sharing and improve the reproducibility of psychological research
S. Grund, O. Lüdtke & A. Robitzsch
The autonomy-validity dilemma in
mechanical judgment procedures: The quest for a compromise
M. Neumann, A. S. M. Niessen, J. N.
Tendeiro & R. R. Meijer
How to aggregate subjective location judgments? Extending Cultural Consensus Theory to two-dimensional continuous data M. Mayer & D. W. Heck
Symposium 2: Networks and Psychology Chair: Robert W. Krause
Psychological networks L. Bringmann
Multilevel network modelling of the academic self
C. Steglich & L. Zander
Modeling categorical time series data: The example case of egocentric social-
interaction networks
T. Elmer, M. van Duijn, T. Snijders, N. Ram
& L. Bringmann
Missing networked data – Multiple
imputation for missing links and attributes of nodes
R. W. Krause & M. Huisman
Combining Bayesian multilevel modelling with network analysis to assess physicians’
competence in shared decision making L. Schumacher, I. Scholl, P. Hahlweg, M.
Härter & L. Kriston
13:00 ̶ 14:00 Lunch Break
14:00 ̶ 15:30 Poster Session
Applications
Richtig einsteigen ins Psychologiestudium:
Evaluation mathematischer Unterstützungs- maßnahmen in der Studieneingangsphase K. L. Austerschmidt
Item Response Theory and Measurement
Relative Gewichtung von Trait und
Antwortstilen als Funktion von Itemposition und Itemkomplexität in IRTree-Modellen A. Gernand & T. Meiser
Statistical Analysis
Making sense of measurement non- invariance via Mixture Multigroup Factor Analysis (MMG-FA)
Ö. E. C. Alagöz, K. De Roover & L.
Vogelsmeier
Mixed Methods Analyse einer App zur Unterstützung traumatisierter minderjähriger Geflüchteter
A. Böhm-Fischer & L. Beyer
Emotionale Effekte von computerisierten adaptiven Hochschulklausuren
P. Naumann & A. Frey
Nutzung und Interpretation von Effekten und Effektgrößen in der psychologischen
Forschung und Lehre – Status quo und Zukunftsvisionen
T. Schäfer
Vergleich der Validität verschiedener Antwortformate zur Erfassung von Lernstrategien
A. Tupac-Yupanqui, J.-H. Heine, A.
Schiepe-Tiska & K. Reiss
The relation between insufficient effort responding and response styles: A simulation study
J. Killisch, S. Frick & T. Meiser
Entwicklung von Indizes zur Identifizierung von Careless Responding in mehrdimen- sionalen Forced-Choice Fragebögen R. Kupffer, S. Frick & E. Wetzel
Assessing cognitive processes underlying stereotype effects in a first-person shooter task and a weapon identification task with diffusion model analyses
J. Liss & V. Lerche
Effects of missing data and multivariate non- normal distributions on the Root Mean Square Error of Approximation
L. J. Jobst, C. Heine, M. Auerswald & M.
Moshagen
Time limits as potential source of gender bias in experimental settings: The case of stereotype threat
A. Stoevenbelt, I. Schwabe & J. Wicherts
Meta-Analysis 2.0: Parameter estimation by means of selective aggregation
E. H. Witte, A. Stanciu & F. Zenker
15:30 ̶ 16:00 Coffee Break
16:00 ̶ 17:45 Members Meeting (Stage 1)
18:00 ̶ 19:00 Keynote Talk (Stage 1)
Mapping item-response interactions: A latent space approach to item response data with interaction maps
Minjeong Jeon
Thursday, 16th September, 2021
Stage 1 Stage 2 Stage 3
8:45 ̶ 9:00 Login at the Digital Conference Platform
9:00 ̶ 10:30 Symposium 3 zu Ehren von Gustav A.
Lienert’s 100. Geburtstag:
Verteilungsfreie Verfahren, Testaufbau und Testanalyse: Anwendungen und neue Entwicklungen
Chair: Mark Stemmler
Zur Nachhaltigkeit des Wirkens von G. A.
Lienert am Beispiel der Testtheorie H. Moosbrugger & A. Kelava
Konfigurationsverlaufsanalyse als Spezialfall der KFA am Beispiel der Entwicklung der Depressionshäufigkeit in Bayern zwischen 2007 und 2013
M. Ising & T. Lang
Konfigurationen aus Migration und PISA- Kompetenzen mit Kovariaten
J.-H. Heine & M. Stemmler
Recurrence Quantification Analysis: A model-free analysis technique for time series data
S. Wallot
Zusammenfassung und Diskussion K. Boehnke (Diskutant)
Bayesian Modeling and Estimation Chair: Veronika Lerche
Introducing Bayesian mixture cross- classified IRT models
M. Bee & T. Koch
Accounting for heterogeneity when
specifying informative prior distributions for Bayesian multiple regression models – A novel similarity measure
C. König
Bayesian moderated nonlinear Latent State- Trait Models – A simulation study
L. Oeltjen, T. Koch, J. Holtmann, F. F.
Münch, M. Eid & F. W. Nussbeck
Proposition of an evaluation method for statistical analyses with distributions as outcomes
T. Braun, A. Omar & T. von Oertzen
Symposium 4: Intensive Longitudinal Data/Complex Data
Chairs: Holger Brandt & Augustin Kelava
Spatial and social network auto-regressive structural equation modeling
Z. Roman & H. Brandt
Bayesian modelling of inattention in intensive longitudinal data
P. Schmidt & H. Brandt
Forecasting intra-individual changes of affective states taking into account inter- individual differences using intensive longitudinal data from a university student drop out study in math
A. Kelava, P. Kilian, J. Glaesser, S. Merk &
H. Brandt
Modeling dimensional shifts in intensive longitudinal data
H. Brandt & C. Flückiger
Machine learning methods for multi-level modeling with sequential data
P. Kilian & A. Kelava
10:30 ̶ 11:00 Coffee Break
11:00 ̶ 12:00 Keynote Talk (Stage 1)
Rethinking the causes of low replication rates Rolf Ulrich
12:00 ̶ 13:00 Lunch Break 13:00 ̶ 14:30 Machine Learning/Statistical Learning
Chair: Timo von Oertzen
Identifying informative predictor variables with random forests
Y. Rothacher & C. Strobl
The impact of correlated predictor variables on interpretation tools for machine learning methods
M. Henninger, Y. Rothacher, R. Debelak &
C. Strobl
Using Rasch trees to identify and investigate rapid responding in questionnaires
U. Kröhne, J. Buchholz & F. Goldhammer
Evaluation of a genetic algorithm for scale shortening
J. Schüller & M. Schultze
Interaktionen von Scores: Ein statistisches Lernverfahren für Moderation mit zwei Gruppen von Variablen
P. Doebler, A. Doebler, P. Buczak & A. Groll
(Intensive) Longitudinal Data Analysis Chair: Jana Holtmann
Modeling emotion regulation flexibility using dual-process Mixture Latent Markov Models G. Grommisch, E. Prestele, C. Altstötter- Gleich & T. Lischetzke
Latent Markov Factor Analysis: A mixture modeling approach for evaluating within- and between-person measurement model differences in intensive longitudinal data L. V. D. E. Vogelsmeier, J. K. Vermunt, & K.
De Roover
Modeling within-person variability of emotion differentiation by means of Latent Markov Factor Analysis
M. C. Schmitt, S. Stuber & T. Lischetzke
Modelling emotional instability with the Multilevel Hidden Markov Model S. Stuber & T. Lischetzke
Examining the performance of the Multimethod Latent State-Trait Model for random and fixed situations in personality research using Monte Carlo simulations D. L. Tinhof, J. Rauthmann & A. Mayer
Symposium 5: Mixed-Effects Modeling ̶ Linking Experimental Psychology and Individual Differences (Part I)
Chairs: Daniel W. Heck & Florence Bockting
Bayes factors for repeated-measures designs: Benefits of model selection and model averaging
D. W. Heck & F. Bockting
Default Bayes factors for mixed models:
Tacit assumptions about standardized effect sizes lead to so-called puzzling results H. Singmann & D. Kellen
On how to compare non-nested mixed- effects models: The test-case of different definitions of culture
V. Vogel, J. Gebauer & O. Lüdtke
Evaluating an MPT model for paired-word recognition
A. Voormann, M. S. Spektor & K. C. Klauer
About the diagnosticity of experimental designs for measuring individual differences in the truth effect
F. Bockting & D. W. Heck
14:30 ̶ 15:00 Coffee Break
15:00 ̶ 15:54 Causal Effects Chair: Axel Mayer
On the relationship between ANOVA main effects and average treatment effects L. Graefe, S. Hahn & A. Mayer
Missing Data
Chair: Martin Schultze
Multiple imputation of zero-inflated longitudinal count data based on a piecewise growth curve model
Symposium 5: Mixed-Effects Modeling ̶ Linking Experimental Psychology and Individual Differences (Part II)
Chairs: Daniel W. Heck & Florence Bockting
Beyond the mean: A flexible framework for studying causal effects using linear models C. Gische & M. Voelkle
Benefits of latent variable models for causal effect analysis in large scale assessments M.-A. Sengewald & A. Mayer
K. Kleinke & J. Reinecke
Simulation-based performance evaluation of missing data handling in network analysis K. J. Nehler & M. Schultze
Planned Missing Data Designs für Multi- Trait-Multi-Method Studien
M. Lawes, M. Schultze & M. Eid
Stability and change in diffusion model parameters over two years
M. von Krause, S. Radev, A. Voss, M.
Quintus, B. Egloff & C. Wrzus
Modeling individual differences in working memory: Evaluating the estimation precision of subject-level parameters of the Memory Measurement Model
J. Göttmann, A.-L. Schubert, K. Oberauer &
G. Frischkorn
Predicting parameter heterogeneity with the R package ipcr
M. Arnold, M. C. Voelkle, A. M. Brandmaier
15:54 ̶ 16:10 Short Break
16:10 ̶ 17:30 Discussion Forum (Stage 1)
Planning (or already juggling?) a family and a scientific career ̶ Podium discussion for researchers of all genders and career stages Young Members and Task Force for Promoting Female Researchers
From 17:30 Meeting of the Young Members (Stage 1)
Friday, 17th September, 2021
Stage 1 Stage 2 Stage 3
8:45 ̶ 9:00 Login at the Digital Conference Platform
9:00 ̶ 10:30 Structural Equation Models (Part I) Chair: Fridtjof Nussbeck
Awareness is bliss: How acquiescence affects exploratory factor analysis
E. D. D'Urso, J. Tijmstra, J. K. Vermunt & K.
De Roover
Specifying Bi-Factor measurement models:
Challenges and recommendations N. Petras
On the purported “Probifactor Model Fit Index Bias”
M. Bader & M. Moshagen
A comparison of different regularization approaches in Bifactor-(S-1) Models with explanatory variables
B. Friemelt, C. Bloszies, A. M. Brandmaier &
T. Koch
Wie nützlich ist Regularisierung bei hoher Multikollinearität in Strukturgleichungs- modellen?
J. Pförtner, F. Scharf & S. Nestler
Multilevel Models Chair: Mirka Henninger
Estimation of a multilevel Item Response Theory model with a latent interaction effect using a new EM algorithm
T. F. Schaffland, S. Noventa & A. Kelava
Modeling careless responding in an
experimental ambulatory assessment study using multigroup multilevel latent class analyses
K. Hasselhorn, C. Ottenstein & T.
Lischetzke
When the night has come – Implications of overnight intervals for autoregressive effects in three-level experience sampling data A. B. Neubauer, S. B. Scott, M. J. Sliwinski
& J. M. Smyth
Comparison of random-effects meta- analysis models for the odds ratio in the case of rare events: A simulation study K. Jansen & Heinz Holling
Gradient Boosting für hierarchische Daten M. Salditt, S. Humberg & S. Nestler
Symposium 6: Mathematical Modeling of Cognitive Processes I ̶ Foundational Methods and Judgment
Chairs: Sophie E. Scharf & Arndt Bröder
Parameter agreement and sources of disagreement across the Bayesian and frequentist MPT multiverse
J. Groß, B. G. Kuhlmann & H. Singmann
Partial derivatives for the first-passage time distribution in diffusion models
R. Hartmann & K. C. Klauer
Normative accounts of the pseudo- contingency heuristic – Mathematical modeling of a mathematically inappropriate inference
F. M. Bott, D. Kellen & K. C. Klauer
Towards understanding the within-trial dynamics of exemplar retrieval in judgments from multiple cues
R. Albrecht, A. Rosner, J. Rieskamp & B.
von Helversen
Measuring rule- and exemplar-based processes of judgment in a hierarchical Bayesian framework
D. Izydorczyk & A. Bröder
10:30 ̶ 11:00 Coffee Break
11:00 ̶ 12:00 Award Ceremony and Presentations of Award Winners (Jürgen Rost Award and Gustav A. Lienert Award)
12:00 ̶ 13:00 Lunch Break
13:00 ̶ 14:00 Keynote Talk (Stage 1)
Race models of stopping: From simple descriptive to complex cognitive process models
Dora Matzke
14:00 ̶ 14:15 Short Break
14:15 ̶ 15:45 Structural Equation Models (Part II) Chair: Karin Schermelleh-Engel
Using Bayesian model averaging for conditions of measurement noninvariance D. Schulze & S. Pohl
Alleviating estimation problems in small sample structural equation modeling - A comparison of constrained maximum likelihood, Bayesian estimation, and fixed reliability approaches
E. Ulitzsch, O. Lüdtke & A. Robitzsch Moving away from traditional cutoffs: ROC analysis as a tool for judging model fit K. Groskurth, N. Bhaktha, M. Bluemke, T.
Meiser & C. M. Lechner
The performance of LMS compared to other methods under distributional
misspecification: The consequences of categorical data treated as continuous J. P. Irmer, A. G. Klein, J. C. Gäde & K.
Schermelleh-Engel
Symposium 7: Mathematical Modeling of Cognitive Processes II ̶ Memory and Decision Making
Chairs: Arndt Bröder & Sophie E. Scharf
Multinomial processing tree modeling of interference processes in episodic memory J. Quevedo Pütter & E. Erdfelder
Measuring binding processes in episodic memory with IRT models
M. R. Schreiner
Reinforcement learning evidence
accumulation models for multi-alternative decision-making
L. Schumacher, S. T. Radev & A. Voss
New models offer new insights: Predicting information-search times with iCodes S. E. Scharf & M. Jekel
Between- and within-subject covariance perspectives matter for investigations into the relationship between single- and multi- tasking performance
C. Naefgen, C. Blech, M. Kriechbaumer, H.
Haider, N. Ram & R. Gaschler
Moving the goal posts: Static and self- adaptive objective functions in meta- heuristic item-selection procedures M. Schultze, L. Binder & S. Windmann
15:45 ̶ 16:00 Short Break
16:00 ̶ 17:30 Discussion Forum (Stage 1)
Different Career Paths
Young Members and Task Force for Promoting Female Researchers
Post-Conference Workshops
Analysis of item response data with a latent space modeling approach in R Minjeong Jeon
Friday, 17th September: 18:00-22:00 (Stage 2) Saturday, 18th September: 18:00-22:00 (Stage 2)
Dynamic models of choice: Bayesian estimation and model comparison for evidence-accumulation architectures Dora Matzke
Saturday, 18th September: 9:00-17:00 (Stage 1)
Person-centered methods using R: Log-linear models and Configural Frequency Analysis Mark Stemmler
Saturday, 18th September: 9:00-17:00 (Stage 2)
A tutorial on p-curves, publication bias, and replication rates Rolf Ulrich
Saturday, 18th September: 9:00-17:00 (Stage 3)
