Assessment

Response times (RTs) to ecological momentary assessment (EMA) items often decrease after repeated EMA administration, but whether this is accompanied by lower response quality requires investigation. We examined the relationship between EMA item RTs and EMA response quality. In one data set, declining response quality was operationalized as decreasing correspondence over time between subjective and objective measures of blood glucose taken at the same time. In a second EMA study data set, declining response quality was operationalized as decreasing correspondence between subjective ratings of memory test performance and objective memory test scores...

The ability to quantify within-person changes in mental health is central to the mission of clinical psychology. Typically, this is done using total or mean scores on symptom measures; however, this approach assumes that measures quantify the same construct, the same way, each time the measure is completed. Without this quality, termed longitudinal measurement invariance, an observed difference between timepoints might be partially attributable to changing measurement properties rather than changes in comparable symptom measurements...

The interpersonal problem circumplex is extensively used in the field as an assessment framework for understanding the interpersonal implications of a range of personality and psychopathology constructs. The vast majority of this large literature has been conducted in Western convenience and clinical samples. We computed interpersonal problem structural summary parameters for a range of personality and psychopathology variables in two Chinese offender samples ( N = 424 and N = 555) and one undergraduate sample ( N = 511) to test how well findings from Western samples generalize to Chinese undergraduates and offenders...

Social desirability bias is a methodological challenge with participant self-reports. Social desirability measures are often used to control the potential effects of social desirability bias on participant self-reports, but whether these measures are interpreted similarly across different demographic groups remains unclear. This study examines the factor structure and measurement invariance of the Children's Social Desirability Scale-Short version (CSD-S) across gender, grade level, and race/ethnicity with a large sample of children and adolescents in the United States...

The primary aim of this study was to evaluate the convergent validity of the Motor domain (MOT) of PediaTracTM v3.0, an online developmental tracking instrument based on caregiver reports, with fine and gross motor domains (ASQ-FM and ASQ-GM) of the Ages and Stages Questionnaire (ASQ-3) in infants between 2- and 9 months of age. Participants were caregivers of 571 infants born term or preterm (gestational age <37 weeks) enrolled in a multi-site psychometric study of PediaTracTM . Findings revealed significant correlations between MOT and ASQ-3 scores at 2, 4, 6, and 9 months across time periods, term-preterm status, and biological sex...

This study aimed to evaluate the psychometric characteristics of the Social Phobia Inventory (SPIN) by employing network analysis, confirmatory factor analysis, and the Polytomous Rasch Model. A cross-sectional data set was collected comprising 1,530 participants, with 959 being women and 571 being men. The Bootstrap Exploratory Graph Analysis unveiled the presence of two dimensions, with Items 17, 15, 5, 14, 6, and 9 exhibiting the highest strength centrality index. Notably, the Network Comparison Test indicated no differences in Network Invariance and global strength between the networks of women and men...

As previous studies have shown that personality disorder (PD) assessment in older adults is often hampered because assessment tools are tailored toward younger adults, establishing the age-neutrality of novel tools is crucial. This study primarily aimed to evaluate the age-neutrality of the Level of Personality Functioning Brief Form (LPFS-BF 2.0) and the Personality Inventory for DSM -5 Modified + (PID-5-BF+M), using a sample of 254 community-dwelling adults. The analysis of Differential Item Functioning (DIF) demonstrated the age-neutrality of both instruments, with only 8...

Operant conditioning and social learning theories suggest that positive cannabis use-related outcomes are a primary contributor to maintained use and risk for dependence. However, currently there does not exist a reliable, validated measure of positive cannabis-related outcomes. This study sought to develop and psychometrically evaluate the Positive Outcomes of Cannabis Use Scale (POCUS). We collected three samples, college students ( N = 883), community adults ( N = 214), and college students ( N = 615), of predominantly White adults in the United States who completed an online survey...

Adults with attention-deficit/hyperactivity disorder (ADHD) experience impairing levels of inattention and/or hyperactivity-impulsivity, while individuals without ADHD experience these symptoms to a lesser extent. Yet, ADHD self-report scales so far hardly captured continuous distributions across the general population. In addition, they focused on weaknesses and ignored strengths. To address these shortcomings, we present here the Strengths and Weaknesses of ADHD and Normal-Behavior Scale Self-Report (SWAN-DE-SB) ...

This study evaluated symptoms assessed in common measures of eating disorder pathology and tested overlap to evaluate the extent to which measures may be interchangeable. Six measures were included: Bulimia Test-Revised, Eating Attitudes Test-26, Eating Disorder Diagnostic Scale, Eating Disorder Examination Questionnaire, Eating Pathology Symptoms Inventory, and Questionnaire for Eating Disorder Diagnoses. Content overlap was quantitatively estimated using the Jaccard Index. Mean overlap was low (.195), likely due to the wide range of symptoms (87) assessed...

Given the popularity and ease of single-item craving assessments, we developed a multi-item measure and compared it to common single-item assessments in an ecological momentary assessment (EMA) context. Two weeks of EMA data were collected from 48 emerging adults (56.25% female, 85.42% White) who frequently used cannabis. Eight craving items were administered, and multilevel factor analyses were used to identify the best fitting model. The resulting scale's factors represented purposefulness/general desire and emotionality/negative affect craving...

Graphomotor and time-based variables from the digital Clock Drawing Test (dCDT) characterize cognitive functions. However, no prior publications have quantified the strength of the associations between digital clock variables as they are produced. We hypothesized that analysis of the production of clock features and their interrelationships, as suggested, will differ between the command and copy test conditions. Older adults aged 65+ completed a digital clock drawing to command and copy conditions. Using a Bayesian hill-climbing algorithm and bootstrapping (10,000 samples), we derived directed acyclic graphs (DAGs) to examine network structure for command and copy dCDT variables...

Intensive longitudinal data (ILD) has been collected to capture the dynamic fluctuations of procrastination; however, researchers have typically measured daily procrastination by modifying trait measures (e.g., adding a time reference "today") without adequately testing their reliabilities. The main purpose of this study was to use an advanced approach, dynamic structural equation modeling, to assess the between- and within-person reliabilities of a widely used six-item measure of daily procrastination. A total of 252 participants completed retrospective measures of various types of trait procrastination and daily measures of procrastination over 34 consecutive days...

Although many fluid reasoning (Gf) tests have been developed, there is a lack of figural tests measuring its lower-order process factors simultaneously. The present article introduces the development of the Multidimensional Induction-Deduction Computerized Adaptive Test (MID-CAT) to measure two process factors of Gf. The MID-CAT is designed to provide an instrument that is flexible, efficient, and entirely free for non-commercial use. We created 530 items and administered them to a sample of N = 2,247. Items were fitted and calibrated using the Rasch model...

Replication provides a confrontation of psychological theory, not only in experimental research, but also in model-based research. Goodness of fit (GOF) of the original model to the replication data is routinely provided as meaningful evidence of replication. We demonstrate, however, that GOF obscures important differences between the original and replication studies. As an alternative, we present Bayesian prior predictive similarity checking: a tool for rigorously evaluating the degree to which the data patterns and parameter estimates of a model replication study resemble those of the original study...

This study psychometrically evaluated the Neurobehavioral Symptom Inventory (NSI) among women survivors of intimate partner violence (IPV) and compared symptoms between women with no brain injury history ( n = 93) and women with IPV-related brain injury history ( n = 112). Women completed the NSI and questionnaires on traumatic brain injury (TBI), hypoxic-ischemic brain injury (HI-BI), and lifetime IPV history. A four-factor NSI model, including affective, somatosensory, cognitive, and vestibular factors, had the best fit (comparative fit index = 0...

The adoption of open science practices (OSPs) is crucial for promoting transparency and robustness in research. We conducted a systematic review to assess the frequency and trends of OSPs in psychometric studies focusing on measures of suicidal thoughts and behavior. We analyzed publications from two international databases, examining the use of OSPs such as open access publication, preregistration, provision of open materials, and data sharing. Our findings indicate a lack of adherence to OSPs in psychometric studies of suicide...

Our study compared the impact of administering Symptom Validity Tests (SVTs) and Performance Validity Tests (PVTs) in in-person versus remote formats and assessed different approaches to combining validity test results. Using the MMPI-2-RF, IOP-29, IOP-M, and FIT, we assessed 164 adults, with half instructed to feign mild traumatic brain injury (mTBI) and half to respond honestly. Within each subgroup, half completed the tests in person, and the other half completed them online via videoconferencing. Results from 2 ×2 analyses of variance showed no significant effects of administration format on SVT and PVT scores...

Research on resilience is a growing field, and resilience has been conceptualized and operationalized in multiple ways. The aim of this study was to compare the Brief Resilient Coping Scale (BRCS), a conventional measure of resilience, with within-person process indicators derived from experience sampling method (ESM). A sample of 177 teachers from southern Finland participated in the study, commencing with a startup session followed by an 8-day ESM period. Through twice-daily prompts, participants reported their immediate positive and negative affect as well as recent stressors encountered, such as workload and challenging social interactions...

Executive function influences children's learning abilities and organizes their cognitive processes, behaviors, and emotions. This cross-sectional study examined whether an Indonesian Computer-Based Game (ICbG) prototype could be used as a Computer-Based Game Inventory for Executive Function (CGIEF) in children and adolescents. The study was conducted with 200 children, adolescents, and their parents. The parents completed the Behavior Rating Inventory of Executive Functioning (BRIEF) questionnaire, and the children and adolescents completed the CGIEF...