Probabilistic measurement of non-physical constructs during early childhood: Epistemological implications for advancing psychosocial science (original) (raw)
Related papers
Frontiers in Public Health, 2021
The last 15 years have seen an explosion of measurement tools for assessing the development of young children in low- and middle- income countries. This paper builds on and contributes to that literature by identifying a core set of caregiver-report items and a core set of direct assessment items that measure key developmental domains for children aged 4–6 (48–83 months) and that demonstrate adequate psychometric properties across diverse contexts, the first in this age group to the authors' knowledge. Data were harmonized from previous early childhood measurement efforts in 12 countries that all used the same base measurement tool. Data analyses yielded 20 caregiver report items and 84 child direct assessment items (grouped into 16 tasks) that show strong item-level statistics across countries and that cover the domains of early literacy, early numeracy, executive functioning, and social-emotional competencies. Next steps include adding data and items from other measurement too...
Canadian Journal of Education, 2016
This research investigates key psychometric properties of the French Early Years Evaluation-Teacher Assessment measure designed to systematically assess kindergarten children across five social and academic developmental domains: awareness of self and environment, social skills and behaviour, cognitive abilities, language and communication, and physical development. New Brunswick francophone kindergarten children were recruited to assess the instrument’s internal consistency; content, construct, concurrent and discriminant validity; and linguistic bias relative to the English version. Results indicate that the French measure has strong psychometric properties, and that it can therefore be used with confidence to screen for at-risk children in francophone kindergartens.
Behavior Research Methods
Some of the ‘best practice’ approaches to ensuring reproducibility of research can be difficult to implement in the developmental and clinical domains, where sample sizes and session lengths are constrained by the practicalities of recruitment and testing. For this reason, an important area of improvement to target is the reliability of measurement. Here we demonstrate that best–worst scaling (BWS) provides a superior alternative to Likert ratings for measuring children’s subjective impressions. Seventy-three children aged 5–6 years rated the trustworthiness of faces using either Likert ratings or BWS over two sessions. Individual children’s ratings in the BWS condition were significantly more consistent from session 1 to session 2 than those in the Likert condition, a finding we also replicate with a large adult sample (N = 72). BWS also produced more reliable ratings at the group level than Likert ratings in the child sample. These findings indicate that BWS is a developmentally a...
2014
The current article presents a critical review of empirical evidence for six observation scales commonly used in practice to evaluate the quality of the early childhood classroom environment. Specifically, the theoretical foundation, content, and psychometric properties are reviewed for each scale. Based on the strengths and limitations of the evidence for each measure, recommendations are made regarding use of these specific systems in early education settings.
Applied Health Economics and Health Policy
Background Childhood multi-attribute utility instruments (MAUIs) can be used to measure health utilities in children (aged ≤ 18 years) for economic evaluation. Systematic review methods can generate a psychometric evidence base that informs their selection for application. Previous reviews focused on limited sets of MAUIs and psychometric properties, and only on evidence from studies that directly aimed to conduct psychometric assessments. Objective This study aimed to conduct a systematic review of psychometric evidence for generic childhood MAUIs and to meet three objectives: (1) create a comprehensive catalogue of evaluated psychometric evidence; (2) identify psychometric evidence gaps; and (3) summarise the psychometric assessment methods and performance by property. Methods A review protocol was registered with the Prospective Register of Systematic Reviews (PROSPERO; CRD42021295959); reporting followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline. The searches covered seven academic databases, and included studies that provided psychometric evidence for one or more of the following generic childhood MAUIs designed to be accompanied by a preference-based value set (any language version): 16D, 17D, AHUM, AQoL-6D, CH-6D, CHSCS-PS, CHU9D, EQ-5D-Y-3L, EQ-5D-Y-5L, HUI2, HUI3, IQI, QWB, and TANDI; used data derived from general and/or clinical childhood populations and from children and/ or proxy respondents; and were published in English. The review included 'direct studies' that aimed to assess psychometric properties and 'indirect studies' that generated psychometric evidence without this explicit aim. Eighteen properties were evaluated using a four-part criteria rating developed from established standards in the literature. Data syntheses identified psychometric evidence gaps and summarised the psychometric assessment methods/results by property. Results Overall, 372 studies were included, generating a catalogue of 2153 criteria rating outputs across 14 instruments covering all properties except predictive validity. The number of outputs varied markedly by instrument and property, ranging from 1 for IQI to 623 for HUI3, and from zero for predictive validity to 500 for known-group validity. The more recently developed instruments targeting preschool children (CHSCS-PS, IQI, TANDI) have greater evidence gaps (lack of any evidence) than longer established instruments such as EQ-5D-Y, HUI2/3, and CHU9D. The gaps were prominent for reliability (test-retest, inter-proxy-rater, intermodal , internal consistency) and proxy-child agreement. The inclusion of indirect studies (n = 209 studies; n = 900 outputs) increased the number of properties with at least one output of acceptable performance. Common methodological issues in psychometric assessment were identified, e.g., lack of reference measures to help interpret associations and changes. No instrument consistently outperformed others across all properties. Conclusion This review provides comprehensive evidence on the psychometric performance of generic childhood MAUIs. It assists analysts involved in cost-effectiveness-based evaluation to select instruments based on the application-specific minimum standards of scientific rigour. The identified evidence gaps and methodological issues also motivate and inform future psychometric studies and their methods, particularly those assessing reliability, proxy-child agreement, and MAUIs targeting preschool children.
Capturing quality in early childhood through environmental rating scales
Early Childhood Research Quarterly, 2006
This paper explores the relationship between ‘process’ quality characteristics in English pre-school centres and the developmental progress made by children between the ages of 3–5 years. A nationally representative sample of 141 English pre-schools participated in this study with longitudinal pre- and post-test measures taken from 2857 children at ages 3 and 5. Centre quality was assessed using two observational instruments, the revised version of the Early Childhood Environment Rating Scale [Harms, T., Clifford, M., & Cryer, D. (1998). Early Childhood Environment Rating Scale, Revised Edition (ECERS-R). Vermont: Teachers College Press] and a new English curriculum extension to it [Sylva, K., Siraj-Blatchford, I., & Taggart, B. (2003). Assessing quality in the early years: Early Childhood Environment Rating Scale-Extension (ECERS-E): Four curricular subscales. Stoke-on Trent: Trentham Books]. This new instrument was developed specifically for assessing the curricular aspects of quality, including pedagogy, in pre-school centres subject to the English national Early Childhood Curriculum. Multi-level statistical analyses revealed that quality of centre-based provision as measured by the ECERS-E was a significant predictor of children's development at entry to school after controlling for pre-test, child characteristics and family background. This study demonstrated that the ECERS-E is a reliable instrument for assessing the educational aspects of process quality and is a significant predictor of children's cognitive/linguistic progress. In contrast, the ECERS-R had a stronger relationship with children's socio-behavioural progress in the pre-school period.
Using Scientific Knowledge to Inform Preschool Assessment: Making the Case for "Empirical Validity
PsycEXTRA Dataset, 2005
The No Child Left Behind Act of 2001 crystallized the concern for accountability in education. National testing was mandated as a way to improve the "broken" educational system. Publicly funded early education programs were not spared from such testing. While the positive effects of high-quality early education on children's later school achievement is well demonstrated, too many early care and educational settings in the United States are of minimal or poor quality. Accountability is clearly important for increasing the quality of our early childhood programs, however, it is not yet evident how best to formulate a standard of accountability that reflects the body of knowledge we have gained concerning how young children learn.