Highly recommended AI paper regarding human & AI capabilities. HCQM: A dual-use human capability assessment and prescriptive target for engineering synthetic cognitive architectures (AI)

I recently exchanged emails and zoomed with Kameron Green who works in the AI space regarding his proposed Human Capability Quotient Map (HCQM).  I was thoroughly impressed with his proposed dual-use meta-taxonomy of human competence taxonomies (e.g., CHC; executive function; self-regulation; motivation; etc) into a grand overarching ability and capacity taxonomy.  As stated in the paper “HCQM is positioned to support broad human capability assessment while also providing a partial prescriptive target, at the capacity layer, for engineering synthetic cognitive architectures.”  

IMHO his grand model is one of the most comprehensive proposed high-level integrations of human individual difference constructs and emerging AI competencies I have read.  Although long, I urge those interested in human individual difference domains and AI evaluation frameworks to read his working paper. The paper is relevant to those studying individual differences in humans and those working on models by which to evaluate AI.  

The paper can be found (and downloaded) at the link provided by Kameron (click here).  He has also shared access to his paper at his LinkedIN profile (which is the URL associated with the hyper-link with his name in the first sentence of this post).

I’m sharing this link/paper with his permission.

 

Abstract

The field of intelligence research has long been characterized by fragmentation, with distinct traditions examining general cognitive abilities (Carroll, 1993; McGrew, 2009), emotional and social competencies (Salovey & Mayer, 1990; Goleman, 1995), creativity (Guilford, 1950), metacognition (Flavell, 1979), grit and adaptability (Duckworth et al., 2007), and more recent constructs such as digital intelligence (Park, 2019) and systems thinking (Senge, 1990; Meadows, 2008). While each line of inquiry has yielded valuable insights and measurement tools, the absence of an integrated taxonomy limits holistic assessment of human potential and the principled design of synthetic cognitive architectures. This paper proposes the Human Capability Quotient Map (HCQM) as a hierarchical synthesis that organizes eight top-level domains (General Cognitive Intelligence, Executive/Self-Regulatory Intelligence, Emotional & Social Intelligence, Creative & Innovation Intelligence, Motivational & Adaptive Intelligence, Learning & Knowledge Intelligence, Digital & Technological Intelligence, and Systems & Strategic Intelligence) into a coherent framework. Each domain includes subcomponents and observable indicators drawn from established psychometric, psychological, and cognitive-science literature.

HCQM makes three contributions: the integration itself, a coverage-asymmetry observation, and an explicitly dual-use framing; the two durable differentiators are the integration and the dual-use framing. HCQM is positioned to support broad human capability assessment while also providing a partial prescriptive target, at the capacity layer, for engineering synthetic cognitive architectures, with the explicit limitation that full architectural prescriptiveness requires a companion specification document (§6.6). These are applied to a coverage asymmetry: the human-capability tradition treats motivational, affective, cultural, and adversity capability as first-class (contemporary CHC, for example, now includes emotional intelligence as a broad ability), whereas contemporary AI architecture and evaluation frameworks largely do not. Unlike purely evaluative taxonomies such as DeepMind's 2026 Measuring Progress Toward AGI: A Cognitive Framework (Burnell et al., 2026), which identifies 10 cognitive faculties for benchmarking AGI progress, HCQM brings these dimensions to bear as a specification target. Unlike engineering-oriented architectural frameworks such as CoALA (Sumers et al., 2024), which specifies memory modules, action spaces, and decision loops for language agents, HCQM specifies the capacity surface those structural slots are expected to implement. The dimensions the AI frameworks omit are not a miscellaneous remainder: they concentrate in the motivational, adaptive, and metacognitive capacities (persistence under failure, strategy revision, self-monitoring, calibration) that govern whether a long-horizon autonomous agent is reliable, as distinct from whether it is capable. HCQM's distinctive AI-facing contribution is to organize these as a first-class reliability-and-autonomy layer and specify it at the capacity level (§5.2); a worked example maps a documented long-horizon agent failure pattern to the layer it omits. HCQM consolidates and ports existing constructs rather than claiming to discover them.

Drawing on CHC theory (Carroll, 1993; Schneider & McGrew, 2018), multiple-intelligences and triarchic models (Gardner, 1983; Sternberg, 1985), cultural intelligence (Earley & Ang, 2003), computational thinking (Wing, 2006), and modern cognitive architectures for language agents (Sumers et al., 2024), HCQM offers a synthesis rather than a novel discovery. We outline design principles, detail the hierarchical structure, discuss applications in human development and AI engineering, and acknowledge limitations, including the need for empirical validation, operationalized assessment instruments, and an explicit evaluation protocol. This paper aims to stimulate cross-disciplinary dialogue and guide future instrument development and architectural design.

Keywords: human capabilities, intelligence taxonomy, cognitive architecture, AGI evaluation, capability-grounded architectures, autonomous agents, agent reliability, long-horizon agents, metacognition, grit, cultural intelligence, systems thinking, CHC theory, CoALA.

Click on image to enlarge for easy viewing

AI Brief: The ascent of individual variance in education—the increasing importance of individual differences

This is another IQs Corner AI Brief.  

Prepared by Dr. Kevin McGrew with major assist from Google NotebookLM.  (Click here for brief explanation of how IQs Corner creates AI Briefs from article PDFs).  

For the first time I’m also experimenting with the Google NotebookLM feature of creating an AI generated infographic (Beta) from the research article—click on the image to enlarge for easy viewing.

The Ascent of Individual Variance in Global Education

 

The article "The growing role of individual differences: A cross-National Study of achievement variance reallocation from grade 4 to 8," published in the journal Intelligence (Eriksson et al., 2026; click here to acquire open access PDF copy), explores how the determinants of student achievement shift as children transition from late childhood (approximately age 10) to early adolescence (approximately age 14). The researchers, led by Kimmo Eriksson, sought to determine whether environmental factors, such as the quality of a national school system, become more influential over time through compounding advantages, or if individual learning characteristics grow in importance as academic material becomes more complex.

 

Theoretical Framework

 

The study tested three competing theoretical perspectives on achievement development between Grade 4 and Grade 8:

• Skills-Beget-Skills: Suggests early academic advantages create cascading benefits, predicting that high-quality national systems should lead to compounding advantages and an increase in the proportion of variance attributable to countries.
• Opportunity-to-Learn (OTL): Emphasizes exposure to content and predicts that variance at the school and class levels should increase as curricula become more specialized and students are sorted into different tracks.
• Individual Differences + Institutional Response: The authors’ integrated framework proposes that developmental processes create new individual-level variance, while educational systems respond by sorting students into different classes (tracking/streaming), thereby reallocating that variance to the class level.

Methodology

 

The researchers utilized data from the Trends in International Mathematics and Science Study (TIMSS) across three cohorts (2011–2015, 2015–2019, and 2019–2023). Their analysis involved dozens of countries and two primary methods:

1. Systematic Variance Decomposition: A four-level partition of achievement variance across countries, schools within countries, classes within schools, and individual students.
2. Cross-National Analysis: A formal model examining the relationship between individual characteristics (proxied by within-country relative standing) and educational system quality (proxied by country mean achievement).

Key Findings

 

The results across all cohorts and both subjects (mathematics and science) consistently supported the Individual Differences + Institutional Response hypothesis (H3) and directly contradicted the Skills-Beget-Skills hypothesis.

• Decrease in Country Influence: The proportion of achievement variance attributable to the country level decreased substantially (by 4–11 percentage points) as students moved from Grade 4 to Grade 8.
• Increase in Class-Level Importance: The proportion of variance at the class level increased substantially (by 3–7 percentage points). The class level was unique in benefiting from both the creation of new variance (through differentiated instruction) and the movement of variance (through ability-based sorting).
• Compensatory Advantage: The cross-national analysis revealed that the "slope" relating individual characteristics to system quality was shallower in Grade 8 than in Grade 4. This means that while students in weaker systems need higher individual characteristics to reach a certain achievement level (e.g., 500 points), this compensatory requirement is smaller in Grade 8, indicating that individual traits are increasingly pulling students ahead regardless of their national system's quality.

Conclusions and Implications

 

The authors conclude that stable individual characteristics affecting learning capacity—such as cognitive abilities, motivation, and self-regulation—become more influential as students mature. These traits are further magnified through interaction with educational environments, such as the "Matthew effect," where high-performing students elicit more challenging opportunities and resources. For educational practice, these findings suggest that pedagogical strategies may need to accommodate a wider range of learning profiles as students progress through school. Furthermore, the study cautions researchers that interventions targeting specific early skills may experience "fadeout" if they do not address the underlying learning capacities that become increasingly determinative during adolescence.

 

Leaving no child behind—Beyond cognitive and achievement abilities - #CAMML source “fugitive/grey” working paper now available. Enjoy - #NCLB #learning #EDSPY #motivation #affective #cognitive #intelligence #conative #noncognitive #schoolpsychology #schoolpsychologists

I’ve recently made several posts regarding the importance of conative (i.e., motivation; self-regulated learning strategies; etc.) learner characteristics and how they should be integrated with cognitive abilities (as per the CHC theory of cognitive abilities) to better understand the interplay between learner characteristics and school learning.  These posts have mentioned (and I provided a link) to my recent 2022 article where I articulate a Cognitive-Affective-Motivation Model of Learning; CAMML; click here to access).

In the article I mention that the 2022 CAMML model had its roots in early work I completed as one of the first set of Principal Investigators during the first five years of the University of Minnesota’s National Center on Educational Outcomes (NCEO).  As a result of those posts I’ve had several requests for the original working paper which is best characterized as being “fugitive” or “grey” literature.

The brief back story is that the original 2004 document was a “working paper” (6-15-04; Increasing the Chance of No Child Being Left Behind: Beyond Cognitive and Achievement Abilities, by Kevin McGrew, David Johnson, Anna Casio, Jeffrey Evans) that was written with the aid of discretionary funds from the then Department of Education’s Office of Special Education (OSEP) during the influence of NCLB.  The working draft was submitted but curiously never saw the light of day.

With this post I’m now making the complete 2004 “working paper” (with writing, spelling, and grammar blemish’s in their full glory) available as a PDF.  Click here to access.  Although dated 20 years, IMHO the lengthy paper provides a good accounting of the relevant literature up to 2004, much of which is still relevant.  Below are images of the TOC pages which should give you an hint of the treasure trove of information and literature reviewed.  Enjoy.  Hopefully this MIA paper may help others pursue research and theoretical study in this important area.

Click on images to enlarge for easy reading

#quote2note: Voltaire on #individualdifferences

 

"Minds differ still more than faces"
-Voltaire

Remembering the "individual" in individual differences research: A quote to note

I just ran across this statement in a recent article (see below). It served as a reminder of something I have always preached, but from-time-to-time, tend to forget as I analyze cognitive ability test data, post research articles, or suggest hypotheses regarding test score differences---be it here at this blog, in a journal article, book, book chapter, or professional presentation. The point being that we must remain vigilant in remembering the "individual" in individual differences research.

The privileged unit of analysis in psychology is the individual (Nesselroade, Gerstorf, Hardy, & Ram, 2007). Nevertheless, many data-analytic approaches coarsely aggregate data and tacitly assume group-average models to hold and to be interpreted in lieu of more fine-grained and, ultimately, person-specific models. For example, when a group of persons show an average increase of performance in a learning task, this does not mean that all persons follow a pattern of change similar to this average. In fact, none of the persons may be well represented by the average trend. In a similar vein, Tucker (1966) argued that the consideration of differences instead of averages will allow us to gain more information about the nature of basic functions underlying behavior. Ever since, researchers have been questioning coarse aggregation of data across persons (e.g., Lamiell, 1981; Nesselroade & Molenaar, 1999) as the estimates of averaged effects may not be representative of any single individual. In fact, strong inference about intra-individual variation from interindividual variation is only possible under the ergodic assumption (Molenaar, 2004), which assumes that the group model represents each individual's dynamics (homogeneity) and that those dynamics have constant characteristics in time (stationarity). In the same vein, Simpson (1951) pointed out that a statistical relationship observed in a population could be reversed within subgroups that form the population. For instance, “It may be universally true that drinking coffee increases one's level of neuroticism; then it may still be the case that people who drink more coffee are less neurotic” (Borsboom, Kievit, Cervone, & Hood, 2009, p. 72). Simpson's paradox may arise whenever inferences are drawn across different explanatory levels, for example, from populations to the individual, or from cross-sectional data to intraindividual change over time (see Kievit, Frankenhuis, Waldorp, & Borsboom, 2013, for further illustrations). Hence, there still is a need for focusing on individuals or subgroups of individuals to more accurately model individual process idiosyncrasies and similarities across persons. Particularly, in light of large-scale empirical data sets, aggregation is more likely to lead to models with low informative value about individual underlying processes as it is often difficult to expand prior hypotheses to account for the large number of potential explanatory variables.

Quote is from this article (click on image to enlarge)



- Posted using BlogPress from my iPad

Dr. Detterman's intelligence bytes: On the father of individual differences-Galton

Another in the Dr. Detterman's Intelligence Bytes series

Detterman on Galton




Galton has been called the father of differential psychology, the father of individual differences research, the father of behavioral and educational statistics, the father of behavior genetics, and the father of eugenics, to name a few (though he never had any children of his own). Here is a partial list of his accomplishments:

• Explored and mapped Africa before Livingstone.

• Wrote an extremely popular book on travel to remote places.

• Developed the median

• Developed z-scores

• Developed and promoted correlation for applications in the social sciences

• Pioneered the application of the normal distribution to human characteristics

• Developed the quincunx, a device for demonstrating the normal distribution (Marbles drop down from a central hole over pegs and are distributed into bins forming a normal distribution. These are seen in many science museums.)

• Discovered regression to the mean

• Developed the twin method for behavior genetic research

• Developed and applied the questionnaire method in the social sciences

• Made many contributions to geography

• Explained cyclones

• Developed Galton whistles to test pitch discrimination

• Studied fingerprints and their heritability

• Proved that the probability of identical fingerprints from different individuals was so low that it was extremely unlikely allowing fingerprints to be used in law enforcement.

• Developed underwater ‘spectacles' to allow divers to see clearly

• Demonstrated that intercessional prayer was not effective

• Studied what made an oral presentation interesting (Don't read it.) using an ‘inclinometer' he devised

• Developed a kind of speedometer for bicycles

• Pioneered a method of composite photographs for studying the “average” face

• Developed a heliostat, Galton's Sun-Signal.

• Developed eugenics (see later chapter)

• Got experimental participants to pay him for collecting data on them

IQs Corner intelligence IQ IQ tests psychology history psychology individual differences Galton Doug Detterman Detterman's bytes school psychology neuropsychology cognitive abilities

- iPost using BlogPress from my Kevin McGrew's iPad