KD (2006) — Chapter 6
Chapter 6
Standardized testing is an essential tool for ensuring educational equity and school accountability, particularly under the No Child Left Behind framework. However, the current tension surrounding tests arises from a mismatch between state guidelines focused on formal strategies and the actual knowledge-building required for reading proficiency.
Argument Chains (13)
How the chapter's premises build toward conclusions. Each chain shows a line of reasoning from top to bottom. Click any node for full evidence and counter-arguments.
The Testing Paradox Chain strong
Current state guidelines for fourth-grade reading comprehension focus heavily on formal strategies rather than specific content.4 ev
↓
Reading comprehension is not a universal, repeatable skill like decoding words or physical sports.
↓
Reading tests are not actually testing comprehension strategies; they are testing comprehension itself.1 ca
↓
Classroom practice in reading strategies cannot compensate for a student's lack of the background knowledge required to understand a passage.
↓
Current accountability arrangements and reading tests create a 'Kafkaesque predicament' where schools follow expert advice but fail to improve scores because the requirements for success are misunderstood.1 ev
↓
Complaints against testing are rooted in a lack of fit between the education that improves reading and the unsuccessful methods schools currently use to raise scores.3 ev
The Content-Dependency Chain strong
General reading comprehension is an abstraction for an array of separate, content-constituted skills.
↓
Proficiency in one reading comprehension task does not necessarily predict skill in another task involving different content.
↓
A student's ability to find the 'main idea' is dependent on their ability to understand the specific text content, not on a formal procedural ability.
↓
Inferences made during reading are based on a 'situation model' derived from relevant domain knowledge about the passage.
↓
Reading tests are not actually testing comprehension strategies; they are testing comprehension itself.1 ca
↓
Reading comprehension is not a universal, repeatable skill like decoding words or physical sports.
The Early-Grade Measurement Gap strong
Word understanding is a slow, subliminal process requiring many exposures that often does not reach the measurement threshold of a standardized test.
↓
Real progress in reading comprehension can occur in the early grades without being captured by the sampling of a short reading test.
↓
In the early grades, children make irregular progress in knowledge and vocabulary that cannot be sensitively measured by general reading tests.
↓
Adequate yearly progress in reading comprehension cannot be accurately measured in early grades by current tests because much relevant learning remains latent.
↓
Standard reading tests fail to positively influence instruction because they are unrelated to any specific content curriculum.
↓
Standard reading comprehension tests have severe shortcomings when used to measure yearly student progress in the early grades.
The Knowledge-Based Nature of Reading Tests strong
If reading comprehension were truly a set of formal strategies, a single test passage would be sufficient to measure a student's skill.
↓
A valid reading test must sample several genres and areas of knowledge because general reading skill requires broad general knowledge.
↓
To read a wide array of passages in different domains, a person must possess a wide array of background knowledge.
↓
There is no structural difference between well-designed state or national tests of reading comprehension.
↓
There is no inherent functional difference between criterion-referenced and norm-referenced reading tests as currently designed.1 ca
The Knowledge-Neutrality Paradox strong
Conscious strategizing is a slow and cumbersome mental process compared to the speed afforded by topic familiarity.
↓
Reading tests are inherently time-sensitive because slowness in reading indicates mental overload, which impairs understanding.
↓
Language comprehension can never be knowledge-neutral.
↓
State reading tests are unwittingly unfair because they primarily measure domain knowledge rather than the formal comprehension skills they claim to test.1 ca
The Locus of Educational Inequity strong
The disparity in reading test scores between children with equal skills but different knowledge levels is a result of differences in general knowledge, not intelligence or classroom learning.
↓
State reading tests are unwittingly unfair because they primarily measure domain knowledge rather than the formal comprehension skills they claim to test.1 ca
↓
The ultimate unfairness in testing resides in the failure of schools to impart the background knowledge required to understand test passages.1 ca
The Socioeconomic Neutralizer Chain strong
The correlation between achieved ability and general information is twice as strong as the correlation between achieved ability and family background.
↓
The possession of general knowledge is a far greater factor in student achievement than socioeconomic status.1 ca
↓
Imparting broad knowledge to all children is the most effective way for schools to narrow the demographic achievement gap.
The Cognitive Efficiency Chain strong
The domains of literature, science, history, and the arts constitute the essential background knowledge required for reading comprehension.
↓
Topic familiarity provides a mental speed that is essential not only for finishing a test on time but also for the cognitive accuracy of the answers provided.
↓
Breadth of knowledge is the single most important factor within human control for academic achievement.1 ca
The Accountability Chain moderate
No effort to reform and improve schools can ignore testing because testing determines the actions of states, schools, teachers, and students.2 ev
↓
Tests of academic progress are the only practical way to hold schools accountable for educating all children.2 ev
↓
State accountability requirements before No Child Left Behind were inadequate.2 ev
↓
Testing only every third or fourth year is problematic because teachers need yearly data to understand student standing.1 ev
↓
Teachers avoid teaching in grades that are tested when testing is infrequent because they fear being blamed for the failures of previous teachers.4 ev
↓
Yearly testing is essential to foster a coherent education where each grade builds on the previous one.1 ca
↓
Americans should support the No Child Left Behind requirement for schools to show adequate yearly progress on reading tests for all social groups.2 ev · 1 ca
The Critique of Empty Standards moderate
Current state reading standards, such as drawing inferences or determining main ideas, are 'empty standards' that do not reflect the actual mechanics of reading.
↓
Knowledge-evasive testing criteria fail to reflect the inherently knowledge-based nature of reading comprehension.
↓
State reading tests from different states (e.g., Texas and Michigan) are functionally interchangeable because they both target the same abstract process criteria.
↓
The phrase 'criterion-referenced' as applied to state reading tests is misleading because these tests are not based on the curriculum in a meaningful way.
↓
State reading tests are inadequate for guiding schooling because they are conceived as tests of empty processes rather than knowledge-based comprehension.1 ca
The Curriculum-Test Solution moderate
Current standardized reading tests are designed to measure general reading ability rather than the specific progress made in schooling.
↓
There is a lack of fit between the content that needs to be taught in schools and the general reading ability currently measured by tests.
↓
General reading tests (like ITBS and CTBS) should be supplemented with curriculum-based tests that measure specific subject-matter mastery.1 ca
↓
Curriculum-based content tests encourage schools to teach the specific words and concepts that lead to long-term reading proficiency.
↓
Schools should systematically teach and then test for the general knowledge that leads to proficient reading comprehension to meet yearly progress requirements.1 ca
The Policy Realignment Chain moderate
Content testing leads to engaging and productive teaching, whereas process-oriented testing leads to 'drill-and-kill' instruction.
↓
Gains in reading are directly proportional to the completeness of a school's implementation of a coherent, content-rich curriculum.
↓
A system of specific content standards and curriculum-based tests will eventually cause scores on non-curriculum tests to rise.
↓
Educational monitors should recognize that adequate yearly progress (AYP) is occurring if students show gains on curriculum-based tests of specific knowledge, even if general reading scores do not yet reflect it.1 ca
The Unpredictability of Reading Prep moderate
Valid reading tests reflect an ability to read passages from an unpredictable diversity of domains rather than directly reflecting school curricula.
↓
Students and teachers cannot and should not directly prepare for a reading test because its essence is unpredictability.
↓
Preparation for a reading test should be done indirectly by becoming a good reader of a broad range of texts through the acquisition of broad general knowledge.
Counter-Arguments (12)
empirical challenge (2)
The 'ultimate unfairness' might lie in the socio-economic disparities that create knowledge gaps before children even enter school, which schools cannot fully remediate regardless of curriculum.
Individual differences in executive function, working memory, and motivation are 'within human control' through different interventions and may be equally or more critical for achievement than the volume of facts known.
alternative explanation (4)
The sanctions associated with NCLB may incentivize 'gaming the system' or narrowing the curriculum to the point of excluding the very 'background knowledge' subjects (history, science) the author advocates for.
Even if tests measure 'empty' processes, they serve as a necessary standardized 'thermometer' for overall school performance, even if they don't provide a 'map' for daily instruction.
Testing specific general knowledge can lead to a 'trivia' curriculum where students memorize isolated facts to pass the content test rather than developing deep conceptual understanding.
+ 1 more
value disagreement (1)
Adding curriculum-based tests increases the testing burden on young students and may conflict with local control over what is taught in classrooms.
methodological concern (4)
Yearly testing creates a high-stakes environment that leads to student burnout and 'test fatigue,' which can depress scores regardless of curriculum quality.
Reading tests are intended to measure 'transferable' comprehension—the ability to extract meaning from *unfamiliar* texts—making knowledge-neutrality a feature, not a bug, of a valid test.
Criterion-referenced tests serve a distinct legal and bureaucratic function by holding schools accountable to specific performance thresholds (cut scores), even if the test items are structurally similar to norm-referenced tests.
+ 1 more
scope limitation (1)
While reading comprehension is content-dependent, there are universal meta-cognitive skills (like self-monitoring for understanding) that, once mastered, allow readers to learn content more efficiently from text.
Logical Gaps (9)
Unstated assumptions required for the arguments to work.
Providing teachers with yearly data will naturally lead them to adopt a content-rich curriculum rather than doubling down on the failed strategy-based prepping.
critical
The specific implementation of NCLB's 'adequate yearly progress' is a fair and accurate way to apply the principle of accountability.
significant
The focus on strategies in state guidelines is the primary cause of poor test performance, rather than other factors like socioeconomic status or teacher quality.
significant
Establishing that a test must be curriculum-based to be useful for guidance, even if it accurately predicts reading ability.
significant
Empirical evidence that providing pictures/definitions *never* works to level the field, rather than just failing in current test designs.
minor
National/state standards must be redefined to specify the broad knowledge required for reading.
significant