KD (2006) — Appendix
Appendix
The author argues that educational policy must move beyond atheoretical, 'just-the-facts' data gathering and instead ground itself in deep scientific theory. Without understanding the underlying causal factors of successful interventions, educational leaders risk expensive failures when attempting to replicate results in different contexts, as seen in the unsuccessful application of class-size reduction in California.
Argument Chains (13)
How the chapter's premises build toward conclusions. Each chain shows a line of reasoning from top to bottom. Click any node for full evidence and counter-arguments.
The Necessity of Causal Theory strong
The formulation of theories about deep causal factors is the motive of scientific progress.1 ev
↓
Uncontrolled variables in real classrooms—such as social interactions, teacher talents, and students' prior knowledge—make determining causal conclusions difficult.2 ev
↓
Statistical results cannot by themselves explain underlying reasons for success or allow confident predictions that they will be repeated in new circumstances.2 ev
↓
To apply research results elsewhere, one needs to understand the detailed causal factors that allow for confident predictions.1 ev
↓
Data regarding what works in schools cannot be applied directly to improve different schools without the benefit of deep analysis and general predictive theory.2 ev · 1 ca
The Expertise Argument strong
The development of high-level skill or expertise consistently requires a minimum of approximately ten years.
↓
Active self-monitoring can only be performed effectively once a person has already reached the expert level.
↓
Strategy instruction theory incorrectly assumes that because expert readers monitor their performance, novices can take a shortcut by being taught to do the same.
↓
The theory supporting long-term reading comprehension strategy instruction is a 'nonconvergence' theory because it conflicts with cognitive science and expertise studies.
↓
Extensive comprehension strategy instruction is not a productive use of instructional time.1 ca
Theory-First Epistemology strong
It is essential to go beyond the latest breathless reports from on-site studies, which are, even at their best, inconclusive.
↓
Good policy is made on the basis of theories that are most firmly grounded in the whole range of relevant empirical studies.2 ev
↓
Good data-gathering techniques, such as random assignment of students, are necessary but do not obviate the need for deep general analysis.4 ev
↓
Theory must always precede data to provide context for interpretation and to justify predictions.1 ev · 1 ca
The Biological/Artificial Mismatch strong
Children possess an innate faculty for oral language but lack an innate faculty for alphabetic learning.
↓
Alphabetic decoding is an artificial product of civilization rather than a natural biological faculty.
↓
Naturalism and formalism are the two dominant ideologies corrupting scientific inference in American education.
↓
Naturalism and formalism are inadequate as empirical theories and contradict established scientific knowledge.1 ca
Scientific Convergence and Reductive Validity strong
Medical research and educational research share similar challenges and should rely on similar standards of reductive explanation.
↓
Statistical evidence for a cure or intervention is insufficient if the mechanism cannot be explained reductively (e.g., through biochemistry or biology).
↓
Experimental and statistical methods in research are dubious without the explanatory support of fundamental, reductive science.1 ca
↓
Educational research must adopt 'convergence'—the alignment of data from multiple scientific domains—as a primary criterion for validity.
The Methodological Standard Argument strong
The mere existence of research showing positive effects for an instructional method does not mean the method is efficient or superior.
↓
Educational researchers have a duty to evaluate the opportunity costs of instructional methods quite apart from ideology.
↓
The goal for framing educational theories that guide policy should be independent data convergence, where multiple independent methods yield similar results.
The Scientific Convergence Argument strong
Scientific progress requires rejecting narrow experimental results if they cannot be explained by theoretical systems that embrace a greater complex of phenomena.
↓
The concept of 'convergence' must be established as a central watchword in education alongside 'random assignment' to ensure policy is grounded in broad scientific reality.1 ca
↓
Greater theoretical sophistication is required to achieve improved practical results in education.1 ca
The Domain Priority Argument strong
The Gradualism Argument moderate
Reading comprehension gains are characterized by a slow gradualism rather than rapid, 'Seabiscuit-style' progress.
↓
While language development can be accelerated, it can never be made 'fast' due to the gradual nature of knowledge building.
↓
Dramatic reading gains from a cumulative knowledge curriculum will likely not appear in test data for three to five years.
↓
Knowledge-based educational reforms will yield dramatic reading gains after a period of three to five years.1 ca
Knowledge as the Engine of Learning moderate
Prior knowledge of a domain is an empirical prerequisite for text comprehension.
↓
To understand a text, a child must possess prior knowledge about the text's domain.
↓
General reading ability is necessarily founded upon the acquisition of general knowledge and 'mere information.'
↓
Diverse information is the only way to achieve the goal of learning to learn, despite the disdain formalist ideologues have for factual content.1 ca
The Failure of Pure Empiricism moderate
The Tennessee STAR study failed to hazard a clear and detailed theoretical interpretation and generalization of its own findings.2 ev
↓
The Tennessee STAR class-size study failed to adequately address theoretical questions regarding unanalyzed opportunity costs.
↓
California's unsuccessful $5 billion effort to improve achievement through smaller class sizes resulted from a lack of clear theoretical interpretation of the STAR study.1 ca
The Social Nature of Reading moderate
Poor readers who can decode but not comprehend usually lack knowledge of the unspoken information taken for granted by the speech community.
↓
Sharing 'the unsaid' (tacit agreements) is what makes a group a speech community and enables comprehension of 'the said.'
↓
Reading comprehension is a subcategory of language comprehension.
The Theory-Over-Data Argument moderate
The Tennessee STAR study was 'exemplary' and 'punctilious' in its data-gathering techniques, meaning its failure in California was a failure of theoretical application rather than statistical method.
↓
Educational theory must 'outrun' data to provide the necessary context for interpreting that data and justifying future predictions.
↓
Greater theoretical sophistication is required to achieve improved practical results in education.1 ca
Counter-Arguments (11)
alternative explanation (3)
The failure in California might not have been a failure of theory, but a failure of scale; reducing class sizes for millions of students is logistically different than a controlled study like STAR.
Short-term strategy instruction might act as a necessary scaffold that allows disadvantaged students to access texts long enough to begin building the knowledge the author advocates for.
The failure of 'naturalism' in practice may be due to poor implementation or insufficient teacher training rather than a fundamental contradiction of scientific knowledge.
value disagreement (1)
A curriculum focused on 'unspoken' knowledge of a specific speech community may inadvertently marginalize students from diverse backgrounds by treating one group's norms as the sole target for 'efficiency'.
methodological concern (4)
In many fields, purely data-driven 'evidence-based practice' is more reliable than theories, which are often prone to human bias and ideological capture.
The 3-5 year lag period makes knowledge-based reforms essentially unfalsifiable and politically impossible in an era of annual accountability.
Waiting for reductive scientific explanations (like neuroscience) before accepting statistical evidence in education is a 'perfectionist fallacy' that delays the use of effective, albeit poorly understood, interventions.
+ 1 more
scope limitation (2)
If we wait for a 'deep general predictive theory' for every intervention, we may never implement helpful changes that have shown strong empirical results in several diverse settings.
The 'knowledge-first' approach to learning to learn assumes that all relevant future knowledge can be anticipated; formal skills provide a 'safety net' for entirely novel domains.
internal inconsistency (1)
Prioritizing 'theoretical sophistication' over 'rigorous data' risks a return to the ideological dogmatism the author criticizes, as 'theory' is often used to ignore inconvenient experimental evidence.
Logical Gaps (9)
Unstated assumptions required for the arguments to work.
A curriculum focused on knowledge acquisition will actually cover the specific 'unsaid' items that appear on standardized tests 3-5 years later.
critical
It must be established that the $5 billion failure in California was caused by a lack of theory rather than other state-specific factors like teacher quality or demographics.
significant
The definition of 'language' must be shown to fundamentally rely on 'tacit knowledge' rather than just syntax and semantics.
minor
That a moral or civic 'duty' exists for policymakers to adhere to scientific standards of theory-building.
significant
Establishing that 'unspoken knowledge' is the specific body of information where independent data (cognitive science, linguistics, sociology) converge.
significant
Establishing that 'natural' instructional methods are strictly limited to 'natural' biological faculties and cannot be adapted for artificial ones.
significant