S0004 · france_men_soundings_1987_2007 · registry identity
French National Soundings 1987-2007
External resolution
Resolution status: not_applicable — ongoing assessment/statistical series, no single work
Bears on
Canonical propositions this source was matched as evidence for.
How Hirsch uses it
Every occurrence, grouped by book and chapter, with the claim it was linked to support and (where the extraction regenerated one) the underlying warrant.
2006 · The Knowledge Deficit
Large-scale data from French research showing that effective schooling can overcome initial vocabulary deficits by grade five.
direct A high-quality school system can overcome a disadvantaged student's initial vocabulary deficit by around the fifth grade.
Warrant (implicit): Educational outcomes observed in one national school system can be replicated in another regardless of linguistic, cultural, or socio-economic differences.
could fail ifConfounding variables unique to the French social safety net or its highly centralized, uniform curriculum that are absent in decentralized systems.
2010 · The Making of Americans
National data from France showing the disappearance of demographic achievement gaps by the end of 6th grade.
direct The demographic achievement gap in France almost disappears by the end of sixth grade due to a coherent national curriculum.
Warrant (implicit): A national reduction in achievement gaps coincident with a national curriculum indicates that the curriculum is the mechanism neutralizing the effects of home environment.
could fail ifThe disappearance of the gap in France could be caused by other social safety nets, such as universal high-quality preschool (maternelle) or centralized funding that ensures equal resources to all schools.
2016 · Why Knowledge Matters
Figure 3.1 showing the gap-closing effects of preschool start age on fifth-grade reading and math scores in France in the 1980s.
direct Starting preschool as early as age two provides significant equity benefits for children from lower-income families.
Warrant (implicit): A reduction in the statistical variance between the scores of high-income and low-income students following a specific intervention indicates that the intervention itself is the mechanism of equity.
could fail ifRegression to the mean or changes in the difficulty and scaling of the 1980s tests could create an appearance of gap-closing that does not reflect an actual change in underlying relative ability.
The French natural experiment (1987-2012) where preschools narrowed the gap until the 1990 Jospin law changed elementary schooling.
direct France serves as a model for both the success of preschool and its subsequent null effects following educational reform.
Warrant (implicit): When a country achieves success with a specific educational intervention and then sees that success vanish following a structural change in the subsequent grades, the country serves as a valid experimental control for both outcomes.
could fail ifDemographic shifts in the French population, such as increased immigration during the same period, could account for the decline in outcomes independently of the Jospin law.
French data showing that as the quality of schools declined between 1987 and 2007, equity gaps widened, confirming the Coleman Differential Effect.
direct The French school system narrowed achievement gaps when it had a national curriculum but widened them after abandoning it for a less communal scheme.
Warrant (implicit): When a national school system changes its curricular structure and subsequent longitudinal data shows a correlation between that change and a widening achievement gap, the curricular change is the primary causal driver.
could fail ifThe widening gap may be caused by concurrent demographic shifts, such as increased immigration or changes in the socioeconomic composition of the student body, rather than the curriculum itself.
Statistics regarding grade repetition and failure in reading and arithmetic in French primary schools.
direct The rise in grade repetitions in France was caused by the shift to naturalistic reading and math instruction, rather than the traditional curriculum.
Warrant (implicit): When a change in instructional methods coincides with a rise in student failure rates while previous methods had higher success, the new methodology is the causal agent of the decline.
could fail ifDemographic shifts in the student population, such as an increase in non-native speakers, could account for rising failure rates independently of the curriculum.
French Ministry of Education periodic 'soundings' (surveys) recording student level of competencies and demographics.
direct The French Ministry of Education's periodic 'soundings' provide a precise record of how educational policies affect different socio-economic groups.
Warrant (implicit): Longitudinal survey data combining standardized test scores with student demographics provides an objective map of educational policy outcomes across different social strata.
could fail ifThe 'soundings' may suffer from social desirability bias in how demographic data is reported or from changes in the way 'competencies' are defined over time.
French Ministry of Education 'soundings' from 1987, 1997, and 2007 using identical test instruments to measure 10-year-olds.
direct The French Ministry of Education's periodic 'soundings' provide a precise record of how educational policies affect different socio-economic groups.
Warrant (implicit): Maintaining an identical test instrument over decades allows for a direct causal inference between changes in educational policy and changes in student performance.
could fail ifThe 'identical' test may become less valid over time if the language used in the questions becomes archaic or if students are no longer familiar with the specific cultural references in the older test.
Literacy scores in France declined by four-tenths of a standard deviation (z-score from 0 to -0.37) between 1987 and 2007.
direct The adoption of a child-centered skills curriculum caused average French literacy scores to drop by 0.4 standard deviations over twenty years.
Warrant (implicit): Large-scale drops in national test scores following a systemic pedagogical shift can be attributed to that shift if no other major societal changes occurred simultaneously.
could fail ifIncreased screen time and digital media consumption among children during the 1987-2007 period could be a primary cause for declining literacy scores.
Differential decline in scores between demographic groups, showing children of unemployed/laborers fell much further than children of professionals/intellectuals.
direct The severity of the score decline among needy students in France proves the positive equity effects of a common grade-by-grade curriculum.
Warrant (implicit): A curriculum's effectiveness in promoting social equity is measured by its ability to prevent the achievement gap between wealthy and poor students from widening during times of decline.
could fail ifThe severe decline among needy students could be caused by the erosion of the broader social safety net in France rather than the school curriculum.
French data from 1987 to 2007 showing that new school arrangements intensified social reproduction.
direct The 1990 French educational arrangements intensified social stratification instead of diminishing it.
Warrant (implicit): Educational systems that prioritize individualized learning paths inadvertently reinforce existing home-based advantages and disadvantages.
could fail ifWidening inequality in the labor market may create external pressures that make social reproduction inevitable regardless of how schools are structured.
French Ministry of Education data comparing mathematics performance from 1987 to 2007, showing that while all demographic groups declined, they did so in tandem, unlike the widening gaps observed in literacy.
related The severity of the score decline among needy students in France proves the positive equity effects of a common grade-by-grade curriculum.
Note d’Information 08-38 from the French DEPP, comparing performance of CM2 (5th grade) students in 1987, 1997, and 2007.
Comparison of standard deviation declines showing math declined -0.84 SD while reading declined -0.37 SD.
direct The overall decline in mathematics performance in France between 1987 and 2007 was more than twice as large as the decline in reading.
Warrant (implicit): Standard deviation units are comparable measures across different subject domains and allow for the direct ranking of effect sizes in educational decline.
could fail ifChanges in the difficulty or alignment of the math assessment versus the reading assessment relative to the national curriculum over twenty years.
Data showing the spread between demographic groups increased by 0.1 SD in math but 0.4 SD in reading.
direct The increase in the performance spread between demographic groups was quantified as .1 standard deviation for math and .4 standard deviation for reading.
Warrant (implicit): A larger increase in the standard deviation of performance spreads between groups indicates a greater failure of the school system to compensate for demographic advantages.
could fail ifThe demographic composition of the bottom group may have changed significantly over twenty years, introducing a selection effect through immigration or socioeconomic shifts.
Analysis of writing errors in ten-year-olds showing an increase from 6% to 12% in the high-error group (>25 errors).
direct The percentage of ten-year-old French students making more than twenty-five writing errors doubled between 1987 and 2007.
Warrant (implicit): The frequency of discrete writing errors in a standardized task is a valid proxy for the overall literacy and linguistic competence of a student population.
could fail ifA shift in pedagogical focus toward expression and comprehension and away from orthography may result in more errors without a corresponding decline in cognitive literacy.
Reliability testing during the 2007 French survey where one out of ten images was corrected by two markers, showing inter-rater agreement of 95% (math) to 80% (reading).
direct The variability in inter-rater agreement for reading items (dropping as low as 80% for some questions) has a negligible impact on final performance metrics.
Warrant (explicit): When inter-rater disagreement is concentrated on marginal distinctions like partial versus total success, the noise generated does not aggregate to alter the overall score distribution significantly.
could fail ifSystematic bias in subjective grading where markers consistently favor or penalize certain demographic dialects or styles could skew the final performance metrics despite high average agreement.
French student performance data from 1975-1985 showing high achievement and equality.
direct From 1975 to 1985, France possessed the highest achieving and most egalitarian school system of any large country in Europe.
Warrant (implicit): High achievement scores and low variance between student groups are the primary indicators for defining a school system as the most successful in a region.
could fail ifThe data may reflect a highly selective or tracking-heavy system that excludes lower-performing students from the metrics of 'success' before the reform.
Calculated statistical confidence intervals for French and US longitudinal education data (French: .01509; US: .01050) and relative standard errors (French: 1.54; US: 1.07).
direct The French longitudinal studies (based on 4,200 students from a cohort of 1 million) yield statistical confidence levels similar to the American NAEP (based on 8,700 students from 6 million).
Warrant (implicit): The statistical reliability of a sample's findings is determined by the mathematical relationship between sample size and population size rather than the unique demographic characteristics of the populations being compared.
could fail ifThe French sample may have higher clustering effects or non-response bias than the NAEP, meaning equal confidence intervals do not guarantee equal representativeness or external validity.
2020 · How to Educate a Citizen
Statistical data showing an 80 percent standard deviation decline in French verbal scores over 20 years.
direct The adoption of American-style educational reforms in France caused a decline in verbal scores of 80 percent of a standard deviation within two decades.
Warrant (implicit): The adoption of foreign pedagogical models is the direct cause of a decline in verbal proficiency if the decline occurs in the years following the transition.
could fail ifThe 80 percent standard deviation decline might be an artifact of changing linguistic habits and a decrease in recreational reading among youth due to the rise of digital media rather than school reform.
Sociological graph showing the widening achievement gap between different social classes (children of unemployed/laborers vs. professionals) in France.
direct The achievement gap in France between rich and poor students widened significantly following the implementation of personalized educational reforms.
Warrant (implicit): Moving from a standardized curriculum to personalized learning inherently disadvantages students from lower socioeconomic backgrounds by removing the shared knowledge base necessary for competition.
could fail ifWidening inequality in school scores may simply reflect widening income inequality and the 'Matthew Effect' in the broader economy during the same time period.
Nationwide studies of French fifth graders conducted in 1987, 1997, and 2007 using identical tests and monitoring seven demographic categories.
direct France’s national educational record-keeping is uniquely exhaustive and more precise than most other nations, providing high scientific confidence for educational inferences.
Warrant (explicit): The scientific validity of educational inferences increases proportionally with the exhaustiveness and demographic granularity of a nation's longitudinal record-keeping.
could fail ifThe use of 'identical tests' over decades can lead to measurement decay as the cultural relevance of vocabulary or the specific knowledge being tested changes, making the old test a poor measure for modern cohorts.
The historical success of the 'écoles maternelles' and the national curriculum in producing high and egalitarian reading scores in the 1980s.
direct Prior to 1989, France utilized a highly effective and egalitarian national grade-by-grade elementary school curriculum.
Warrant (implicit): A history of high and egalitarian scores under a specific curricular model establishes that model as the benchmark for educational effectiveness.
could fail ifThe earlier success could be attributed to a more homogeneous student population or different socioeconomic conditions in the 1980s rather than the curriculum itself.
2022 · American Ethnicity
Massive and precise French educational records tracking millions of students across identical conditions.
direct The French data on student achievement is more precise and numerous than American data because it includes all students rather than just a top-scoring subset.
Warrant (implicit): Data sets derived from universal national testing are more reliable for drawing causal conclusions than data sets derived from voluntary or selective participation.
could fail ifLarge-scale administrative data can still be compromised by changes in 'teaching to the test' or variations in how different regions report their local results to the national registry.
French verbal score data showing a rapid decline following the 1989 education reforms.
related The adoption of child-centered, developmental education in France was an unintentional multi-billion-dollar experiment that disproved the efficacy of those methods.
Chart of French Average Verbal Scores (1987-2007) showing a decline of nearly 0.8 standard deviations.
related French verbal scores declined as much in twenty years as American SAT scores declined in sixty years.
Chart of French Reading Scores (1987–2007) segmented by parental profession, showing that scores for children of 'unemployed' and 'laborers' fell much faster than those of 'intellectual professionals'.
direct There is an inverse relationship between child-centered education and social justice.
Warrant (implicit): If a shift toward child-centered schooling results in a widening achievement gap between socioeconomic classes, then child-centered methods are inherently biased against social equity.
could fail ifThe widening gap could be caused by simultaneous economic shifts, such as increased income inequality or the loss of industrial jobs, rather than the school curriculum.
Graph of French reading scores from 1987 to 2007 broken down by professional class, showing that scores for children of laborers and the unemployed dropped significantly more (nearly 1.2 standard deviations) than scores for children of executive/intellectual professionals.
direct Social justice in France, as measured by educational equity, declined following the implementation of child-centered schooling.
Warrant (implicit): When an educational reform leads to a widening performance gap between socio-economic classes, that reform is the direct cause of the decline in social equity.
could fail ifChanging immigration patterns and the increasing concentration of poverty in specific urban areas during those two decades could explain the diverging scores of laborers' children.
A statistical chart showing a consistent downward trend in reading scores for five social categories in France (Executive/Intellectual, Unemployed, Laborers, Artisans/Shop Owners/Farmers/White Collar, and Intermediate Professionals) over two decades.
direct French reading scores across all socio-economic groups declined significantly between 1987 and 2007.
Warrant (implicit): A simultaneous decline in performance across all demographic sectors indicates a systemic failure in the national educational methodology.
could fail ifSocietal-wide changes such as the rise of digital entertainment and decreased leisure reading time may have reduced literacy across all classes independent of school quality.
2023 · Shared Knowledge
A 20-year study of 12 million pupils by the French Ministry of Education showing that shared instruction raises scores and individualized instruction lowers them, especially for the disadvantaged.
direct French reading scores fell significantly and unequally across socio-economic groups following the Loi Jospin reforms.
Warrant (implicit): A simultaneous decline in scores and an increase in inequality following a transition to individualized instruction proves that the instruction style caused the decline.
could fail ifThe confounding effect of the 1989 Loi Jospin's other changes, such as teacher training requirements or administrative decentralization.
French Ministry of Education longitudinal data (1987, 1997, 2007) using identical test items to measure reading ability among 11-year-olds.
direct The French reading data was carefully controlled because the 1987, 1997, and 2007 assessments used the identical exam and the same representative geographical and sociological data.
Warrant (implicit): The use of identical test items and stable demographic sampling across decades ensures that changes in scores reflect changes in student ability rather than test difficulty.
could fail ifObsolescence of test items, where questions from 1987 may become less relevant or more difficult for 2007 students due to cultural shifts rather than literacy decline.
The 'French Reading Scores 1987–2007' chart, showing declines in standard deviation for various SES groups (unemployed, laborers, etc.).
related Individualized, child-centered education induces social inequalities.
French Reading Scores 1987-2007 showing a steep decline (the 'French elbow') across various social classes after the 1989 reform.
direct The full implementation of American-style individualized pedagogy in France resulted in a steep descent in reading scores among eleven-year-olds.
Warrant (implicit): The adoption of pedagogical philosophies from one country by another will inevitably result in the same educational outcomes observed in the source country.
could fail ifCross-cultural translation failure, where the French version of 'individualized pedagogy' may differ significantly from the American version.
A 20-year longitudinal look at 12 million pupils in France showing the impact of shared knowledge.
direct Evidence from a massive 20-year experiment in France supports the effectiveness of shared knowledge schooling.
Warrant (implicit): Large-scale national shifts in student performance following a major policy change can be attributed to the specific pedagogical shift mandated by that policy.
could fail ifMacroeconomic or demographic shifts in France between 1987 and 2007, such as changes in immigration patterns or poverty rates, could independently lower scores.
The 'French Elbow' chart showing the impact of early schooling on disadvantaged students.
direct The quality of education in grades K-5 is life-determining for disadvantaged children.
Warrant (implicit): Data showing that early educational interventions significantly alter the academic trajectories of disadvantaged groups proves that those specific grades are the definitive factor in their lifelong outcomes.
could fail ifThe long-term benefits of K-5 quality may dissipate if not followed by high-quality secondary education, making later schooling a confounding variable.
2024 · The Ratchet Effect
Fifth-grade nationwide data recorded by the French central government showing score declines.
direct The French Americanized their schooling approximately 20 years before their manifest decline recorded by the central government.
Warrant (implicit): A twenty-year gap between a policy change and a recorded decline in student achievement represents the necessary gestation period for curricular changes to manifest in national data.
could fail ifEconomic shifts or changes in the labor market over two decades could have altered the home environment and readiness of students independently of school reforms.
Three massive national 'sondages' (soundings) conducted in France in 1987, 1997, and 2007 showing 5th grade score declines.
direct French educational evaluations are superior to American ones because they measured results in the fifth grade rather than the twelfth.
Warrant (explicit): Testing students at the end of primary school provides a more accurate assessment of a curriculum's effectiveness than testing them at the end of secondary school.
could fail ifFifth-grade scores may reflect developmental stages that even out by high school, whereas twelfth-grade scores better capture the cumulative effect of education.
French reading scores from 1987-2007 broken down by parent occupation (Laborers/Unemployed vs. Executive/Intellectual), showing a steep drop for the lower socio-economic groups.
direct In France, the gap between rich and poor students widened after the 1989 reforms, with the poor declining more than the rich.
Warrant (implicit): If a curriculum change coincides with a widening achievement gap between socioeconomic classes, the curriculum is failing to provide the compensatory knowledge necessary for social mobility.
could fail ifThe widening gap might be caused by increasing income inequality or the 'Matthew Effect' where wealthy parents provide supplemental tutoring to offset school changes.
A massive 20-year study of 12 million French pupils documenting performance and socioeconomic origins between 1987 and 2007.
direct The French study of twelve million pupils (1987-2007) provides meticulous and massive evidence regarding the outcomes of different educational approaches.
Warrant (implicit): Large-scale national longitudinal data covering an entire student population over decades provides the most definitive evidence for the impact of systemic educational policy changes.
could fail ifSocietal confounding variables, such as changes in immigration patterns, economic shifts, or household technology (like the rise of the internet), which occurred simultaneously with the French curriculum changes.
A massive longitudinal study of 12 million French pupils from 1987 to 2007, showing performance declines following a shift away from shared knowledge curricula.
direct The French study of twelve million pupils (1987-2007) provides meticulous and massive evidence regarding the outcomes of different educational approaches.
Warrant (implicit): A chronological decline in national test scores following a specific change in curriculum is primary evidence that the curriculum change caused the decline.
could fail ifPost hoc ergo propter hoc fallacy, where the decline in French scores might be better explained by changes in teacher training standards or the socio-economic destabilization of urban districts rather than the curriculum itself.
2007 French Ministry of Education data compiled and published by Paola Mattei.
direct The data collected by the French Ministry of Education constitutes the most definitive comparative study of curriculum effects ever undertaken.
Warrant (implicit): Government-led longitudinal data tracking a total population before and after a singular structural policy shift provides the highest possible level of empirical proof for causal curriculum effects.
could fail ifThe data may be confounded by exogenous socio-economic shocks or changes in the national labor market occurring simultaneously with the curricular shift.
Rising rates of primary students repeating grades due to inability to read or reckon.
direct The increase in French primary students failing to read and having to repeat grades was a consequence of new progressive teaching methods, not the old curriculum.
Warrant (implicit): If a rise in student failure coincides with the introduction of new teaching methods, the methods are the primary cause of the failure.
could fail ifThe failure rate might increase because the standard for what counts as 'passing' was raised simultaneously with the new methods.
The French Ministry of Education's periodic 'soundings' (national longitudinal data) from 1987, 1997, and 2007 using identical test instruments and demographic categories.
direct The data collected by the French Ministry of Education constitutes the most definitive comparative study of curriculum effects ever undertaken.
Warrant (implicit): Longitudinal studies using identical testing instruments across a single national population provide the most reliable basis for measuring the causal impact of curriculum changes.
could fail ifIdentical test instruments may lose validity over time as the 'teaching to the test' effect or changes in the cultural relevance of the questions skew the results.
Sounding results showing a decline of 0.4 standard deviations in literacy skills over two decades following the 1989 law.
direct The implementation of a child-centered skills curriculum caused average literacy scores in France to fall by 0.4 standard deviations.
Warrant (implicit): A temporal correlation between the introduction of a new pedagogical philosophy and a decline in national test scores indicates that the pedagogy caused the decline.
could fail ifExtraneous variables such as shifts in national immigration patterns, economic instability, or changes in family structure could have occurred simultaneously with the 1989 law.
Comparative data showing that students with better-educated parents suffered less decline than students from disadvantaged backgrounds under the new curriculum.
direct The decline in educational achievement following the 1989 reform disproportionately affected the neediest students.
Warrant (implicit): If a decline in educational outcomes is steeper for students without domestic academic support, then the school system has failed to provide the equalizing knowledge it previously offered.
could fail ifThe decline among disadvantaged students might be caused by a widening 'digital divide' or economic shifts that reduced the resources available to low-income families during that specific period.
Figure 7.2: Longitudinal data comparing z-scores for French students in 1987 (knowledge-based curriculum) versus 2007 (skills-based curriculum).
direct The implementation of a child-centered skills curriculum caused average literacy scores in France to fall by 0.4 standard deviations.
Warrant (implicit): Large-scale shifts in normalized test scores (z-scores) over two decades are primarily attributable to changes in national instructional standards rather than broader cultural or technological shifts.
could fail ifThe rise of digital media and the corresponding decline in recreational reading habits among youth could explain falling literacy scores independently of the school curriculum.
Comparison of decline across social classes: Children of unemployed/laborers saw a drop of nearly 1.0 standard deviation, while children of executives saw a smaller decline.
direct Educational achievement declines under a skills-based curriculum are more severe for disadvantaged students than for advantaged students.
Warrant (implicit): A school system's curriculum is the primary factor that determines whether the achievement gap between social classes narrows or widens.
could fail ifThe widening gap could be driven by 'parental investment' inflation, where wealthy parents increase private tutoring to compensate for school changes, while poor parents cannot.
Endnote numbers seen
Raw book:chapter:endnote references collected during endnote backfill.
wkm:3:23wkm:5:16wkm:7:29wkm:prologue:11
Raw source_reference strings seen
As they appeared before normalization/consolidation into this source identity.
DEPP, 2008French Ministry of Education (implied by context of 'carefully controlled' and 'same exam')French grammar-school experiment (as cited in the text)Hirsch (2016), Figure 7.2Note d’Information 08-38: Lire, Écrire, Compter (DEPP, 2008)Unspecified French sociological chart