Relationqualifies · challengesRolewhole school lottery with registered restricted estimand changeAccessFull working paperReviewprimary readRegistry independencemixed affiliation
Independence boundary: Academic/federal evaluation of CKF schools; David Grissmer is independent of CKF, Dan Willingham is a CKF trustee, and CKF supplied professional development. Evaluator, programme and support ties are therefore shown separately.
Bears on: A4 A5 A6 A7 A8
Can establishFor the registered 1,831-single-applicant sample, random offer estimates access to the whole charter-school package: grade-4 ITT .09 (n.s.), grade-5 ITT .12 (significant), and the prespecified grade-6 ELA ITT .04 and TOT .09 (both n.s.). The restricted grades 3-6 TOT .473 is at most a complier LATE for that whole-school package, conditional on IV, exclusion, monotonicity and missingness assumptions.
Cannot establishA .473 registered-population ATE, a causal Core Knowledge curriculum effect, commonality as the active ingredient, a treatment-by-disadvantage interaction, replicated subgroup benefit or durable gap closure.
Open limitation: There were 2,310 unique applicants across 14 lotteries and nine schools, but the registered single-applicant sample was N=1,831; take-up was 45% and grade-6 attrition 37%. The highlighted pooled ITT .241/TOT .473 excludes four high-differential-attrition lotteries and younger applicants. The low-income-site result comes from 62 applications and only 16 winner-enrollees; paper N=167 counts repeated grade observations, not children.
Checked: Full working paper, sample restrictions, attrition, estimands and subgroup analysis; OSF identity corroborated but direct registration inaccessible
Design: Fourteen admission lotteries at nine Colorado Core Knowledge charter schools. Random offer identifies access to the whole school package among applicants; grade 6 was the prespecified primary endpoint, while the highlighted pooled grades 3-6 estimates use a restricted post-registration sample.
Finding: Grade-4 ITT .09, nonsignificant; grade-5 ITT .12, significant; prespecified grade-6 ELA ITT .04 and TOT .09, both nonsignificant. Restricted pooled grades 3-6: ITT .241, TOT .473. One low-income lottery: ITT .944, TOT 1.299.
Detailed limits: The .241/.473 estimates exclude four high-differential-attrition lotteries and younger applicants. The .473 is at most a restricted-sample complier LATE for the whole charter package, conditional on IV, exclusion, monotonicity and missingness assumptions—not a registered-population ATE or curriculum-component effect. The low-income-site result is a within-subgroup estimate, not a treatment-by-disadvantage interaction or gap-change estimand.
Open source appraisal · Open external record