Income/education split-sample stability sensitivity =================================================== Status: descriptive associational analysis; no coefficient is a causal effect. Production source commit: 6c70d58d278d768a2b8d46dcdf4e7ddfbccc0a98 Academic year: 2024-2025 Approved SHA-256: {"english": "10828e0b0bb6a5f2794836f5a36e85f6949a58cb2b7a3a14529f303106b6f1a9", "math": "076e89da00f4117d6f49a9f279641484407947145d56445e751a3febaa185283", "science": "eec291f604325979fba71cbc352f401b5d46664d2e4e02ac9569d3fdb25f9839"} Primary estimand: student-weighted association among ordinary ODE Regular elementary school sites. Elementary eligibility is classified from observed Total Population tested-grade profiles across all three subjects (grades 3-5 only); the outcome is each subject's single official Total Population All Grades row. Middle-school results are a labeled sensitivity only. High and combined-grade sites are excluded because a school-address tract is generally not a defensible catchment proxy. Ordinary excludes charter, true virtual (but not Supplemental Virtual), and separately reviewed special-enrollment schools. Outcome counts must satisfy integer L1+L2+L3+L4=scored and L3+L4=proficient. Scored students are the model weights. BA is an ACS fraction; income is ACS median household income in dollars; SEP is percent. SEP midpoint is estimated for left-censored intervals; lower endpoint, upper endpoint, and exact-only results are sensitivities. Missingness is model-specific. Attendance models require tested_grade_rollup plus exact included/regular-attender counts and the rounded rate identity. In-sample fit is separate from 20 repeated 5-fold school-row CV runs (fixed seed 20260910). Bracketed p05-p95 values are descriptive ranges across fixed-seed repeats, not confidence intervals. This report is a stability sensitivity, not headline inference; repeated halves describe coefficient variation under sample splitting. Results - elementary_primary | English | income (as_reported): n=470, scored=86279, beta_context=0.209, beta_BA=0.577, beta_attendance=n/a, in_sample_R2=0.557, CV_R2_mean=0.551 (repeat p05-p95 0.549 to 0.554), split beta context repeat p05-p95 0.140 to 0.270, split beta BA repeat p05-p95 0.494 to 0.660 coverage: cross-subject profile=504, subject All Grades=504, ordinary=470, outcome-identity-valid=470, model-complete=470; missing BA=0, missing context=0, invalid/missing attendance=0 - elementary_primary | English | sep_percent (midpoint): n=468, scored=86205, beta_context=-0.649, beta_BA=0.273, beta_attendance=n/a, in_sample_R2=0.747, CV_R2_mean=0.744 (repeat p05-p95 0.741 to 0.745), split beta context repeat p05-p95 -0.700 to -0.589, split beta BA repeat p05-p95 0.215 to 0.330 coverage: cross-subject profile=504, subject All Grades=504, ordinary=470, outcome-identity-valid=470, model-complete=468; missing BA=0, missing context=2, invalid/missing attendance=0 - elementary_primary | English | sep_percent (lower_endpoint): n=468, scored=86205, beta_context=-0.651, beta_BA=0.272, beta_attendance=n/a, in_sample_R2=0.747, CV_R2_mean=0.744 (repeat p05-p95 0.742 to 0.745), split beta context repeat p05-p95 -0.700 to -0.592, split beta BA repeat p05-p95 0.215 to 0.329 coverage: cross-subject profile=504, subject All Grades=504, ordinary=470, outcome-identity-valid=470, model-complete=468; missing BA=0, missing context=2, invalid/missing attendance=0 - elementary_primary | English | sep_percent (upper_endpoint): n=468, scored=86205, beta_context=-0.647, beta_BA=0.276, beta_attendance=n/a, in_sample_R2=0.747, CV_R2_mean=0.743 (repeat p05-p95 0.741 to 0.745), split beta context repeat p05-p95 -0.699 to -0.585, split beta BA repeat p05-p95 0.216 to 0.334 coverage: cross-subject profile=504, subject All Grades=504, ordinary=470, outcome-identity-valid=470, model-complete=468; missing BA=0, missing context=2, invalid/missing attendance=0 - elementary_primary | English | sep_percent (exact_only): n=462, scored=84800, beta_context=-0.648, beta_BA=0.269, beta_attendance=n/a, in_sample_R2=0.732, CV_R2_mean=0.727 (repeat p05-p95 0.723 to 0.729), split beta context repeat p05-p95 -0.702 to -0.586, split beta BA repeat p05-p95 0.195 to 0.347 coverage: cross-subject profile=504, subject All Grades=504, ordinary=470, outcome-identity-valid=470, model-complete=462; missing BA=0, missing context=8, invalid/missing attendance=0 - elementary_primary | Math | income (as_reported): n=469, scored=85887, beta_context=0.239, beta_BA=0.550, beta_attendance=n/a, in_sample_R2=0.556, CV_R2_mean=0.549 (repeat p05-p95 0.545 to 0.554), split beta context repeat p05-p95 0.181 to 0.298, split beta BA repeat p05-p95 0.490 to 0.619 coverage: cross-subject profile=504, subject All Grades=503, ordinary=469, outcome-identity-valid=469, model-complete=469; missing BA=0, missing context=0, invalid/missing attendance=0 - elementary_primary | Math | sep_percent (midpoint): n=467, scored=85814, beta_context=-0.614, beta_BA=0.294, beta_attendance=n/a, in_sample_R2=0.719, CV_R2_mean=0.715 (repeat p05-p95 0.711 to 0.717), split beta context repeat p05-p95 -0.678 to -0.549, split beta BA repeat p05-p95 0.235 to 0.352 coverage: cross-subject profile=504, subject All Grades=503, ordinary=469, outcome-identity-valid=469, model-complete=467; missing BA=0, missing context=2, invalid/missing attendance=0 - elementary_primary | Math | sep_percent (lower_endpoint): n=467, scored=85814, beta_context=-0.616, beta_BA=0.292, beta_attendance=n/a, in_sample_R2=0.720, CV_R2_mean=0.716 (repeat p05-p95 0.711 to 0.718), split beta context repeat p05-p95 -0.679 to -0.553, split beta BA repeat p05-p95 0.232 to 0.348 coverage: cross-subject profile=504, subject All Grades=503, ordinary=469, outcome-identity-valid=469, model-complete=467; missing BA=0, missing context=2, invalid/missing attendance=0 - elementary_primary | Math | sep_percent (upper_endpoint): n=467, scored=85814, beta_context=-0.611, beta_BA=0.297, beta_attendance=n/a, in_sample_R2=0.718, CV_R2_mean=0.714 (repeat p05-p95 0.710 to 0.716), split beta context repeat p05-p95 -0.676 to -0.544, split beta BA repeat p05-p95 0.238 to 0.356 coverage: cross-subject profile=504, subject All Grades=503, ordinary=469, outcome-identity-valid=469, model-complete=467; missing BA=0, missing context=2, invalid/missing attendance=0 - elementary_primary | Math | sep_percent (exact_only): n=461, scored=84411, beta_context=-0.613, beta_BA=0.287, beta_attendance=n/a, in_sample_R2=0.700, CV_R2_mean=0.695 (repeat p05-p95 0.694 to 0.697), split beta context repeat p05-p95 -0.654 to -0.555, split beta BA repeat p05-p95 0.239 to 0.338 coverage: cross-subject profile=504, subject All Grades=503, ordinary=469, outcome-identity-valid=469, model-complete=461; missing BA=0, missing context=8, invalid/missing attendance=0 - elementary_primary | Science | income (as_reported): n=438, scored=28521, beta_context=0.166, beta_BA=0.578, beta_attendance=n/a, in_sample_R2=0.505, CV_R2_mean=0.496 (repeat p05-p95 0.494 to 0.499), split beta context repeat p05-p95 0.053 to 0.269, split beta BA repeat p05-p95 0.485 to 0.667 coverage: cross-subject profile=504, subject All Grades=472, ordinary=438, outcome-identity-valid=438, model-complete=438; missing BA=0, missing context=0, invalid/missing attendance=0 - elementary_primary | Science | sep_percent (midpoint): n=437, scored=28506, beta_context=-0.560, beta_BA=0.302, beta_attendance=n/a, in_sample_R2=0.646, CV_R2_mean=0.640 (repeat p05-p95 0.636 to 0.643), split beta context repeat p05-p95 -0.613 to -0.511, split beta BA repeat p05-p95 0.242 to 0.365 coverage: cross-subject profile=504, subject All Grades=472, ordinary=438, outcome-identity-valid=438, model-complete=437; missing BA=0, missing context=1, invalid/missing attendance=0 - elementary_primary | Science | sep_percent (lower_endpoint): n=437, scored=28506, beta_context=-0.561, beta_BA=0.300, beta_attendance=n/a, in_sample_R2=0.646, CV_R2_mean=0.641 (repeat p05-p95 0.636 to 0.644), split beta context repeat p05-p95 -0.618 to -0.509, split beta BA repeat p05-p95 0.240 to 0.365 coverage: cross-subject profile=504, subject All Grades=472, ordinary=438, outcome-identity-valid=438, model-complete=437; missing BA=0, missing context=1, invalid/missing attendance=0 - elementary_primary | Science | sep_percent (upper_endpoint): n=437, scored=28506, beta_context=-0.558, beta_BA=0.304, beta_attendance=n/a, in_sample_R2=0.645, CV_R2_mean=0.640 (repeat p05-p95 0.635 to 0.643), split beta context repeat p05-p95 -0.611 to -0.510, split beta BA repeat p05-p95 0.247 to 0.364 coverage: cross-subject profile=504, subject All Grades=472, ordinary=438, outcome-identity-valid=438, model-complete=437; missing BA=0, missing context=1, invalid/missing attendance=0 - elementary_primary | Science | sep_percent (exact_only): n=431, scored=28027, beta_context=-0.558, beta_BA=0.297, beta_attendance=n/a, in_sample_R2=0.629, CV_R2_mean=0.623 (repeat p05-p95 0.620 to 0.626), split beta context repeat p05-p95 -0.641 to -0.470, split beta BA repeat p05-p95 0.233 to 0.362 coverage: cross-subject profile=504, subject All Grades=472, ordinary=438, outcome-identity-valid=438, model-complete=431; missing BA=0, missing context=7, invalid/missing attendance=0 - middle_sensitivity | English | income (as_reported): n=193, scored=88661, beta_context=0.062, beta_BA=0.600, beta_attendance=n/a, in_sample_R2=0.414, CV_R2_mean=0.389 (repeat p05-p95 0.371 to 0.401), split beta context repeat p05-p95 -0.041 to 0.176, split beta BA repeat p05-p95 0.455 to 0.749 coverage: cross-subject profile=202, subject All Grades=202, ordinary=193, outcome-identity-valid=193, model-complete=193; missing BA=0, missing context=0, invalid/missing attendance=0 - middle_sensitivity | English | sep_percent (midpoint): n=191, scored=88568, beta_context=-0.607, beta_BA=0.216, beta_attendance=n/a, in_sample_R2=0.601, CV_R2_mean=0.583 (repeat p05-p95 0.567 to 0.591), split beta context repeat p05-p95 -0.715 to -0.490, split beta BA repeat p05-p95 0.098 to 0.329 coverage: cross-subject profile=202, subject All Grades=202, ordinary=193, outcome-identity-valid=193, model-complete=191; missing BA=0, missing context=2, invalid/missing attendance=0 - middle_sensitivity | English | sep_percent (lower_endpoint): n=191, scored=88568, beta_context=-0.607, beta_BA=0.216, beta_attendance=n/a, in_sample_R2=0.601, CV_R2_mean=0.583 (repeat p05-p95 0.567 to 0.591), split beta context repeat p05-p95 -0.715 to -0.490, split beta BA repeat p05-p95 0.098 to 0.329 coverage: cross-subject profile=202, subject All Grades=202, ordinary=193, outcome-identity-valid=193, model-complete=191; missing BA=0, missing context=2, invalid/missing attendance=0 - middle_sensitivity | English | sep_percent (upper_endpoint): n=191, scored=88568, beta_context=-0.607, beta_BA=0.216, beta_attendance=n/a, in_sample_R2=0.601, CV_R2_mean=0.583 (repeat p05-p95 0.567 to 0.591), split beta context repeat p05-p95 -0.715 to -0.490, split beta BA repeat p05-p95 0.098 to 0.329 coverage: cross-subject profile=202, subject All Grades=202, ordinary=193, outcome-identity-valid=193, model-complete=191; missing BA=0, missing context=2, invalid/missing attendance=0 - middle_sensitivity | English | sep_percent (exact_only): n=191, scored=88568, beta_context=-0.607, beta_BA=0.216, beta_attendance=n/a, in_sample_R2=0.601, CV_R2_mean=0.583 (repeat p05-p95 0.567 to 0.591), split beta context repeat p05-p95 -0.715 to -0.490, split beta BA repeat p05-p95 0.098 to 0.329 coverage: cross-subject profile=202, subject All Grades=202, ordinary=193, outcome-identity-valid=193, model-complete=191; missing BA=0, missing context=2, invalid/missing attendance=0 - middle_sensitivity | Math | income (as_reported): n=192, scored=87581, beta_context=0.059, beta_BA=0.686, beta_attendance=n/a, in_sample_R2=0.528, CV_R2_mean=0.502 (repeat p05-p95 0.486 to 0.515), split beta context repeat p05-p95 -0.124 to 0.214, split beta BA repeat p05-p95 0.531 to 0.829 coverage: cross-subject profile=202, subject All Grades=200, ordinary=192, outcome-identity-valid=192, model-complete=192; missing BA=0, missing context=0, invalid/missing attendance=0 - middle_sensitivity | Math | sep_percent (midpoint): n=190, scored=87489, beta_context=-0.593, beta_BA=0.310, beta_attendance=n/a, in_sample_R2=0.706, CV_R2_mean=0.692 (repeat p05-p95 0.684 to 0.699), split beta context repeat p05-p95 -0.678 to -0.513, split beta BA repeat p05-p95 0.197 to 0.414 coverage: cross-subject profile=202, subject All Grades=200, ordinary=192, outcome-identity-valid=192, model-complete=190; missing BA=0, missing context=2, invalid/missing attendance=0 - middle_sensitivity | Math | sep_percent (lower_endpoint): n=190, scored=87489, beta_context=-0.593, beta_BA=0.310, beta_attendance=n/a, in_sample_R2=0.706, CV_R2_mean=0.692 (repeat p05-p95 0.684 to 0.699), split beta context repeat p05-p95 -0.678 to -0.513, split beta BA repeat p05-p95 0.197 to 0.414 coverage: cross-subject profile=202, subject All Grades=200, ordinary=192, outcome-identity-valid=192, model-complete=190; missing BA=0, missing context=2, invalid/missing attendance=0 - middle_sensitivity | Math | sep_percent (upper_endpoint): n=190, scored=87489, beta_context=-0.593, beta_BA=0.310, beta_attendance=n/a, in_sample_R2=0.706, CV_R2_mean=0.692 (repeat p05-p95 0.684 to 0.699), split beta context repeat p05-p95 -0.678 to -0.513, split beta BA repeat p05-p95 0.197 to 0.414 coverage: cross-subject profile=202, subject All Grades=200, ordinary=192, outcome-identity-valid=192, model-complete=190; missing BA=0, missing context=2, invalid/missing attendance=0 - middle_sensitivity | Math | sep_percent (exact_only): n=190, scored=87489, beta_context=-0.593, beta_BA=0.310, beta_attendance=n/a, in_sample_R2=0.706, CV_R2_mean=0.692 (repeat p05-p95 0.684 to 0.699), split beta context repeat p05-p95 -0.678 to -0.513, split beta BA repeat p05-p95 0.197 to 0.414 coverage: cross-subject profile=202, subject All Grades=200, ordinary=192, outcome-identity-valid=192, model-complete=190; missing BA=0, missing context=2, invalid/missing attendance=0 - middle_sensitivity | Science | income (as_reported): n=190, scored=30988, beta_context=0.054, beta_BA=0.540, beta_attendance=n/a, in_sample_R2=0.333, CV_R2_mean=0.304 (repeat p05-p95 0.287 to 0.317), split beta context repeat p05-p95 -0.042 to 0.158, split beta BA repeat p05-p95 0.408 to 0.648 coverage: cross-subject profile=202, subject All Grades=197, ordinary=190, outcome-identity-valid=190, model-complete=190; missing BA=0, missing context=0, invalid/missing attendance=0 - middle_sensitivity | Science | sep_percent (midpoint): n=189, scored=30977, beta_context=-0.563, beta_BA=0.181, beta_attendance=n/a, in_sample_R2=0.493, CV_R2_mean=0.471 (repeat p05-p95 0.456 to 0.485), split beta context repeat p05-p95 -0.668 to -0.449, split beta BA repeat p05-p95 0.060 to 0.274 coverage: cross-subject profile=202, subject All Grades=197, ordinary=190, outcome-identity-valid=190, model-complete=189; missing BA=0, missing context=1, invalid/missing attendance=0 - middle_sensitivity | Science | sep_percent (lower_endpoint): n=189, scored=30977, beta_context=-0.563, beta_BA=0.181, beta_attendance=n/a, in_sample_R2=0.493, CV_R2_mean=0.471 (repeat p05-p95 0.456 to 0.485), split beta context repeat p05-p95 -0.668 to -0.449, split beta BA repeat p05-p95 0.060 to 0.274 coverage: cross-subject profile=202, subject All Grades=197, ordinary=190, outcome-identity-valid=190, model-complete=189; missing BA=0, missing context=1, invalid/missing attendance=0 - middle_sensitivity | Science | sep_percent (upper_endpoint): n=189, scored=30977, beta_context=-0.563, beta_BA=0.181, beta_attendance=n/a, in_sample_R2=0.493, CV_R2_mean=0.471 (repeat p05-p95 0.456 to 0.485), split beta context repeat p05-p95 -0.668 to -0.449, split beta BA repeat p05-p95 0.060 to 0.274 coverage: cross-subject profile=202, subject All Grades=197, ordinary=190, outcome-identity-valid=190, model-complete=189; missing BA=0, missing context=1, invalid/missing attendance=0 - middle_sensitivity | Science | sep_percent (exact_only): n=189, scored=30977, beta_context=-0.563, beta_BA=0.181, beta_attendance=n/a, in_sample_R2=0.493, CV_R2_mean=0.471 (repeat p05-p95 0.456 to 0.485), split beta context repeat p05-p95 -0.668 to -0.449, split beta BA repeat p05-p95 0.060 to 0.274 coverage: cross-subject profile=202, subject All Grades=197, ordinary=190, outcome-identity-valid=190, model-complete=189; missing BA=0, missing context=1, invalid/missing attendance=0 Machine-readable companion: income_education_split_stability_results.csv