Please log in to access this page.
chemla2013experimentingcontextualismnat
/data/papers/chemla2013experimentingcontextualismnat/REPORT.md# Extraction report: chemla2013experimentingcontextualismnat
## Summary
- Pipeline outputs still used for manuscript structure and wording:
- Extraction index/status: `papers/chemla2013experimentingcontextualismnat/out/bundle.json`
- Study design + participants + appendix wording checks: `papers/chemla2013experimentingcontextualismnat/out/fulltext.md`
- Scenario-text cross-checks and figure/table fragments: `papers/chemla2013experimentingcontextualismnat/out/tei.xml`
- Supplementary archive now used as the primary numeric source:
- `papers/chemla2013experimentingcontextualismnat/out/external/Analyses-SHARE.zip`
- Extracted payload: `papers/chemla2013experimentingcontextualismnat/out/external/Analyses-SHARE/`
- Output YAML:
- `papers/chemla2013experimentingcontextualismnat/chemla2013experimentingcontextualismnat.yaml`
- Reproducible computation notebook:
- `papers/chemla2013experimentingcontextualismnat/analysis/effect_sizes.qmd`
## What changed
- The previous extraction stored only two aggregate knowledge effects (positive and negative) based on Figure 5.
- The updated extraction replaces those aggregate rows with eight vignette-level knowledge effects:
- Bank: positive, negative
- Truck/bridge: positive, negative
- Train: positive, negative
- Spelling/typos: positive, negative
- Each effect now includes:
- Low/high condition means and SDs
- Paired t-test reconstructed from the raw data
- Computed SMD (`d`, `v`) using the project's within-subject SMCRP convention
## Manual interventions / non-pipeline sources
- The supplementary `Analyses-SHARE` archive was extracted locally and used directly.
- The original `Analyses.R` script in the archive was followed for:
- special-case recoding (`SCENARIO == 5`, misc coding fix)
- inclusion filtering (`Ireponse > -1`, exclude `TYPE == "E"`, English-language respondents only)
- No manual digitization from charts was needed once the archive was available.
## Residual limitations
- The raw archive stores numeric knowledge-scenario ids (`K1`-`K4`) rather than explicit vignette names.
- The mapping `K1->Bank`, `K2->Truck`, `K3->Train`, `K4->Spelling` is inferred from appendix order and preserved as a quality flag in each effect.
- The train vignette text and moderator coding were corrected from the source PDF appendix directly, but the code-to-vignette mapping is still inferred rather than explicitly labeled in the supplementary archive.
- Color, miscellaneous, control, and bias items are not encoded as effects because this extraction targets the knowledge-stakes contrasts relevant to the meta-analysis.
## Validation / follow-up
- The new vignette-level means, SDs, and paired tests are reproducible from:
- `papers/chemla2013experimentingcontextualismnat/out/external/Analyses-SHARE/raw-results-pro.txt`
- `papers/chemla2013experimentingcontextualismnat/out/external/Analyses-SHARE/raw-results-anti.txt`
- The new computation path is documented in:
- `papers/chemla2013experimentingcontextualismnat/analysis/effect_sizes.qmd`
- Moderator audit update:
- `evidence_reliability` was re-coded per `docs/extraction_instructions.md` Section 6.
- Final codes: bank = Medium, bridge = Medium, train = Medium, typos = High (applied to both polarity effects for each vignette).
- The other moderator fields (`scenario`, `skeptical_pressure`, `awareness`, `evidence`, `attribution_person`) were re-checked against the appendix wording and left unchanged.
- Bank-case provenance/quotes were corrected to the paper's experimental Figure 2 wording on PDF page 14, replacing earlier quotes pulled from the introductory DeRose/Table-2 version.
- Recommended follow-up:
- re-render the extraction HTML after confirming the YAML (`meta-extract render-extraction chemla2013experimentingcontextualismnat`)