Extraction report — Turri 2017

schema_version: '1.2'
paper:
  paper_id: turrindepistemiccontextualismidle
  citation: 'Turri, J. (n.d.). Epistemic Contextualism: An Idle Hypothesis. (Penultimate version; to appear in Australasian
    Journal of Philosophy.)'
  short_label: Turri 2017
  doi: null
  published: null
  year: null
  language: English
  language_other: null
  research_objective: Test whether classic low/high stakes contextualist cases produce shifting judgments about knowledge
    and related requirements (truth, belief, evidence), and whether the common deferral confound (agent says “I know” vs “I
    don’t know”) can explain the pattern; additionally test whether stakes affect the evidential standard required to know.
  data_availability:
    data_available_online: null
    url: null
    notes: null
  notes: Text indicates this PDF is the penultimate version; publication year/DOI not provided in extracted outputs.
studies:
- study_id: 1
  label: Experiment 1 (bank; Low vs High)
  language: English
  language_other: null
  objective: Test whether judgments about a knowledge attribution/denial and related factors (truth, belief, evidence, actionability)
    shift across a classic low vs high stakes bank case.
  sample:
    n_final: 201
    recruitment: mTurk
    recruitment_other: null
    compensation: money
    compensation_other: $0.40 (approx. 2–3 minutes)
    characteristics: U.S. residents; aged 19–71 (mean 31); 94% native English; 77 female.
    provenance:
      page: null
      quote: Participants. Two hundred and one participants (aged 19-71 years, mean age = 31 years; 94% reporting English
        as a native language; 77 female) were tested. Participants were U.S. residents, recruited and tested online using
        Amazon Mechanical Turk and Qualtrics, and compensated $0.40 for approximately 2-3 minutes of their time.
      tei_id: null
      table_ref: null
    mean_age: 31
    mean_age_prov:
      page: null
      quote: Two hundred and one participants (aged 19-71 years, mean age = 31 years; 94% reporting English as a native language;
        77 female) were tested.
      tei_id: null
      table_ref: null
  design: Between-Subjects
  design_other: null
  manipulated_factors:
  - Agent knowledge statement polarity varies with stakes (self-ascription in Low; self-denial in High).
  - Questioner affect varies with stakes (Jane calm in Low; anxious in High).
  paradigm: Agreement that a sentence is true
  paradigm_other: null
  scale:
    label: Likert 7-point
    points: 7
    anchors: 1 ("Strongly Disagree") to 7 ("Strongly Agree")
    direction: Higher = greater agreement.
    provenance:
      page: null
      quote: Responses were collected on a standard seven-point Likert scale, 1 ("Strongly Disagree") -7 ("Strongly Agree"),
        left-to-right on the participant's screen.
      tei_id: null
      table_ref: null
  measures:
    knowledge_question_text: When Keith said, "I [do/don't] know," what he said was true.
    knowledge_question_first: null
    additional_question_text: null
  scenarios:
  - scenario_code: bank
    scenario_type: Bank-hours / deposit vignette (bank open on Saturday).
    high_stakes_text: null
    low_stakes_text: null
    provenance:
      page: null
      quote: The stories were based on the original pair of "bank cases" (DeRose 2009, pp. 1-2).
      tei_id: null
      table_ref: null
  effects:
  - effect_id: s1_e1
    subgroup: Knowledge statement truth (self-regarding; bank)
    subgroup_desc: Agreement with “When Keith said, ‘I do/don’t know,’ what he said was true.”
    design: Between-Subjects
    design_other: null
    moderators:
      scenario: bank
      skeptical_pressure: 'Yes'
      awareness: 'Yes'
      evidence: First Person
      attribution_person: First Person
      evidence_reliability: Medium
    moderators_coding:
      scenario:
        provenance:
          page: null
          quote: The stories were based on the original pair of "bank cases" (DeRose 2009, pp. 1-2).
          tei_id: null
          table_ref: null
        reason: Bank-hours vignette (deposit check; bank open on Saturday).
      skeptical_pressure:
        provenance:
          page: null
          quote: Jane responds [calmly/anxiously], "This is really [not/very] important, [but/and] lots of banks are closed
            on Saturdays. Do you know that our bank is open tomorrow?"
          tei_id: null
          table_ref: null
        reason: The vignette includes explicit doubt/counterconsideration about whether the bank is open.
      awareness:
        provenance:
          page: null
          quote: It is [not/very] important for him to deposit the check before Monday
          tei_id: null
          table_ref: null
        reason: Stakes (importance of depositing the check) are described as part of the protagonist’s situation at the time
          of the knowledge question.
      evidence:
        provenance:
          page: null
          quote: It was two Saturdays ago that I went to our bank, and it was open.
          tei_id: null
          table_ref: null
        reason: Evidence is the protagonist’s own past experience/memory.
      attribution_person:
        provenance:
          page: null
          quote: So, [yes, I do/no, I don't] know that our bank is open tomorrow.
          tei_id: null
          table_ref: null
        reason: Knowledge statement is first-person (self-ascription/denial).
      evidence_reliability:
        provenance:
          page: null
          quote: It was two Saturdays ago that I went to our bank, and it was open.
          tei_id: null
          table_ref: null
        reason: Reliability is not meaningfully specified/manipulated; coded null.
    contrast:
      group_high: high_stakes
      group_low: low_stakes
      sign_convention: d = mean(low) - mean(high)
      other_notes: Low vs High stakes is confounded with questioner affect (calm vs anxious) and with the agent’s knowledge
        statement (self-ascription vs self-denial).
    groups:
    - group_id: low_stakes
      label: null
      n: 102
      mean: 5.02
      sd: 1.48
      se: null
      provenance:
        page: 9
        quote: “Know” 5.02 (1.48) 4.36 (1.81) 2.81 189 .006 0.66 0.41 0.20 1.12
        tei_id: null
        table_ref: tabula_stream_p9_t1.csv
    - group_id: high_stakes
      label: null
      n: 99
      mean: 4.36
      sd: 1.81
      se: null
      provenance:
        page: 9
        quote: “Know” 5.02 (1.48) 4.36 (1.81) 2.81 189 .006 0.66 0.41 0.20 1.12
        tei_id: null
        table_ref: tabula_stream_p9_t1.csv
    reported_test:
      test: t
      t: 2.81
      df1: 189.0
      p: 0.006
      reported_d: 0.41
      notes: Table reports Cohen’s d as an absolute magnitude.
      provenance:
        page: 9
        quote: “Know” 5.02 (1.48) 4.36 (1.81) 2.81 189 .006 0.66 0.41 0.20 1.12
        table_ref: tabula_stream_p9_t1.csv
    effect_size:
      metric: SMD
      d: 0.399811605602
      v: 0.020302566794
      computed_from: groups
      needs_review: false
      notes: Computed from group means/SDs and split Ns with esc::esc_mean_sd in analysis/effect_sizes.qmd.
    quality_flags: []
    notes: null
  notes: null
- study_id: 2
  label: Conceptual replication of Experiment 1 (flight; Low vs High)
  language: English
  language_other: null
  objective: Conceptual replication of Experiment 1 using a direct-flight vignette (low vs high stakes) and the same metalinguistic
    truth-evaluation questions.
  sample:
    n_final: null
    recruitment: mTurk
    recruitment_other: null
    compensation: money
    compensation_other: $0.40 (same recruitment/compensation as other experiments per Experiment 1 description)
    characteristics: null
    provenance:
      page: null
      quote: Participants were recruited and tested the same way as in all experiments reported here.
      tei_id: null
      table_ref: null
    mean_age: null
  design: Between-Subjects
  design_other: null
  manipulated_factors:
  - Agent knowledge statement polarity varies with stakes (self-ascription in Low; self-denial in High).
  - Questioner affect varies with stakes (Jill calm in Low; anxious in High).
  paradigm: Agreement that a sentence is true
  paradigm_other: null
  scale:
    label: Likert 7-point
    points: 7
    anchors: 1 ("Strongly Disagree") to 7 ("Strongly Agree")
    direction: Higher = greater agreement.
    provenance:
      page: null
      quote: Responses were collected on a standard seven-point Likert scale, 1 ("Strongly Disagree") -7 ("Strongly Agree"),
        left-to-right on the participant's screen.
      tei_id: null
      table_ref: null
  measures:
    knowledge_question_text: When Stewart said, "I [do/don't] know," what he said was true.
    knowledge_question_first: null
    additional_question_text: null
  scenarios:
  - scenario_code: airport
    scenario_type: Direct-flight vignette (vacation vs organ courier).
    high_stakes_text: null
    low_stakes_text: null
    provenance:
      page: null
      quote: 'In the high stakes version, it is very important whether the flight is direct: Stewart is transporting a liver
        for transplantation, and a non-direct flight will cause it to spoil.'
      tei_id: fig_1
      table_ref: manifest.json:fig_1
  effects:
  - effect_id: s2_e1
    subgroup: Knowledge statement truth (self-regarding; flight)
    subgroup_desc: Agreement with “When Stewart said, ‘I do/don’t know,’ what he said was true.”
    design: Between-Subjects
    design_other: null
    moderators:
      scenario: airport
      skeptical_pressure: 'Yes'
      awareness: 'Yes'
      evidence: First Person
      attribution_person: First Person
      evidence_reliability: Medium
    moderators_coding:
      scenario:
        provenance:
          page: null
          quote: Stewart and his wife Jill are organ couriers.
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: Scenario is about whether a flight is direct; coded airport.
      skeptical_pressure:
        provenance:
          page: null
          quote: Jill responds [calmly/anxiously], "This is really [not/very] important, [but/and] sometimes the online booking
            information is inaccurate. Do you know that the flight is direct to Chicago?"
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: Explicit counterconsideration (online booking information may be inaccurate).
      awareness:
        provenance:
          page: null
          quote: It's Saturday morning and they are currently [beginning their vacation/transporting a liver].
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: Stakes are described as part of the protagonist’s situation at the time of the knowledge question.
      evidence:
        provenance:
          page: null
          quote: It was two Saturdays ago that I flew this airline to Chicago, and the flight was direct.
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: Evidence is protagonist’s own past experience/memory.
      attribution_person:
        provenance:
          page: null
          quote: So, [yes, I do/no, I don't] know that the flight is direct.
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: Knowledge statement is first-person (self-ascription/denial).
      evidence_reliability:
        provenance:
          page: null
          quote: It was two Saturdays ago that I flew this airline to Chicago, and the flight was direct.
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: Reliability is not meaningfully specified/manipulated; coded null.
    contrast:
      group_high: high_stakes
      group_low: low_stakes
      sign_convention: d = mean(low) - mean(high)
      other_notes: Low vs High stakes is confounded with questioner affect (calm vs anxious) and with the agent’s knowledge
        statement (self-ascription vs self-denial).
    groups:
    - group_id: low_stakes
      label: null
      n: 52
      mean: 4.44
      sd: 1.55
      se: null
      provenance:
        page: 11
        quote: “Know” 4.44 (1.55) 5.41 (1.61) -3.07 99 .003 -0.97 0.61 -1.56 -0.34
        tei_id: null
        table_ref: tabula_stream_p11_t2.csv
    - group_id: high_stakes
      label: null
      n: 49
      mean: 5.41
      sd: 1.61
      se: null
      provenance:
        page: 11
        quote: “Know” 4.44 (1.55) 5.41 (1.61) -3.07 99 .003 -0.97 0.61 -1.56 -0.34
        tei_id: null
        table_ref: tabula_stream_p11_t2.csv
    reported_test:
      test: t
      t: -3.07
      df1: 99.0
      p: 0.003
      reported_d: 0.61
      notes: Table reports Cohen’s d as an absolute magnitude.
      provenance:
        page: 11
        quote: “Know” 4.44 (1.55) 5.41 (1.61) -3.07 99 .003 -0.97 0.61 -1.56 -0.34
        table_ref: tabula_stream_p11_t2.csv
    effect_size:
      metric: SMD
      d: -0.614166764737
      v: 0.041506263263
      computed_from: groups
      needs_review: false
      notes: Computed from group means/SDs and split Ns with esc::esc_mean_sd in analysis/effect_sizes.qmd.
    quality_flags: []
    notes: null
  notes: null
- study_id: 3
  label: Experiment 2 (bank; Yes vs No; stakes held constant)
  language: English
  language_other: null
  objective: Test the deferral confound by holding stakes constant and varying only whether the agent self-attributes knowledge
    (“I do know”) or self-denies knowledge (“I don’t know”).
  sample:
    n_final: 199
    recruitment: mTurk
    recruitment_other: null
    compensation: money
    compensation_other: $0.40 (same recruitment/compensation as other experiments per Experiment 1 description)
    characteristics: Aged 18–65 (mean 31); 97% native English; 80 female.
    provenance:
      page: null
      quote: Participants. One hundred ninety-nine new participants (aged 18-65 years, mean age = 31 years; 97% reporting
        English as a native language; 80 female) were tested.
      tei_id: null
      table_ref: null
    mean_age: 31
    mean_age_prov:
      page: null
      quote: One hundred ninety-nine new participants (aged 18-65 years, mean age = 31 years; 97% reporting English as a native
        language; 80 female) were tested.
      tei_id: null
      table_ref: null
  design: Between-Subjects
  design_other: null
  manipulated_factors:
  - Agent knowledge statement polarity (Yes=“I do know” vs No=“I don’t know”).
  paradigm: Agreement that a sentence is true
  paradigm_other: null
  scale:
    label: Likert 7-point
    points: 7
    anchors: 1 ("Strongly Disagree") to 7 ("Strongly Agree")
    direction: Higher = greater agreement.
    provenance:
      page: null
      quote: Responses were collected on a standard seven-point Likert scale, 1 ("Strongly Disagree") -7 ("Strongly Agree"),
        left-to-right on the participant's screen.
      tei_id: null
      table_ref: null
  measures:
    knowledge_question_text: When Keith said, "I [do/don't] know," what he said was true.
    knowledge_question_first: null
    additional_question_text: null
  scenarios:
  - scenario_code: bank
    scenario_type: Bank-hours / deposit vignette (stakes held constant; agent statement varied).
    high_stakes_text: null
    low_stakes_text: null
    provenance:
      page: null
      quote: The present experiment tests this deferral hypothesis by comparing results from two cases differing only in whether
        the agent says "I know" or "I don't know."
      tei_id: null
      table_ref: null
  effects:
  - effect_id: s3_e1
    subgroup: Knowledge statement truth (deferral; bank; Yes vs No)
    subgroup_desc: Agreement with “When Keith said, ‘I do/don’t know,’ what he said was true,” comparing Yes vs No conditions
      (stakes held constant).
    design: Between-Subjects
    design_other: null
    moderators:
      scenario: bank
      skeptical_pressure: 'Yes'
      awareness: 'Yes'
      evidence: First Person
      attribution_person: First Person
      evidence_reliability: null
    moderators_coding:
      scenario:
        provenance:
          page: null
          quote: (Yes/No) Keith and his wife Jane are driving home from work on Friday afternoon.
          tei_id: fig_2
          table_ref: manifest.json:fig_2
        reason: Bank-hours vignette (deposit; bank open on Saturday).
      skeptical_pressure:
        provenance:
          page: null
          quote: Jane asks, "Do you know that our bank is open tomorrow?"
          tei_id: fig_3
          table_ref: manifest.json:fig_3
        reason: The vignette includes the standard skeptical prompt/question about whether the bank is open.
      awareness:
        provenance:
          page: null
          quote: Participants in both conditions were equally likely to judge the situation unserious.
          tei_id: null
          table_ref: null
        reason: Stakes are treated as part of the scenario context; in this experiment stakes do not vary (held constant).
      evidence:
        provenance:
          page: null
          quote: It was two Saturdays ago that I went to our bank, and it was open.
          tei_id: fig_3
          table_ref: manifest.json:fig_3
        reason: Evidence is the protagonist’s own past experience/memory.
      attribution_person:
        provenance:
          page: null
          quote: So, [yes, I do/no, I don't] know that our bank is open tomorrow.
          tei_id: fig_3
          table_ref: manifest.json:fig_3
        reason: Knowledge statement is first-person (self-ascription vs self-denial).
      evidence_reliability:
        provenance:
          page: null
          quote: It was two Saturdays ago that I went to our bank, and it was open.
          tei_id: fig_3
          table_ref: manifest.json:fig_3
        reason: Reliability is not meaningfully specified/manipulated; coded null.
    contrast:
      group_high: 'no'
      group_low: 'yes'
      sign_convention: other
      other_notes: This contrast is Yes vs No knowledge statement (stakes held constant). Sign convention used here is d =
        mean(yes) - mean(no).
    groups:
    - group_id: 'yes'
      label: Yes condition (agent says “I do know”)
      n: 98
      mean: 4.58
      sd: 1.67
      se: null
      provenance:
        page: 14
        quote: “Know” 4.58 (1.67) 4.49 (1.78) 0.39 197 .694 0.09 0.06 -0.39 0.58
        tei_id: null
        table_ref: tabula_stream_p14_t3.csv
    - group_id: 'no'
      label: No condition (agent says “I don’t know”)
      n: 101
      mean: 4.49
      sd: 1.78
      se: null
      provenance:
        page: 14
        quote: “Know” 4.58 (1.67) 4.49 (1.78) 0.39 197 .694 0.09 0.06 -0.39 0.58
        tei_id: null
        table_ref: tabula_stream_p14_t3.csv
    reported_test:
      test: t
      t: 0.39
      f: null
      chi2: null
      z: null
      df1: 197
      df2: null
      p: 0.694
      reported_d: 0.06
      reported_r: null
      notes: Table reports Cohen’s d as an absolute magnitude.
      provenance:
        page: 14
        quote: “Know” 4.58 (1.67) 4.49 (1.78) 0.39 197 .694 0.09 0.06 -0.39 0.58
        tei_id: null
        table_ref: tabula_stream_p14_t3.csv
    effect_size:
      metric: SMD
      d: 0.052122137662
      v: 0.020111897654
      computed_from: groups
      needs_review: false
      notes: Computed from group means/SDs and split Ns (Yes vs No) with esc::esc_mean_sd in analysis/effect_sizes.qmd.
    quality_flags: []
    notes: null
  notes: null
- study_id: 4
  label: Conceptual replication of Experiment 2 (flight; Yes vs No)
  language: English
  language_other: null
  objective: Conceptual replication of Experiment 2 using the direct-flight vignette, varying only whether the agent says
    “I do know” vs “I don’t know” (stakes held constant).
  sample:
    n_final: null
    recruitment: mTurk
    recruitment_other: null
    compensation: money
    compensation_other: $0.40 (same recruitment/compensation as other experiments per Experiment 1 description)
    characteristics: null
    provenance:
      page: null
      quote: Participants were recruited and tested the same way as in all experiments reported here.
      tei_id: null
      table_ref: null
    mean_age: null
  design: Between-Subjects
  design_other: null
  manipulated_factors:
  - Agent knowledge statement polarity (Yes=“I do know” vs No=“I don’t know”).
  paradigm: Agreement that a sentence is true
  paradigm_other: null
  scale:
    label: Likert 7-point
    points: 7
    anchors: 1 ("Strongly Disagree") to 7 ("Strongly Agree")
    direction: Higher = greater agreement.
    provenance:
      page: null
      quote: Responses were collected on a standard seven-point Likert scale, 1 ("Strongly Disagree") -7 ("Strongly Agree"),
        left-to-right on the participant's screen.
      tei_id: null
      table_ref: null
  measures:
    knowledge_question_text: When Stewart said, "I [do/don't] know," what he said was true.
    knowledge_question_first: null
    additional_question_text: null
  scenarios:
  - scenario_code: airport
    scenario_type: Direct-flight vignette (Yes vs No; stakes held constant).
    high_stakes_text: null
    low_stakes_text: null
    provenance:
      page: null
      quote: (Yes/No) It's Saturday, and Stewart and his wife Jill are considering whether to fly to Chicago.
      tei_id: fig_4
      table_ref: manifest.json:fig_4
  effects:
  - effect_id: s4_e1
    subgroup: Knowledge statement truth (deferral; flight; Yes vs No)
    subgroup_desc: Agreement with “When Stewart said, ‘I do/don’t know,’ what he said was true,” comparing Yes vs No conditions
      (stakes held constant).
    design: Between-Subjects
    design_other: null
    moderators:
      scenario: airport
      skeptical_pressure: 'Yes'
      awareness: 'Yes'
      evidence: First Person
      attribution_person: First Person
      evidence_reliability: null
    moderators_coding:
      scenario:
        provenance:
          page: null
          quote: It's Saturday, and Stewart and his wife Jill are considering whether to fly to Chicago.
          tei_id: fig_4
          table_ref: manifest.json:fig_4
        reason: Scenario is about whether a flight is direct; coded airport.
      skeptical_pressure:
        provenance:
          page: null
          quote: Jill asks, "Do you know that the flight is direct to Chicago?"
          tei_id: fig_4
          table_ref: manifest.json:fig_4
        reason: The vignette includes the standard skeptical prompt/question about whether the flight is direct.
      awareness:
        provenance:
          page: null
          quote: Participants in both conditions were equally likely to judge the situation unserious.
          tei_id: null
          table_ref: null
        reason: Stakes are treated as part of the scenario context; in this experiment stakes do not vary (held constant).
      evidence:
        provenance:
          page: null
          quote: It was two Saturdays ago that I flew this airline to Chicago, and the flight was direct.
          tei_id: fig_4
          table_ref: manifest.json:fig_4
        reason: Evidence is protagonist’s own past experience/memory.
      attribution_person:
        provenance:
          page: null
          quote: So, [yes, I do/no, I don't] know that the flight is direct.
          tei_id: fig_4
          table_ref: manifest.json:fig_4
        reason: Knowledge statement is first-person (self-ascription vs self-denial).
      evidence_reliability:
        provenance:
          page: null
          quote: It was two Saturdays ago that I flew this airline to Chicago, and the flight was direct.
          tei_id: fig_4
          table_ref: manifest.json:fig_4
        reason: Reliability is not meaningfully specified/manipulated; coded null.
    contrast:
      group_high: 'no'
      group_low: 'yes'
      sign_convention: other
      other_notes: This contrast is Yes vs No knowledge statement (stakes held constant). Sign convention used here is d =
        mean(yes) - mean(no).
    groups:
    - group_id: 'yes'
      label: Yes condition (agent says “I do know”)
      n: 50
      mean: 4.54
      sd: 1.73
      se: null
      provenance:
        page: 15
        quote: “Know” 4.54 (1.73) 4.61 (1.98) -0.18 99 .855 -0.68 0.04 -0.80 0.67
        tei_id: null
        table_ref: tabula_stream_p15_t4.csv
    - group_id: 'no'
      label: No condition (agent says “I don’t know”)
      n: 51
      mean: 4.61
      sd: 1.98
      se: null
      provenance:
        page: 15
        quote: “Know” 4.54 (1.73) 4.61 (1.98) -0.18 99 .855 -0.68 0.04 -0.80 0.67
        tei_id: null
        table_ref: tabula_stream_p15_t4.csv
    reported_test:
      test: t
      t: -0.18
      f: null
      chi2: null
      z: null
      df1: 99
      df2: null
      p: 0.855
      reported_d: 0.04
      reported_r: null
      notes: Table reports Cohen’s d as an absolute magnitude. (Table-extracted MD for this row appears inconsistent with
        the means/CI; effect size computed from means/SDs.)
      provenance:
        page: 15
        quote: “Know” 4.54 (1.73) 4.61 (1.98) -0.18 99 .855 -0.68 0.04 -0.80 0.67
        tei_id: null
        table_ref: tabula_stream_p15_t4.csv
    effect_size:
      metric: SMD
      d: -0.037624978833
      v: 0.039614851251
      computed_from: groups
      needs_review: false
      notes: Computed from group means/SDs and split Ns (Yes vs No) with esc::esc_mean_sd in analysis/effect_sizes.qmd.
    quality_flags:
    - table_extraction_uncertain
    notes: null
  notes: null
- study_id: 5
  label: Experiment 3 (bank; Low vs High; recommendation)
  language: English
  language_other: null
  objective: Test for evidence supporting contextualism while avoiding deferral by asking whether the agent should self-attribute
    knowledge to speak truthfully (agent makes no knowledge statement in the vignette).
  sample:
    n_final: 202
    recruitment: mTurk
    recruitment_other: null
    compensation: money
    compensation_other: $0.40 (same recruitment/compensation as other experiments per Experiment 1 description)
    characteristics: Aged 18–63 (mean 30); 95% native English; 78 female.
    provenance:
      page: null
      quote: Participants. Two hundred and two participants (aged 18-63 years, mean age = 30 years; 95% reporting English
        as a native language; 78 female) were tested.
      tei_id: null
      table_ref: null
    mean_age: 30
    mean_age_prov:
      page: null
      quote: Two hundred and two participants (aged 18-63 years, mean age = 30 years; 95% reporting English as a native language;
        78 female) were tested.
      tei_id: null
      table_ref: null
  design: Between-Subjects
  design_other: null
  manipulated_factors:
  - Questioner affect varies with stakes (Jane calm in Low; anxious in High).
  paradigm: Agreement that a sentence is true
  paradigm_other: null
  scale:
    label: Likert 7-point
    points: 7
    anchors: 1 ("Strongly Disagree") to 7 ("Strongly Agree")
    direction: Higher = greater agreement.
    provenance:
      page: null
      quote: Participants then went to a new screen and rated their agreement with the same statements about truth, belief,
        evidence, seriousness, and actionability from Experiment 1, in the same way as in Experiment 1.
      tei_id: null
      table_ref: null
  measures:
    knowledge_question_text: In order for Keith's answer to be true, he should say, "Yes, I do know."
    knowledge_question_first: null
    additional_question_text: null
  scenarios:
  - scenario_code: bank
    scenario_type: Bank-hours / deposit vignette (no knowledge statement; recommendation DV).
    high_stakes_text: null
    low_stakes_text: null
    provenance:
      page: null
      quote: Participants were randomly assigned to one of two conditions, Low and High, in a between-subjects design.
      tei_id: null
      table_ref: null
  effects:
  - effect_id: s5_e1
    subgroup: Knowledge self-ascription recommendation (bank)
    subgroup_desc: Agreement with “In order for Keith’s answer to be true, he should say, ‘Yes, I do know.’”
    design: Between-Subjects
    design_other: null
    moderators:
      scenario: bank
      skeptical_pressure: 'Yes'
      awareness: 'Yes'
      evidence: First Person
      attribution_person: First Person
      evidence_reliability: Medium
    moderators_coding:
      scenario:
        provenance:
          page: null
          quote: Each participant read a single story very similar to the ones used in Experiment 1.
          tei_id: null
          table_ref: null
        reason: Bank-hours vignette (deposit; bank open on Saturday).
      skeptical_pressure:
        provenance:
          page: null
          quote: The stories were the same as in Experiment 1 through the point where Jane asks, "Do you know that our bank
            is open tomorrow?"
          tei_id: null
          table_ref: null
        reason: The vignette includes the standard skeptical prompt about whether the bank is open.
      awareness:
        provenance:
          page: null
          quote: Participants were randomly assigned to one of two conditions, Low and High, in a between-subjects design.
          tei_id: null
          table_ref: null
        reason: Stakes (Low vs High) are described as part of the protagonist’s situation at the time of the knowledge question.
      evidence:
        provenance:
          page: null
          quote: It was two Saturdays ago that I went to our bank, and it was open.
          tei_id: null
          table_ref: null
        reason: Evidence is the protagonist’s own past experience/memory.
      attribution_person:
        provenance:
          page: null
          quote: In order for Keith's answer to be true, he should say, "Yes, I do know."
          tei_id: null
          table_ref: null
        reason: The outcome is framed as a first-person self-ascription (“I do know”).
      evidence_reliability:
        provenance:
          page: null
          quote: It was two Saturdays ago that I went to our bank, and it was open.
          tei_id: null
          table_ref: null
        reason: Reliability is not meaningfully specified/manipulated; coded null.
    contrast:
      group_high: high_stakes
      group_low: low_stakes
      sign_convention: d = mean(low) - mean(high)
      other_notes: null
    groups:
    - group_id: low_stakes
      label: null
      n: 102
      mean: 4.79
      sd: 1.72
      se: null
      provenance:
        page: 18
        quote: “Know” 4.79 (1.72) 4.64 (1.68) 0.64 200 .520 0.15 0.09 -0.32 0.63
        tei_id: null
        table_ref: tabula_stream_p18_t5.csv
    - group_id: high_stakes
      label: null
      n: 100
      mean: 4.64
      sd: 1.68
      se: null
      provenance:
        page: 18
        quote: “Know” 4.79 (1.72) 4.64 (1.68) 0.64 200 .520 0.15 0.09 -0.32 0.63
        tei_id: null
        table_ref: tabula_stream_p18_t5.csv
    reported_test:
      test: t
      t: 0.64
      df1: 200.0
      p: 0.52
      reported_d: 0.09
      notes: Table reports Cohen’s d as an absolute magnitude.
      provenance:
        page: 18
        quote: “Know” 4.79 (1.72) 4.64 (1.68) 0.64 200 .520 0.15 0.09 -0.32 0.63
        table_ref: tabula_stream_p18_t5.csv
    effect_size:
      metric: SMD
      d: 0.088218811866
      v: 0.019823185328
      computed_from: groups
      needs_review: false
      notes: Computed from group means/SDs and split Ns with esc::esc_mean_sd in analysis/effect_sizes.qmd.
    quality_flags: []
    notes: null
  notes: null
- study_id: 6
  label: Conceptual replication of Experiment 3 (flight; Low vs High; recommendation)
  language: English
  language_other: null
  objective: Conceptual replication of Experiment 3 using the direct-flight vignette and the same recommendation outcome (should
    say “Yes, I do know” to speak truthfully).
  sample:
    n_final: null
    recruitment: mTurk
    recruitment_other: null
    compensation: money
    compensation_other: $0.40 (same recruitment/compensation as other experiments per Experiment 1 description)
    characteristics: null
    provenance:
      page: null
      quote: Participants were recruited and tested the same way as in all experiments reported here.
      tei_id: null
      table_ref: null
    mean_age: null
  design: Between-Subjects
  design_other: null
  manipulated_factors:
  - Questioner affect varies with stakes (Jill calm in Low; anxious in High).
  paradigm: Agreement that a sentence is true
  paradigm_other: null
  scale:
    label: Likert 7-point
    points: 7
    anchors: 1 ("Strongly Disagree") to 7 ("Strongly Agree")
    direction: Higher = greater agreement.
    provenance:
      page: null
      quote: Participants then went to a new screen and rated their agreement with the same statements about truth, belief,
        evidence, seriousness, and actionability from the conceptual replication of Experiment 1.
      tei_id: null
      table_ref: null
  measures:
    knowledge_question_text: In order for Stewart's answer to be true, he should say, "Yes, I do know."
    knowledge_question_first: null
    additional_question_text: null
  scenarios:
  - scenario_code: airport
    scenario_type: Direct-flight vignette (vacation vs organ courier; recommendation DV).
    high_stakes_text: null
    low_stakes_text: null
    provenance:
      page: null
      quote: Stewart wants to correctly answer Jill's question. Please rate your agreement with the following statement.
      tei_id: null
      table_ref: null
  effects:
  - effect_id: s6_e1
    subgroup: Knowledge self-ascription recommendation (flight)
    subgroup_desc: Agreement with “In order for Stewart’s answer to be true, he should say, ‘Yes, I do know.’”
    design: Between-Subjects
    design_other: null
    moderators:
      scenario: airport
      skeptical_pressure: 'Yes'
      awareness: 'Yes'
      evidence: First Person
      attribution_person: First Person
      evidence_reliability: Medium
    moderators_coding:
      scenario:
        provenance:
          page: null
          quote: Stewart wants to correctly answer Jill's question. Please rate your agreement with the following statement.
          tei_id: null
          table_ref: null
        reason: Scenario is about whether a flight is direct; coded airport.
      skeptical_pressure:
        provenance:
          page: null
          quote: Jill asks, "Do you know that the flight is direct to Chicago?"
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: The vignette includes explicit doubt/counterconsideration about whether the flight is direct.
      awareness:
        provenance:
          page: null
          quote: It's Saturday morning and they are currently [beginning their vacation/transporting a liver].
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: Stakes are described as part of the protagonist’s situation (Low vs High).
      evidence:
        provenance:
          page: null
          quote: It was two Saturdays ago that I flew this airline to Chicago, and the flight was direct.
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: Evidence is protagonist’s own past experience/memory.
      attribution_person:
        provenance:
          page: null
          quote: In order for Stewart's answer to be true, he should say, "Yes, I do know."
          tei_id: null
          table_ref: null
        reason: The outcome is framed as a first-person self-ascription (“I do know”).
      evidence_reliability:
        provenance:
          page: null
          quote: It was two Saturdays ago that I flew this airline to Chicago, and the flight was direct.
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: Reliability is not meaningfully specified/manipulated; coded null.
    contrast:
      group_high: high_stakes
      group_low: low_stakes
      sign_convention: d = mean(low) - mean(high)
      other_notes: null
    groups:
    - group_id: low_stakes
      label: null
      n: 50
      mean: 4.9
      sd: 1.61
      se: null
      provenance:
        page: 19
        quote: “Know” 4.90 (1.61) 4.76 (1.72) 0.41 99 .684 0.14 0.08 -0.52 0.79
        tei_id: null
        table_ref: tabula_stream_p19_t6.csv
    - group_id: high_stakes
      label: null
      n: 51
      mean: 4.76
      sd: 1.72
      se: null
      provenance:
        page: 19
        quote: “Know” 4.90 (1.61) 4.76 (1.72) 0.41 99 .684 0.14 0.08 -0.52 0.79
        tei_id: null
        table_ref: tabula_stream_p19_t6.csv
    reported_test:
      test: t
      t: 0.41
      df1: 99.0
      p: 0.684
      reported_d: 0.08
      notes: Table reports Cohen’s d as an absolute magnitude.
      provenance:
        page: 19
        quote: “Know” 4.90 (1.61) 4.76 (1.72) 0.41 99 .684 0.14 0.08 -0.52 0.79
        table_ref: tabula_stream_p19_t6.csv
    effect_size:
      metric: SMD
      d: 0.084010249876
      v: 0.039642782355
      computed_from: groups
      needs_review: false
      notes: Computed from group means/SDs and split Ns with esc::esc_mean_sd in analysis/effect_sizes.qmd.
    quality_flags: []
    notes: null
  notes: null
- study_id: 7
  label: Experiment 4 (bank; evidence strength required)
  language: English
  language_other: null
  objective: Test contextualism by asking what strength of evidence is required to know, comparing Low vs High stakes contexts.
  sample:
    n_final: 99
    recruitment: mTurk
    recruitment_other: null
    compensation: money
    compensation_other: $0.40 (same recruitment/compensation as other experiments per Experiment 1 description)
    characteristics: Aged 18–74 (mean 31); 97% native English; 41 female.
    provenance:
      page: null
      quote: Participants. Ninety-nine new participants (aged 18-74 years, mean age = 31 years; 97% reporting English as a
        native language; 41 female) were tested.
      tei_id: null
      table_ref: null
    mean_age: 31
    mean_age_prov:
      page: null
      quote: Ninety-nine new participants (aged 18-74 years, mean age = 31 years; 97% reporting English as a native language;
        41 female) were tested.
      tei_id: null
      table_ref: null
  design: Between-Subjects
  design_other: null
  manipulated_factors: []
  paradigm: Rating how much evidence is needed for knowledge
  paradigm_other: null
  scale:
    label: other
    points: 10
    anchors: 1 to 10 (10 = highest)
    direction: Higher = stronger evidence required for knowledge.
    provenance:
      page: null
      quote: Responses were collected on a ten-point scale, 1-10, left-to-right on the participant's screen.
      tei_id: null
      table_ref: null
  measures:
    knowledge_question_text: Knowing requires evidence that rates _____ on the scale.
    knowledge_question_first: null
    additional_question_text: null
  scenarios:
  - scenario_code: bank
    scenario_type: Bank-hours vignette (evidence threshold DV).
    high_stakes_text: null
    low_stakes_text: null
    provenance:
      page: null
      quote: The procedures and stories for the conditions were very similar to Experiment 1, except this time the story ends
        with Jane posing a question to Keith about evidence and knowledge.
      tei_id: null
      table_ref: null
  effects:
  - effect_id: s7_e1
    subgroup: Evidence strength required for knowledge (bank)
    subgroup_desc: Response to 1–10 question about how strong evidence must be to know (Low vs High stakes).
    design: Between-Subjects
    design_other: null
    moderators:
      scenario: bank
      skeptical_pressure: 'Yes'
      awareness: 'Yes'
      evidence: First Person
      attribution_person: First Person
      evidence_reliability: Medium
    moderators_coding:
      scenario:
        provenance:
          page: null
          quote: The procedures and stories for the conditions were very similar to Experiment 1, except this time the story
            ends with Jane posing a question to Keith about evidence and knowledge.
          tei_id: null
          table_ref: null
        reason: Bank-hours vignette (deposit; bank open on Saturday).
      skeptical_pressure:
        provenance:
          page: null
          quote: The stories were the same as in Experiment 1 through the point where Jane asks, "Do you know that our bank
            is open tomorrow?"
          tei_id: null
          table_ref: null
        reason: The vignette includes the standard skeptical prompt about whether the bank is open.
      awareness:
        provenance:
          page: null
          quote: Participants were randomly assigned to one of two conditions, Low and High, in a between-subjects design.
          tei_id: null
          table_ref: null
        reason: Stakes (Low vs High) are described as part of the protagonist’s situation.
      evidence:
        provenance:
          page: null
          quote: It was two Saturdays ago that I went to our bank, and it was open.
          tei_id: null
          table_ref: null
        reason: Evidence is the protagonist’s own past experience/memory.
      attribution_person:
        provenance:
          page: null
          quote: Knowing requires evidence that rates _____ on the scale.
          tei_id: null
          table_ref: null
        reason: The DV is framed as what the protagonist should say about “knowing” in the first-person context of the vignette.
      evidence_reliability:
        provenance:
          page: null
          quote: It was two Saturdays ago that I went to our bank, and it was open.
          tei_id: null
          table_ref: null
        reason: Reliability is not meaningfully specified/manipulated; coded null.
    contrast:
      group_high: high_stakes
      group_low: low_stakes
      sign_convention: d = mean(low) - mean(high)
      other_notes: Condition split Ns are not reported in extracted outputs; d/v computed using analyst-authorized equal-N
        assumption n_low=n_high=99/2.
    groups:
    - group_id: low_stakes
      label: null
      n: null
      mean: 8.31
      sd: 1.86
      se: null
      provenance:
        page: null
        quote: High/Low, M = 8.62/8.31, SD = 1.98/1.86 t(97) = -0.81, p = .418, n.s.
        tei_id: null
        table_ref: null
    - group_id: high_stakes
      label: null
      n: null
      mean: 8.62
      sd: 1.98
      se: null
      provenance:
        page: null
        quote: High/Low, M = 8.62/8.31, SD = 1.98/1.86 t(97) = -0.81, p = .418, n.s.
        tei_id: null
        table_ref: null
    reported_test:
      test: t
      t: -0.81
      df1: 97.0
      p: 0.418
      notes: Split condition Ns not reported; effect size computed using analyst-authorized equal-N assumption n_low=n_high=99/2.
      provenance:
        page: null
        quote: High/Low, M = 8.62/8.31, SD = 1.98/1.86 t(97) = -0.81, p = .418, n.s.
    effect_size:
      metric: SMD
      d: -0.161379553952
      v: 0.040535572527
      computed_from: groups
      needs_review: false
      notes: Computed from group means/SDs with esc::esc_mean_sd in analysis/effect_sizes.qmd using analyst-authorized equal-N
        assumption n_low=n_high=99/2; integer-split sensitivity changes v by about 0.000004.
    quality_flags:
    - imputed_equal_split_n
    notes: null
  notes: null
- study_id: 8
  label: Conceptual replication of Experiment 4 (flight; evidence strength required)
  language: English
  language_other: null
  objective: Conceptual replication of Experiment 4 using the direct-flight vignette, asking what strength of evidence is
    required to know (Low vs High stakes).
  sample:
    n_final: null
    recruitment: mTurk
    recruitment_other: null
    compensation: money
    compensation_other: $0.40 (same recruitment/compensation as other experiments per Experiment 1 description)
    characteristics: null
    provenance:
      page: null
      quote: Participants were recruited and tested the same way as in all experiments reported here.
      tei_id: null
      table_ref: null
    mean_age: null
  design: Between-Subjects
  design_other: null
  manipulated_factors: []
  paradigm: Rating how much evidence is needed for knowledge
  paradigm_other: null
  scale:
    label: other
    points: 10
    anchors: 1 to 10 (10 = highest)
    direction: Higher = stronger evidence required for knowledge.
    provenance:
      page: null
      quote: On a scale of 1 to 10, with 10 being the highest, how strong must your evidence be in order to know that the
        flight is direct?
      tei_id: null
      table_ref: null
  measures:
    knowledge_question_text: Knowing requires evidence that rates _____ on the scale.
    knowledge_question_first: null
    additional_question_text: null
  scenarios:
  - scenario_code: airport
    scenario_type: Direct-flight vignette (evidence threshold DV).
    high_stakes_text: null
    low_stakes_text: null
    provenance:
      page: null
      quote: Again I conducted a conceptual replication with the story about the direct flight.
      tei_id: null
      table_ref: null
  effects:
  - effect_id: s8_e1
    subgroup: Evidence strength required for knowledge (flight)
    subgroup_desc: Response to 1–10 question about how strong evidence must be to know (Low vs High stakes).
    design: Between-Subjects
    design_other: null
    moderators:
      scenario: airport
      skeptical_pressure: 'Yes'
      awareness: 'Yes'
      evidence: First Person
      attribution_person: First Person
      evidence_reliability: Medium
    moderators_coding:
      scenario:
        provenance:
          page: null
          quote: Again I conducted a conceptual replication with the story about the direct flight.
          tei_id: null
          table_ref: null
        reason: Scenario is about whether a flight is direct; coded airport.
      skeptical_pressure:
        provenance:
          page: null
          quote: Jill asks, "Do you know that the flight is direct to Chicago?"
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: The vignette includes explicit doubt/counterconsideration about whether the flight is direct.
      awareness:
        provenance:
          page: null
          quote: It's Saturday morning and they are currently [beginning their vacation/transporting a liver].
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: Stakes are described as part of the protagonist’s situation (Low vs High).
      evidence:
        provenance:
          page: null
          quote: It was two Saturdays ago that I flew this airline to Chicago, and the flight was direct.
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: Evidence is protagonist’s own past experience/memory.
      attribution_person:
        provenance:
          page: null
          quote: Knowing requires evidence that rates _____ on the scale.
          tei_id: null
          table_ref: null
        reason: DV is framed as what the protagonist should say about “knowing” in the first-person context of the vignette.
      evidence_reliability:
        provenance:
          page: null
          quote: It was two Saturdays ago that I flew this airline to Chicago, and the flight was direct.
          tei_id: fig_1
          table_ref: manifest.json:fig_1
        reason: Reliability is not meaningfully specified/manipulated; coded null.
    contrast:
      group_high: high_stakes
      group_low: low_stakes
      sign_convention: d = mean(low) - mean(high)
      other_notes: v computed from reported d + t(df) without split Ns (see analysis/effect_sizes.qmd).
    groups:
    - group_id: low_stakes
      label: null
      n: null
      mean: 8.59
      sd: 1.56
      se: null
      provenance:
        page: null
        quote: High/Low, M = 9.08/8.59, SD = 1.29/1.56, t(98) = 1.69, p = .093, d = 0.34.
        tei_id: null
        table_ref: null
    - group_id: high_stakes
      label: null
      n: null
      mean: 9.08
      sd: 1.29
      se: null
      provenance:
        page: null
        quote: High/Low, M = 9.08/8.59, SD = 1.29/1.56, t(98) = 1.69, p = .093, d = 0.34.
        tei_id: null
        table_ref: null
    reported_test:
      test: t
      t: 1.69
      df1: 98.0
      p: 0.093
      reported_d: 0.34
      notes: Reported Cohen’s d appears to be an absolute magnitude; sign set in effect_size using d = mean(low) - mean(high).
      provenance:
        page: null
        quote: High/Low, M = 9.08/8.59, SD = 1.29/1.56, t(98) = 1.69, p = .093, d = 0.34.
    effect_size:
      metric: SMD
      d: -0.34
      v: 0.041064569211
      computed_from: reported_d
      needs_review: false
      notes: Computed v from reported d + t(df) in analysis/effect_sizes.qmd; sign set from means using d = mean(low) - mean(high).
    quality_flags: []
    notes: null
  notes: null