Extraction report — Turri et al. 2016

Source: papers/turrietalndactionabilityjudgmentscause/turrietalndactionabilityjudgmentscause.yaml · Generated: 2026-02-10 13:35 UTC
2 studies2 effects

Paper

paper_idturrietalndactionabilityjudgmentscause
short_labelTurri et al. 2016
citationTurri, J., Buckwalter, W., & Rose, D. (2016). Actionability Judgments Cause Knowledge Judgments. Thought: A Journal of Philosophy, 5(3), 212–222.
doi10.1002/tht3.213
year2016
publishedYes
languageEnglish
language_other
research_objectiveTest whether actionability judgments cause knowledge judgments (or vice versa) using causal modeling across two experiments manipulating practical stakes.
data_available_online
data_url
notes

Experiment 1

study_id: 1

Study

study_id1
labelExperiment 1
objectiveTest the relationship between stakes, actionability judgments, and knowledge judgments in an intelligence-analyst vignette (Low vs High stakes; multiple dependent measures including knowledge).
designBetween-Subjects
design_other
manipulated_factors
paradigmAgreement with knowledge claim
paradigm_other
notes

Sample

n_final200
recruitmentmTurk
recruitment_other
compensationmoney
compensation_other$0.40 for approximately 2–3 minutes.
characteristicsAged 18–68 years (mean age = 31); 94% reported English as a native language; 80 females.
mean_age31
Provenance
page
table_ref
tei_id
Two hundred participants (aged 18-68 years, mean age = 31 years; 94% reporting English as a native language; 80 females) were tested. Participants were recruited and tested online using Amazon Mechanical Turk and Qualtrics and compensated $0.40 for approximately 2-3 minutes of their time.

Scale

labelLikert 7-point
points7
anchors"strongly disagree" … "strongly agree"
directionHigher numbers indicate stronger agreement with the statement.
Provenance
page
table_ref
tei_id
Responses were collected on a standard 7-point Likert scale anchored with "strongly disagree," "disagree," "somewhat disagree," "neutral," "somewhat agree," "agree," and "strongly agree," left-to-right on the participant's screen. Responses were coded 1 (strongly disagree) to 7 (strongly agree).

Measures

knowledge_question_textJennifer knows that Ivan no longer [jogs regularly/is a threat].
knowledge_question_first
additional_question_text

Scenarios

No scenarios recorded.

Effects

s1_e1 · Experiment 1 — Knowledge judgment · Between-Subjects · d=0.62 · v=0.021192068909

Effect

effect_ids1_e1
subgroupExperiment 1 — Knowledge judgment
subgroup_descAgreement with third-person knowledge attribution (Jennifer knows …)
designBetween-Subjects
design_other
quality_flags
notes

Effect Size

metricSMD
d0.62
v0.021192068909
computed_fromreported_d
needs_reviewfalse
notesd from Table 1; v computed from reported d + t(df) in analysis/effect_sizes.qmd (method=between_reported_d_t_df).

Moderators

scenarioother
skeptical_pressureNo
awarenessYes
evidenceExternal
attribution_personOther
evidence_reliability

Contrast

group_highhigh
group_lowlow
sign_conventiond = mean(low) - mean(high)
other_notes7-point agreement rating; higher = more agreement with knowledge statement.

Moderator Coding

moderatorvaluereasonevidence
scenariootherThe vignette is about an intelligence report on a foreign operative (not bank/peanuts/bridge/typos).
Provenance
page
table_ref
tei_id
Jennifer is an intelligence analyst developing a file on Ivan, an elusive foreign operative.
skeptical_pressureNoNo explicit doubt/counterconsideration is introduced; the protagonist receives testimony from a source.
Provenance
page
table_ref
tei_id
Jennifer has a source who tells her that Ivan stopped [his low-carb diet/selling arms to terrorists] and is no longer [jogging regularly/a threat].
awarenessYesThe stakes (serious consequences) are explicitly described in the scenario presented to participants.
Provenance
page
table_ref
tei_id
If Ivan still [jogs regularly/is a threat], there will be serious consequences.
evidenceExternalThe evidence basis is testimony from another person (a source), i.e., external evidence.
Provenance
page
table_ref
tei_id
Jennifer has a source who tells her that Ivan stopped [his low-carb diet/selling arms to terrorists] and is no longer [jogging regularly/a threat].
attribution_personOtherParticipants rate agreement with a third-person attribution ('Jennifer knows …'), not a self-ascription.
Provenance
page
table_ref
tei_id
Jennifer knows that Ivan no longer [jogs regularly/is a threat].
evidence_reliabilityThe source’s reliability is not specified/manipulated, so evidence_reliability is coded as null.
Provenance
page
table_ref
tei_id
Jennifer has a source who tells her that Ivan stopped [his low-carb diet/selling arms to terrorists] and is no longer [jogging regularly/a threat].

Groups

group_idlabelnmeansdseprovenance
lowLow stakes4.531.73
Provenance
page5
table_reftabula_stream_p5_t1.csv
tei_id
Knowledge,4.53 (1.73),3.49 (1.65),4.36,198.0,<.001,1.04,0.62,0.57 1.51
highHigh stakes3.491.65
Provenance
page5
table_reftabula_stream_p5_t1.csv
tei_id
Knowledge,4.53 (1.73),3.49 (1.65),4.36,198.0,<.001,1.04,0.62,0.57 1.51

Reported Test

testt
t4.36
f
chi2
z
df1198
df2
p
reported_d0.62
reported_r
notesIndependent samples t-test; table reports d.
Provenance
page5
table_reftabula_stream_p5_t1.csv
tei_id
Knowledge,4.53 (1.73),3.49 (1.65),4.36,198.0,<.001,1.04,0.62,0.57 1.51

Quality Flags

Experiment 2

study_id: 2

Study

study_id2
labelExperiment 2
objectiveReplicate the causal-modeling approach in a coffee-menu vignette with a Low vs High stakes manipulation; dependent measures include actionability and knowledge judgments.
designBetween-Subjects
design_other
manipulated_factors
paradigmAgreement with knowledge claim
paradigm_other
notes

Sample

n_final205
recruitmentmTurk
recruitment_other
compensationmoney
compensation_other
characteristicsAged 18–72 years (mean age = 32); 96% reported English as a native language; 101 females.
mean_age32
Provenance
page
table_ref
tei_id
Two hundred and five participants (aged 18-72 years, mean age = 32 years; 96% reporting English as a native language; 101 females) were tested.

Scale

labelLikert 7-point
points7
anchors"strongly disagree" … "strongly agree"
directionHigher numbers indicate stronger agreement with the statement.
Provenance
page
table_ref
tei_id
Responses were collected on a standard 7-point Likert scale anchored with "strongly disagree," "disagree," "somewhat disagree," "neutral," "somewhat agree," "agree," and "strongly agree," left-to-right on the participant's screen. Responses were coded 1 (strongly disagree) to 7 (strongly agree).

Measures

knowledge_question_textChristina knows that the coffee [is from northern Colombia/contains pine nuts].
knowledge_question_first
additional_question_text

Scenarios

No scenarios recorded.

Effects

s2_e1 · Experiment 2 — Knowledge judgment · Between-Subjects · d=-0.05 · v=0.017319177026

Effect

effect_ids2_e1
subgroupExperiment 2 — Knowledge judgment
subgroup_descAgreement with third-person knowledge attribution (Christina knows …)
designBetween-Subjects
design_other
quality_flags
notes

Effect Size

metricSMD
d-0.05
v0.017319177026
computed_fromreported_d
needs_reviewfalse
notesd from Table 2 (signed using mean_low-mean_high); v computed from reported d + t(df) in analysis/effect_sizes.qmd (method=between_reported_d_t_df).

Moderators

scenariopeanuts
skeptical_pressureNo
awarenessYes
evidenceFirst Person
attribution_personOther
evidence_reliability

Contrast

group_highhigh
group_lowlow
sign_conventiond = mean(low) - mean(high)
other_notes7-point agreement rating; higher = more agreement with knowledge statement.

Moderator Coding

moderatorvaluereasonevidence
scenariopeanutsThe vignette concerns whether food contains nuts (pine nuts), matching the peanuts/allergy scenario family.
Provenance
page
table_ref
tei_id
Christina knows that the coffee [is from northern Colombia/contains pine nuts].
skeptical_pressureNoNo explicit counterconsideration or doubt is introduced; the protagonist observes the relevant fact.
Provenance
page
table_ref
tei_idtab_2
Christina observes that the latest shipment of coffee [is from northern Colombia/contains trace amounts of pine nuts].
awarenessYesThe stakes (serious consequences) are explicitly described in the scenario presented to participants.
Provenance
page
table_ref
tei_id
If the coffee [is from northern Colombia/contains pine nuts], there could be serious consequences.
evidenceFirst PersonThe evidence is based on the protagonist’s own observation (first-person evidence).
Provenance
page
table_ref
tei_idtab_2
Christina observes that the latest shipment of coffee [is from northern Colombia/contains trace amounts of pine nuts].
attribution_personOtherParticipants rate agreement with a third-person attribution ('Christina knows …'), not a self-ascription.
Provenance
page
table_ref
tei_id
Christina knows that the coffee [is from northern Colombia/contains pine nuts].
evidence_reliabilityThe paper does not specify/manipulate source reliability, so evidence_reliability is coded as null.
Provenance
page
table_ref
tei_idtab_2
Christina observes that the latest shipment of coffee [is from northern Colombia/contains trace amounts of pine nuts].

Groups

group_idlabelnmeansdseprovenance
lowLow stakes6.131.11
Provenance
page7
table_reftabula_stream_p7_t2.csv
tei_id
Knowledge,6.13 (1.11),6.19 (1.13),−0.38,203.0,.702,−0.06,0.05,−0.37 0.25
highHigh stakes6.191.13
Provenance
page7
table_reftabula_stream_p7_t2.csv
tei_id
Knowledge,6.13 (1.11),6.19 (1.13),−0.38,203.0,.702,−0.06,0.05,−0.37 0.25

Reported Test

testt
t-0.38
f
chi2
z
df1203
df2
p0.702
reported_d0.05
reported_r
notesIndependent samples t-test; table reports |d|, so sign is inferred from group means (mean_low < mean_high).
Provenance
page7
table_reftabula_stream_p7_t2.csv
tei_id
Knowledge,6.13 (1.11),6.19 (1.13),−0.38,203.0,.702,−0.06,0.05,−0.37 0.25

Quality Flags

Raw YAML
schema_version: "1.1"

paper:
  paper_id: turrietalndactionabilityjudgmentscause
  citation: "Turri, J., Buckwalter, W., & Rose, D. (2016). Actionability Judgments Cause Knowledge Judgments. Thought: A Journal of Philosophy, 5(3), 212–222."
  short_label: "Turri et al. 2016"
  doi: "10.1002/tht3.213"
  published: "Yes"
  year: 2016
  language: "English"
  language_other: null
  research_objective: "Test whether actionability judgments cause knowledge judgments (or vice versa) using causal modeling across two experiments manipulating practical stakes."
  data_availability:
    data_available_online: null
    url: null
    notes: null
  notes: null

studies:
  - study_id: 1
    label: "Experiment 1"
    objective: "Test the relationship between stakes, actionability judgments, and knowledge judgments in an intelligence-analyst vignette (Low vs High stakes; multiple dependent measures including knowledge)."
    sample:
      n_final: 200
      recruitment: "mTurk"
      recruitment_other: null
      compensation: "money"
      compensation_other: "$0.40 for approximately 2–3 minutes."
      characteristics: "Aged 18–68 years (mean age = 31); 94% reported English as a native language; 80 females."
      mean_age: 31
      mean_age_prov:
        page: null
        quote: "Two hundred participants (aged 18-68 years, mean age = 31 years; 94% reporting English as a native language; 80 females) were tested."
        tei_id: null
        table_ref: null
      provenance:
        page: null
        quote: "Two hundred participants (aged 18-68 years, mean age = 31 years; 94% reporting English as a native language; 80 females) were tested. Participants were recruited and tested online using Amazon Mechanical Turk and Qualtrics and compensated $0.40 for approximately 2-3 minutes of their time."
        tei_id: null
        table_ref: null
    design: "Between-Subjects"
    design_other: null
    manipulated_factors: []
    paradigm: "Agreement with knowledge claim"
    paradigm_other: null
    scale:
      label: "Likert 7-point"
      points: 7
      anchors: "\"strongly disagree\" … \"strongly agree\""
      direction: "Higher numbers indicate stronger agreement with the statement."
      provenance:
        page: null
        quote: "Responses were collected on a standard 7-point Likert scale anchored with \"strongly disagree,\" \"disagree,\" \"somewhat disagree,\" \"neutral,\" \"somewhat agree,\" \"agree,\" and \"strongly agree,\" left-to-right on the participant's screen. Responses were coded 1 (strongly disagree) to 7 (strongly agree)."
        tei_id: null
        table_ref: null
    measures:
      knowledge_question_text: "Jennifer knows that Ivan no longer [jogs regularly/is a threat]."
      knowledge_question_first: null
      additional_question_text: null
    scenarios: []
    effects:
      - effect_id: s1_e1
        subgroup: "Experiment 1 — Knowledge judgment"
        subgroup_desc: "Agreement with third-person knowledge attribution (Jennifer knows …)"
        design: "Between-Subjects"
        design_other: null
        moderators:
          scenario: other
          skeptical_pressure: "No"
          awareness: "Yes"
          evidence: "External"
          attribution_person: "Other"
          evidence_reliability: null
        moderators_coding:
          scenario:
            provenance:
              page: null
              quote: "Jennifer is an intelligence analyst developing a file on Ivan, an elusive foreign operative."
              tei_id: null
              table_ref: null
            reason: "The vignette is about an intelligence report on a foreign operative (not bank/peanuts/bridge/typos)."
          skeptical_pressure:
            provenance:
              page: null
              quote: "Jennifer has a source who tells her that Ivan stopped [his low-carb diet/selling arms to terrorists] and is no longer [jogging regularly/a threat]."
              tei_id: null
              table_ref: null
            reason: "No explicit doubt/counterconsideration is introduced; the protagonist receives testimony from a source."
          awareness:
            provenance:
              page: null
              quote: "If Ivan still [jogs regularly/is a threat], there will be serious consequences."
              tei_id: null
              table_ref: null
            reason: "The stakes (serious consequences) are explicitly described in the scenario presented to participants."
          evidence:
            provenance:
              page: null
              quote: "Jennifer has a source who tells her that Ivan stopped [his low-carb diet/selling arms to terrorists] and is no longer [jogging regularly/a threat]."
              tei_id: null
              table_ref: null
            reason: "The evidence basis is testimony from another person (a source), i.e., external evidence."
          attribution_person:
            provenance:
              page: null
              quote: "Jennifer knows that Ivan no longer [jogs regularly/is a threat]."
              tei_id: null
              table_ref: null
            reason: "Participants rate agreement with a third-person attribution ('Jennifer knows …'), not a self-ascription."
          evidence_reliability:
            provenance:
              page: null
              quote: "Jennifer has a source who tells her that Ivan stopped [his low-carb diet/selling arms to terrorists] and is no longer [jogging regularly/a threat]."
              tei_id: null
              table_ref: null
            reason: "The source’s reliability is not specified/manipulated, so evidence_reliability is coded as null."
        contrast:
          group_high: high
          group_low: low
          sign_convention: "d = mean(low) - mean(high)"
          other_notes: "7-point agreement rating; higher = more agreement with knowledge statement."
        groups:
          - group_id: low
            label: "Low stakes"
            n: null
            mean: 4.53
            sd: 1.73
            se: null
            provenance:
              page: 5
              quote: "Knowledge,4.53 (1.73),3.49 (1.65),4.36,198.0,<.001,1.04,0.62,0.57 1.51"
              tei_id: null
              table_ref: "tabula_stream_p5_t1.csv"
          - group_id: high
            label: "High stakes"
            n: null
            mean: 3.49
            sd: 1.65
            se: null
            provenance:
              page: 5
              quote: "Knowledge,4.53 (1.73),3.49 (1.65),4.36,198.0,<.001,1.04,0.62,0.57 1.51"
              tei_id: null
              table_ref: "tabula_stream_p5_t1.csv"
        reported_test:
          test: "t"
          t: 4.36
          f: null
          chi2: null
          z: null
          df1: 198
          df2: null
          p: null
          reported_d: 0.62
          reported_r: null
          notes: "Independent samples t-test; table reports d."
          provenance:
            page: 5
            quote: "Knowledge,4.53 (1.73),3.49 (1.65),4.36,198.0,<.001,1.04,0.62,0.57 1.51"
            tei_id: null
            table_ref: "tabula_stream_p5_t1.csv"
        effect_size:
          metric: SMD
          d: 0.620000000000
          v: 0.021192068909
          computed_from: reported_d
          needs_review: false
          notes: "d from Table 1; v computed from reported d + t(df) in analysis/effect_sizes.qmd (method=between_reported_d_t_df)."
        quality_flags: []
        notes: null

  - study_id: 2
    label: "Experiment 2"
    objective: "Replicate the causal-modeling approach in a coffee-menu vignette with a Low vs High stakes manipulation; dependent measures include actionability and knowledge judgments."
    sample:
      n_final: 205
      recruitment: "mTurk"
      recruitment_other: null
      compensation: "money"
      compensation_other: null
      characteristics: "Aged 18–72 years (mean age = 32); 96% reported English as a native language; 101 females."
      mean_age: 32
      mean_age_prov:
        page: null
        quote: "Two hundred and five participants (aged 18-72 years, mean age = 32 years; 96% reporting English as a native language; 101 females) were tested."
        tei_id: null
        table_ref: null
      provenance:
        page: null
        quote: "Two hundred and five participants (aged 18-72 years, mean age = 32 years; 96% reporting English as a native language; 101 females) were tested."
        tei_id: null
        table_ref: null
    design: "Between-Subjects"
    design_other: null
    manipulated_factors: []
    paradigm: "Agreement with knowledge claim"
    paradigm_other: null
    scale:
      label: "Likert 7-point"
      points: 7
      anchors: "\"strongly disagree\" … \"strongly agree\""
      direction: "Higher numbers indicate stronger agreement with the statement."
      provenance:
        page: null
        quote: "Responses were collected on a standard 7-point Likert scale anchored with \"strongly disagree,\" \"disagree,\" \"somewhat disagree,\" \"neutral,\" \"somewhat agree,\" \"agree,\" and \"strongly agree,\" left-to-right on the participant's screen. Responses were coded 1 (strongly disagree) to 7 (strongly agree)."
        tei_id: null
        table_ref: null
    measures:
      knowledge_question_text: "Christina knows that the coffee [is from northern Colombia/contains pine nuts]."
      knowledge_question_first: null
      additional_question_text: null
    scenarios: []
    effects:
      - effect_id: s2_e1
        subgroup: "Experiment 2 — Knowledge judgment"
        subgroup_desc: "Agreement with third-person knowledge attribution (Christina knows …)"
        design: "Between-Subjects"
        design_other: null
        moderators:
          scenario: peanuts
          skeptical_pressure: "No"
          awareness: "Yes"
          evidence: "First Person"
          attribution_person: "Other"
          evidence_reliability: null
        moderators_coding:
          scenario:
            provenance:
              page: null
              quote: "Christina knows that the coffee [is from northern Colombia/contains pine nuts]."
              tei_id: null
              table_ref: null
            reason: "The vignette concerns whether food contains nuts (pine nuts), matching the peanuts/allergy scenario family."
          skeptical_pressure:
            provenance:
              page: null
              quote: "Christina observes that the latest shipment of coffee [is from northern Colombia/contains trace amounts of pine nuts]."
              tei_id: "tab_2"
              table_ref: null
            reason: "No explicit counterconsideration or doubt is introduced; the protagonist observes the relevant fact."
          awareness:
            provenance:
              page: null
              quote: "If the coffee [is from northern Colombia/contains pine nuts], there could be serious consequences."
              tei_id: null
              table_ref: null
            reason: "The stakes (serious consequences) are explicitly described in the scenario presented to participants."
          evidence:
            provenance:
              page: null
              quote: "Christina observes that the latest shipment of coffee [is from northern Colombia/contains trace amounts of pine nuts]."
              tei_id: "tab_2"
              table_ref: null
            reason: "The evidence is based on the protagonist’s own observation (first-person evidence)."
          attribution_person:
            provenance:
              page: null
              quote: "Christina knows that the coffee [is from northern Colombia/contains pine nuts]."
              tei_id: null
              table_ref: null
            reason: "Participants rate agreement with a third-person attribution ('Christina knows …'), not a self-ascription."
          evidence_reliability:
            provenance:
              page: null
              quote: "Christina observes that the latest shipment of coffee [is from northern Colombia/contains trace amounts of pine nuts]."
              tei_id: "tab_2"
              table_ref: null
            reason: "The paper does not specify/manipulate source reliability, so evidence_reliability is coded as null."
        contrast:
          group_high: high
          group_low: low
          sign_convention: "d = mean(low) - mean(high)"
          other_notes: "7-point agreement rating; higher = more agreement with knowledge statement."
        groups:
          - group_id: low
            label: "Low stakes"
            n: null
            mean: 6.13
            sd: 1.11
            se: null
            provenance:
              page: 7
              quote: "Knowledge,6.13 (1.11),6.19 (1.13),−0.38,203.0,.702,−0.06,0.05,−0.37 0.25"
              tei_id: null
              table_ref: "tabula_stream_p7_t2.csv"
          - group_id: high
            label: "High stakes"
            n: null
            mean: 6.19
            sd: 1.13
            se: null
            provenance:
              page: 7
              quote: "Knowledge,6.13 (1.11),6.19 (1.13),−0.38,203.0,.702,−0.06,0.05,−0.37 0.25"
              tei_id: null
              table_ref: "tabula_stream_p7_t2.csv"
        reported_test:
          test: "t"
          t: -0.38
          f: null
          chi2: null
          z: null
          df1: 203
          df2: null
          p: 0.702
          reported_d: 0.05
          reported_r: null
          notes: "Independent samples t-test; table reports |d|, so sign is inferred from group means (mean_low < mean_high)."
          provenance:
            page: 7
            quote: "Knowledge,6.13 (1.11),6.19 (1.13),−0.38,203.0,.702,−0.06,0.05,−0.37 0.25"
            tei_id: null
            table_ref: "tabula_stream_p7_t2.csv"
        effect_size:
          metric: SMD
          d: -0.050000000000
          v: 0.017319177026
          computed_from: reported_d
          needs_review: false
          notes: "d from Table 2 (signed using mean_low-mean_high); v computed from reported d + t(df) in analysis/effect_sizes.qmd (method=between_reported_d_t_df)."
        quality_flags: []
        notes: null