porteretalndpuzzleaboutknowledge
/data/papers/porteretalndpuzzleaboutknowledge/porteretalndpuzzleaboutknowledge.yamlschema_version: '1.2'
paper:
paper_id: porteretalndpuzzleaboutknowledge
citation: Porter, B., Barr, K., Bencherifa, A., et al. (2025). A puzzle about knowledge ascriptions. Noûs.
short_label: Porter et al. 2025
doi: 10.1111/nous.12515
published: 'Yes'
year: 2025
language: English
language_other: null
research_objective: Test cross-culturally whether stakes (high vs low) affect (a) knowledge ascriptions in an
evidence-fixed prompt and (b) evidence requirements for knowledge in an evidence-seeking prompt, and interpret
any divergence between the prompts as reflecting a tension between epistemic beliefs and epistemic practices.
data_availability:
data_available_online: 'Yes'
url: https://osf.io/tyge9/files/osfstorage
notes: Paper states that data and code are available at this OSF location.
notes: null
studies:
- study_id: 1
label: Cross-cultural dam study (15 site samples)
language: other
language_other: multiple site languages
objective: Test cross-culturally whether stakes affect evidence-fixed knowledge ascription and evidence-seeking
judgments in a dam vignette; site-level weak/strong evidence contrasts are extracted as effects.
sample:
n_final: 3516
recruitment: other
recruitment_other: Multi-site/cross-cultural sample; site-level recruitment is stored in each effect.sample
override.
compensation: null
compensation_other: Mixed or site-specific; site-level compensation is stored in each effect.sample override
when available.
characteristics: Multi-site sample across 15 site/language samples included in this extraction. The study-level
n_final is the sum of site-level passed-comprehension Ns; site-specific language, recruitment, compensation,
N, and demographic details are stored in each effect.sample override.
provenance:
page: 4
quote: 'Data was collected from convenience samples across 17 sites in 11 countries... Participants were randomly
and evenly assigned to one of four conditions, based on a 2 × 2 design (Evidence: weak vs. strong; Stakes:
low vs. high).'
table_ref: tabula_stream_p4_t1.csv
design: Between-Subjects
design_other: '2 (Evidence: weak vs strong) × 2 (Stakes: low vs high) between-subjects design within each site;
site/language is an effect-level sample descriptor, not a separate paper-reported study.'
manipulated_factors:
- 'Evidence: weak vs strong'
paradigm: Other
paradigm_other: 'Mixed DVs: evidence-fixed knowledge ascription (binary) and evidence-seeking checks-required
free response (numeric; coded).'
scale:
label: other
points: null
anchors: 'Evidence-fixed: binary choice (knows vs only thinks he knows); Evidence-seeking: numeric free response
(# checks).'
direction: 'Evidence-fixed: higher probability of selecting ''knows''; Evidence-seeking: higher numbers = more
checks required.'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows. Evidence-seeking:
How many times do you think [name] has to check the logs before he knows that the dam is secure?'
measures:
knowledge_question_text: 'Evidence-fixed: [name] ____________ that the dam is secure. (options: knows / only
thinks he knows)'
knowledge_question_first: null
additional_question_text: 'Evidence-seeking: How many times do you think [name] has to check the logs before
he knows that the dam is secure?'
scenarios:
- scenario_code: dam
scenario_type: Dam-on-river vignette; stakes (high vs low) and evidence (weak vs strong) manipulated.
high_stakes_text: "PAGE 3 and 5: full vignettes\r\n\r\nIt is very important that the dam is secure. Due to the\
\ high water level, if it breaks, his kids will be swept away by the water."
low_stakes_text: It is not at all important that the dam is secure. Due to the low water level, if it breaks,
the water won't even rise to knee level.
provenance:
page: 5
quote: 'High stakes: It is very important that the dam is secure. Due to the high water level, if it breaks,
his kids will be swept away by the water. Low stakes: It is not at all important that the dam is secure.
Due to the low water level, if it breaks, the water won''t even rise to knee level.'
effects:
- effect_id: s1_e1
site_id: 1
site_label: China (Mandarin)
language: other
language_other: Mandarin
sample:
n_final: 261
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: If you participate in this study, you will receive a payment of $1.00 (info in OSF materials),
but we do not know if it applied to all groups (probably not)
characteristics: 'Students and non-students; Age mean 22.75 (sd 5.53, range 18–52); Gender % M/F/other: 43.9/55.8/0.3;
Total N=416; Passed comprehension check N=261 (62.7%).'
mean_age: 22.75
mean_age_prov:
page: 4
quote: 'China: Age mean 22.75 (range 18–52; sd 5.53).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'China: N=416; Passed Check=261 (62.7%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: China (Mandarin) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist. The protagonist has
to be aware of the water levels.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: 'Reliability is manipulated: checked once'
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=9, low_no=29, high_yes=9,
high_no=79; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.552515367598915
v: 0.0818765974028145
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 38
mean: 0.236842105263158
sd: 0.430851484182746
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 88
mean: 0.102272727272727
sd: 0.304743069745636
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s1_e2
site_id: 1
site_label: China (Mandarin)
language: other
language_other: Mandarin
sample:
n_final: 261
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: If you participate in this study, you will receive a payment of $1.00 (info in OSF materials),
but we do not know if it applied to all groups (probably not)
characteristics: 'Students and non-students; Age mean 22.75 (sd 5.53, range 18–52); Gender % M/F/other: 43.9/55.8/0.3;
Total N=416; Passed comprehension check N=261 (62.7%).'
mean_age: 22.75
mean_age_prov:
page: 4
quote: 'China: Age mean 22.75 (range 18–52; sd 5.53).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'China: N=416; Passed Check=261 (62.7%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: China (Mandarin) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=7, low_no=37,
high_yes=23, high_no=68; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.320318931519335
v: 0.0693244543058392
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 44
mean: 0.159090909090909
sd: 0.369989429024468
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 91
mean: 0.252747252747253
sd: 0.436994955307943
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s1_e3
site_id: 1
site_label: China (Mandarin)
language: other
language_other: Mandarin
sample:
n_final: 261
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: If you participate in this study, you will receive a payment of $1.00 (info in OSF materials),
but we do not know if it applied to all groups (probably not)
characteristics: 'Students and non-students; Age mean 22.75 (sd 5.53, range 18–52); Gender % M/F/other: 43.9/55.8/0.3;
Total N=416; Passed comprehension check N=261 (62.7%).'
mean_age: 22.75
mean_age_prov:
page: 4
quote: 'China: Age mean 22.75 (range 18–52; sd 5.53).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'China: N=416; Passed Check=261 (62.7%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: China (Mandarin) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=31, n_high=57, mean_low=3.48387096774194,
mean_high=4.78947368421053, sd_low=2.46131357533514, sd_high=3.14947184974415.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.445926217287843
v: 0.0509317547974373
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 31
mean: 3.48387096774194
sd: 2.46131357533514
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 57
mean: 4.78947368421053
sd: 3.14947184974415
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s1_e4
site_id: 1
site_label: China (Mandarin)
language: other
language_other: Mandarin
sample:
n_final: 261
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: If you participate in this study, you will receive a payment of $1.00 (info in OSF materials),
but we do not know if it applied to all groups (probably not)
characteristics: 'Students and non-students; Age mean 22.75 (sd 5.53, range 18–52); Gender % M/F/other: 43.9/55.8/0.3;
Total N=416; Passed comprehension check N=261 (62.7%).'
mean_age: 22.75
mean_age_prov:
page: 4
quote: 'China: Age mean 22.75 (range 18–52; sd 5.53).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'China: N=416; Passed Check=261 (62.7%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: China (Mandarin) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=36, n_high=58, mean_low=4.61111111111111,
mean_high=4.72413793103448, sd_low=4.7285018937006, sd_high=5.01154142848417.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.0230394819994714
v: 0.0450219805866907
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 36
mean: 4.61111111111111
sd: 4.7285018937006
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 58
mean: 4.72413793103448
sd: 5.01154142848417
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s2_e1
site_id: 2
site_label: Russia (Russian)
language: other
language_other: Russian
sample:
n_final: 558
recruitment: other
recruitment_other: Convenience sample (non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 25.97 (sd 10.28, range 18–75); Gender % M/F/other: 40/60/0;
Total N=739; Passed comprehension check N=558 (75.5%).'
mean_age: 25.97
mean_age_prov:
page: 4
quote: 'Russia: Age mean 25.97 (range 18–75; sd 10.28).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Russia: N=739; Passed Check=558 (75.5%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Russia (Russian) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=32, low_no=72, high_yes=52,
high_no=125; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.0364647842582463
v: 0.0219977382614252
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 104
mean: 0.307692307692308
sd: 0.463773527692987
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 177
mean: 0.293785310734463
sd: 0.456786974431487
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s2_e2
site_id: 2
site_label: Russia (Russian)
language: other
language_other: Russian
sample:
n_final: 558
recruitment: other
recruitment_other: Convenience sample (non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 25.97 (sd 10.28, range 18–75); Gender % M/F/other: 40/60/0;
Total N=739; Passed comprehension check N=558 (75.5%).'
mean_age: 25.97
mean_age_prov:
page: 4
quote: 'Russia: Age mean 25.97 (range 18–75; sd 10.28).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Russia: N=739; Passed Check=558 (75.5%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Russia (Russian) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=48, low_no=70,
high_yes=49, high_no=110; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.237824450182473
v: 0.0196415532019087
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 118
mean: 0.406779661016949
sd: 0.493327930247495
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 159
mean: 0.308176100628931
sd: 0.463198641460142
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s2_e3
site_id: 2
site_label: Russia (Russian)
language: other
language_other: Russian
sample:
n_final: 558
recruitment: other
recruitment_other: Convenience sample (non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 25.97 (sd 10.28, range 18–75); Gender % M/F/other: 40/60/0;
Total N=739; Passed comprehension check N=558 (75.5%).'
mean_age: 25.97
mean_age_prov:
page: 4
quote: 'Russia: Age mean 25.97 (range 18–75; sd 10.28).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Russia: N=739; Passed Check=558 (75.5%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Russia (Russian) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=103, n_high=167, mean_low=2.1747572815534,
mean_high=8.18562874251497, sd_low=2.63247883057991, sd_high=20.1014363673349.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.37796129506215
v: 0.0159613076320347
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 103
mean: 2.1747572815534
sd: 2.63247883057991
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 167
mean: 8.18562874251497
sd: 20.1014363673349
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s2_e4
site_id: 2
site_label: Russia (Russian)
language: other
language_other: Russian
sample:
n_final: 558
recruitment: other
recruitment_other: Convenience sample (non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 25.97 (sd 10.28, range 18–75); Gender % M/F/other: 40/60/0;
Total N=739; Passed comprehension check N=558 (75.5%).'
mean_age: 25.97
mean_age_prov:
page: 4
quote: 'Russia: Age mean 25.97 (range 18–75; sd 10.28).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Russia: N=739; Passed Check=558 (75.5%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Russia (Russian) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=115, n_high=145, mean_low=4.4695652173913,
mean_high=10.5655172413793, sd_low=9.84914435604169, sd_high=22.6868212457706.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.335503596949632
v: 0.0158086705587551
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 115
mean: 4.4695652173913
sd: 9.84914435604169
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 145
mean: 10.5655172413793
sd: 22.6868212457706
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s3_e1
site_id: 3
site_label: Slovakia (Slovak)
language: other
language_other: Slovak
sample:
n_final: 290
recruitment: other
recruitment_other: Convenience sample (students and non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: both; Age mean 26.28 (sd 9.07, range 18–74); Gender % M/F/other: 54.4/44.9/0.7;
Total N=713; Passed comprehension check N=290 (40.7%).'
mean_age: 26.28
mean_age_prov:
page: 4
quote: 'Slovakia: Age mean 26.28 (range 18–74; sd 9.07).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Slovakia: N=713; Passed Check=290 (40.7%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Slovakia (Slovak) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=19, low_no=24, high_yes=19,
high_no=79; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.656849950227036
v: 0.0485089510959194
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 43
mean: 0.441860465116279
sd: 0.502485516559592
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 98
mean: 0.193877551020408
sd: 0.397366673881274
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s3_e2
site_id: 3
site_label: Slovakia (Slovak)
language: other
language_other: Slovak
sample:
n_final: 290
recruitment: other
recruitment_other: Convenience sample (students and non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: both; Age mean 26.28 (sd 9.07, range 18–74); Gender % M/F/other: 54.4/44.9/0.7;
Total N=713; Passed comprehension check N=290 (40.7%).'
mean_age: 26.28
mean_age_prov:
page: 4
quote: 'Slovakia: Age mean 26.28 (range 18–74; sd 9.07).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Slovakia: N=713; Passed Check=290 (40.7%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Slovakia (Slovak) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=26, low_no=22,
high_yes=32, high_no=69; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.515726659136653
v: 0.039411560667506
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 48
mean: 0.541666666666667
sd: 0.503533612870859
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 101
mean: 0.316831683168317
sd: 0.467561612395777
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s3_e3
site_id: 3
site_label: Slovakia (Slovak)
language: other
language_other: Slovak
sample:
n_final: 290
recruitment: other
recruitment_other: Convenience sample (students and non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: both; Age mean 26.28 (sd 9.07, range 18–74); Gender % M/F/other: 54.4/44.9/0.7;
Total N=713; Passed comprehension check N=290 (40.7%).'
mean_age: 26.28
mean_age_prov:
page: 4
quote: 'Slovakia: Age mean 26.28 (range 18–74; sd 9.07).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Slovakia: N=713; Passed Check=290 (40.7%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Slovakia (Slovak) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=35, n_high=85, mean_low=3.57142857142857,
mean_high=11.5411764705882, sd_low=11.070059552116, sd_high=22.8663575613443.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.394792312363619
v: 0.0409855551617041
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 35
mean: 3.57142857142857
sd: 11.070059552116
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 85
mean: 11.5411764705882
sd: 22.8663575613443
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s3_e4
site_id: 3
site_label: Slovakia (Slovak)
language: other
language_other: Slovak
sample:
n_final: 290
recruitment: other
recruitment_other: Convenience sample (students and non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: both; Age mean 26.28 (sd 9.07, range 18–74); Gender % M/F/other: 54.4/44.9/0.7;
Total N=713; Passed comprehension check N=290 (40.7%).'
mean_age: 26.28
mean_age_prov:
page: 4
quote: 'Slovakia: Age mean 26.28 (range 18–74; sd 9.07).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Slovakia: N=713; Passed Check=290 (40.7%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Slovakia (Slovak) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=41, n_high=82, mean_low=2.46341463414634,
mean_high=11.7317073170732, sd_low=2.48090266813926, sd_high=25.379611132691.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.445289756137204
v: 0.0373913941744745
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 41
mean: 2.46341463414634
sd: 2.48090266813926
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 82
mean: 11.7317073170732
sd: 25.379611132691
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s4_e1
site_id: 4
site_label: Ecuador (Spanish)
language: other
language_other: Spanish
sample:
n_final: 208
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: students; Age mean 21.39 (sd 3.21, range 18–42); Gender % M/F/other: 32.9/66.7/0.5;
Total N=390; Passed comprehension check N=208 (53.3%).'
mean_age: 21.39
mean_age_prov:
page: 4
quote: 'Ecuador: Age mean 21.39 (range 18–42; sd 3.21).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Ecuador: N=390; Passed Check=208 (53.3%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Ecuador (Spanish) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=8, low_no=30, high_yes=21,
high_no=41; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.359855794346364
v: 0.07001576218072
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 38
mean: 0.210526315789474
sd: 0.413154950112274
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 62
mean: 0.338709677419355
sd: 0.477134492745083
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s4_e2
site_id: 4
site_label: Ecuador (Spanish)
language: other
language_other: Spanish
sample:
n_final: 208
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: students; Age mean 21.39 (sd 3.21, range 18–42); Gender % M/F/other: 32.9/66.7/0.5;
Total N=390; Passed comprehension check N=208 (53.3%).'
mean_age: 21.39
mean_age_prov:
page: 4
quote: 'Ecuador: Age mean 21.39 (range 18–42; sd 3.21).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Ecuador: N=390; Passed Check=208 (53.3%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Ecuador (Spanish) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=18, low_no=24,
high_yes=23, high_no=43; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.18636230333852
v: 0.0498367382467262
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 42
mean: 0.428571428571429
sd: 0.500870322677809
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 66
mean: 0.348484848484849
sd: 0.480141781702166
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s4_e3
site_id: 4
site_label: Ecuador (Spanish)
language: other
language_other: Spanish
sample:
n_final: 208
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: students; Age mean 21.39 (sd 3.21, range 18–42); Gender % M/F/other: 32.9/66.7/0.5;
Total N=390; Passed comprehension check N=208 (53.3%).'
mean_age: 21.39
mean_age_prov:
page: 4
quote: 'Ecuador: Age mean 21.39 (range 18–42; sd 3.21).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Ecuador: N=390; Passed Check=208 (53.3%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Ecuador (Spanish) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=38, n_high=53, mean_low=2.71052631578947,
mean_high=6.20754716981132, sd_low=2.3122224565292, sd_high=13.4455575885838.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.336736969823536
v: 0.0458067457978429
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 38
mean: 2.71052631578947
sd: 2.3122224565292
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 53
mean: 6.20754716981132
sd: 13.4455575885838
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s4_e4
site_id: 4
site_label: Ecuador (Spanish)
language: other
language_other: Spanish
sample:
n_final: 208
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: students; Age mean 21.39 (sd 3.21, range 18–42); Gender % M/F/other: 32.9/66.7/0.5;
Total N=390; Passed comprehension check N=208 (53.3%).'
mean_age: 21.39
mean_age_prov:
page: 4
quote: 'Ecuador: Age mean 21.39 (range 18–42; sd 3.21).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Ecuador: N=390; Passed Check=208 (53.3%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Ecuador (Spanish) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=36, n_high=45, mean_low=3.05555555555556,
mean_high=9.97777777777778, sd_low=2.56286050503221, sd_high=19.8705914366031.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.463732339101942
v: 0.0513274548291911
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 36
mean: 3.05555555555556
sd: 2.56286050503221
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 45
mean: 9.97777777777778
sd: 19.8705914366031
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s5_e1
site_id: 5
site_label: India (Hindi)
language: other
language_other: Hindi
sample:
n_final: 100
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: both; Age mean 29.98 (sd 10.23, range 18–62); Gender % M/F/other: 45.3/53.8/0.9;
Total N=200; Passed comprehension check N=100 (50%).'
mean_age: 29.98
mean_age_prov:
page: 4
quote: 'India (Hindi): Age mean 29.98 (range 18–62; sd 10.23).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'India (Hindi): N=200; Passed Check=100 (50%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: India (Hindi) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=4, low_no=6, high_yes=16,
high_no=24; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.0
v: 0.158314349441153
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 10
mean: 0.4
sd: 0.516397779494322
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 40
mean: 0.4
sd: 0.496138938356834
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s5_e2
site_id: 5
site_label: India (Hindi)
language: other
language_other: Hindi
sample:
n_final: 100
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: both; Age mean 29.98 (sd 10.23, range 18–62); Gender % M/F/other: 45.3/53.8/0.9;
Total N=200; Passed comprehension check N=100 (50%).'
mean_age: 29.98
mean_age_prov:
page: 4
quote: 'India (Hindi): Age mean 29.98 (range 18–62; sd 10.23).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'India (Hindi): N=200; Passed Check=100 (50%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: India (Hindi) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=7, low_no=5, high_yes=17,
high_no=21; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.302007675760594
v: 0.136570738287655
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 12
mean: 0.583333333333333
sd: 0.514928650544437
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 38
mean: 0.447368421052632
sd: 0.503896622873567
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s5_e3
site_id: 5
site_label: India (Hindi)
language: other
language_other: Hindi
sample:
n_final: 100
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: both; Age mean 29.98 (sd 10.23, range 18–62); Gender % M/F/other: 45.3/53.8/0.9;
Total N=200; Passed comprehension check N=100 (50%).'
mean_age: 29.98
mean_age_prov:
page: 4
quote: 'India (Hindi): Age mean 29.98 (range 18–62; sd 10.23).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'India (Hindi): N=200; Passed Check=100 (50%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: India (Hindi) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=10, n_high=34, mean_low=2.6, mean_high=4.97058823529412,
sd_low=2.98886823619465, sd_high=2.77963692983015.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.838915625663936
v: 0.137409258194327
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 10
mean: 2.6
sd: 2.98886823619465
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 34
mean: 4.97058823529412
sd: 2.77963692983015
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s5_e4
site_id: 5
site_label: India (Hindi)
language: other
language_other: Hindi
sample:
n_final: 100
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: both; Age mean 29.98 (sd 10.23, range 18–62); Gender % M/F/other: 45.3/53.8/0.9;
Total N=200; Passed comprehension check N=100 (50%).'
mean_age: 29.98
mean_age_prov:
page: 4
quote: 'India (Hindi): Age mean 29.98 (range 18–62; sd 10.23).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'India (Hindi): N=200; Passed Check=100 (50%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: India (Hindi) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=12, n_high=28, mean_low=3.08333333333333,
mean_high=7.28571428571429, sd_low=3.50216383328243, sd_high=3.25300024316178.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -1.26309671009282
v: 0.13899028528571
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 12
mean: 3.08333333333333
sd: 3.50216383328243
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 28
mean: 7.28571428571429
sd: 3.25300024316178
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s6_e1
site_id: 6
site_label: India (Meitei)
language: other
language_other: Meitei
sample:
n_final: 42
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 23.26 (sd 6.26, range 18–45); Gender % M/F/other: 47.6/50/2.4;
Total N=86; Passed comprehension check N=42 (48.8%).'
mean_age: 23.26
mean_age_prov:
page: 4
quote: 'India (Meitei): Age mean 23.26 (range 18–45; sd 6.26).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'India (Meitei): N=86; Passed Check=42 (48.8%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: India (Meitei) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=0, low_no=0, high_yes=17,
high_no=3; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: null
v: null
computed_from: groups
needs_review: true
notes: Missing one stakes group in this evidence stratum.
quality_flags:
- insufficient_data_for_split_effect
notes: null
groups:
- group_id: low_stakes
label: null
n: 0
mean: null
sd: null
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 20
mean: 0.85
sd: 0.366347548532523
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s6_e2
site_id: 6
site_label: India (Meitei)
language: other
language_other: Meitei
sample:
n_final: 42
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 23.26 (sd 6.26, range 18–45); Gender % M/F/other: 47.6/50/2.4;
Total N=86; Passed comprehension check N=42 (48.8%).'
mean_age: 23.26
mean_age_prov:
page: 4
quote: 'India (Meitei): Age mean 23.26 (range 18–45; sd 6.26).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'India (Meitei): N=86; Passed Check=42 (48.8%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: India (Meitei) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=1, low_no=1, high_yes=14,
high_no=6; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.467139793460525
v: 0.680299375884268
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 2
mean: 0.5
sd: 0.707106781186548
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 20
mean: 0.7
sd: 0.470162345981627
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s6_e3
site_id: 6
site_label: India (Meitei)
language: other
language_other: Meitei
sample:
n_final: 42
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 23.26 (sd 6.26, range 18–45); Gender % M/F/other: 47.6/50/2.4;
Total N=86; Passed comprehension check N=42 (48.8%).'
mean_age: 23.26
mean_age_prov:
page: 4
quote: 'India (Meitei): Age mean 23.26 (range 18–45; sd 6.26).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'India (Meitei): N=86; Passed Check=42 (48.8%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: India (Meitei) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=0, n_high=18, mean_low=None, mean_high=7.61111111111111,
sd_low=None, sd_high=3.1462188115987.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: null
v: null
computed_from: groups
needs_review: true
notes: Insufficient per-group data for esc_mean_sd (need n>=2 and finite SD in both stakes groups).
quality_flags:
- insufficient_data_for_split_effect
notes: null
groups:
- group_id: low_stakes
label: null
n: 0
mean: null
sd: null
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 18
mean: 7.61111111111111
sd: 3.1462188115987
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s6_e4
site_id: 6
site_label: India (Meitei)
language: other
language_other: Meitei
sample:
n_final: 42
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 23.26 (sd 6.26, range 18–45); Gender % M/F/other: 47.6/50/2.4;
Total N=86; Passed comprehension check N=42 (48.8%).'
mean_age: 23.26
mean_age_prov:
page: 4
quote: 'India (Meitei): Age mean 23.26 (range 18–45; sd 6.26).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'India (Meitei): N=86; Passed Check=42 (48.8%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: India (Meitei) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=2, n_high=17, mean_low=5.0,
mean_high=7.70588235294118, sd_low=0.0, sd_high=3.78755702733228.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.736400711009846
v: 0.573094213811128
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 2
mean: 5.0
sd: 0.0
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 17
mean: 7.70588235294118
sd: 3.78755702733228
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s7_e1
site_id: 7
site_label: Japan (Japanese)
language: other
language_other: Japanese
sample:
n_final: 445
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 30.31 (sd 10.76, range 19–62); Gender % M/F/other: 53.3/46.3/0.4;
Total N=544; Passed comprehension check N=445 (81.8%).'
mean_age: 30.31
mean_age_prov:
page: 4
quote: 'Japan: Age mean 30.31 (range 19–62; sd 10.76).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Japan: N=544; Passed Check=445 (81.8%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Japan (Japanese) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=18, low_no=78, high_yes=16,
high_no=116; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.283749355205253
v: 0.0424019299139823
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 96
mean: 0.1875
sd: 0.392361272835448
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 132
mean: 0.121212121212121
sd: 0.327616957271215
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s7_e2
site_id: 7
site_label: Japan (Japanese)
language: other
language_other: Japanese
sample:
n_final: 445
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 30.31 (sd 10.76, range 19–62); Gender % M/F/other: 53.3/46.3/0.4;
Total N=544; Passed comprehension check N=445 (81.8%).'
mean_age: 30.31
mean_age_prov:
page: 4
quote: 'Japan: Age mean 30.31 (range 19–62; sd 10.76).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Japan: N=544; Passed Check=445 (81.8%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Japan (Japanese) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=27, low_no=58,
high_yes=25, high_no=107; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.380056845671382
v: 0.0314979830585107
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 85
mean: 0.317647058823529
sd: 0.468324386608723
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 132
mean: 0.189393939393939
sd: 0.393313886219085
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s7_e3
site_id: 7
site_label: Japan (Japanese)
language: other
language_other: Japanese
sample:
n_final: 445
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 30.31 (sd 10.76, range 19–62); Gender % M/F/other: 53.3/46.3/0.4;
Total N=544; Passed comprehension check N=445 (81.8%).'
mean_age: 30.31
mean_age_prov:
page: 4
quote: 'Japan: Age mean 30.31 (range 19–62; sd 10.76).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Japan: N=544; Passed Check=445 (81.8%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Japan (Japanese) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=88, n_high=110, mean_low=4.29545454545455,
mean_high=9.49090909090909, sd_low=12.1675648456777, sd_high=20.3581444399418.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.301876109494476
v: 0.0206846696603119
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 88
mean: 4.29545454545455
sd: 12.1675648456777
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 110
mean: 9.49090909090909
sd: 20.3581444399418
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s7_e4
site_id: 7
site_label: Japan (Japanese)
language: other
language_other: Japanese
sample:
n_final: 445
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 30.31 (sd 10.76, range 19–62); Gender % M/F/other: 53.3/46.3/0.4;
Total N=544; Passed comprehension check N=445 (81.8%).'
mean_age: 30.31
mean_age_prov:
page: 4
quote: 'Japan: Age mean 30.31 (range 19–62; sd 10.76).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Japan: N=544; Passed Check=445 (81.8%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Japan (Japanese) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=71, n_high=111, mean_low=8.16901408450704,
mean_high=17.5585585585586, sd_low=19.6301414851847, sd_high=29.6091769203968.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.358594182611733
v: 0.0234467846990729
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 71
mean: 8.16901408450704
sd: 19.6301414851847
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 111
mean: 17.5585585585586
sd: 29.6091769203968
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s8_e1
site_id: 8
site_label: Morocco (Arabic)
language: other
language_other: Arabic
sample:
n_final: 323
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 32.96 (sd 11.81, range 18–76); Gender % M/F/other: 44.4/55.6/0;
Total N=551; Passed comprehension check N=323 (58.6%).'
mean_age: 32.96
mean_age_prov:
page: 4
quote: 'Morocco: Age mean 32.96 (range 18–76; sd 11.81).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Morocco: N=551; Passed Check=323 (58.6%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Morocco (Arabic) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=25, low_no=17, high_yes=41,
high_no=76; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.552885712812783
v: 0.0414520164666358
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 42
mean: 0.595238095238095
sd: 0.496795772414547
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 117
mean: 0.35042735042735
sd: 0.479155854642943
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s8_e2
site_id: 8
site_label: Morocco (Arabic)
language: other
language_other: Arabic
sample:
n_final: 323
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 32.96 (sd 11.81, range 18–76); Gender % M/F/other: 44.4/55.6/0;
Total N=551; Passed comprehension check N=323 (58.6%).'
mean_age: 32.96
mean_age_prov:
page: 4
quote: 'Morocco: Age mean 32.96 (range 18–76; sd 11.81).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Morocco: N=551; Passed Check=323 (58.6%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Morocco (Arabic) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=14, low_no=35,
high_yes=48, high_no=67; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.321313996951993
v: 0.0412656984871685
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 49
mean: 0.285714285714286
sd: 0.456435464587638
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 115
mean: 0.417391304347826
sd: 0.495286709376626
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s8_e3
site_id: 8
site_label: Morocco (Arabic)
language: other
language_other: Arabic
sample:
n_final: 323
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 32.96 (sd 11.81, range 18–76); Gender % M/F/other: 44.4/55.6/0;
Total N=551; Passed comprehension check N=323 (58.6%).'
mean_age: 32.96
mean_age_prov:
page: 4
quote: 'Morocco: Age mean 32.96 (range 18–76; sd 11.81).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Morocco: N=551; Passed Check=323 (58.6%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Morocco (Arabic) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=41, n_high=108, mean_low=1.58536585365854,
mean_high=3.5, sd_low=1.9745329796701, sd_high=2.75985913225776.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.744981969167287
v: 0.0355119130086257
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 41
mean: 1.58536585365854
sd: 1.9745329796701
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 108
mean: 3.5
sd: 2.75985913225776
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s8_e4
site_id: 8
site_label: Morocco (Arabic)
language: other
language_other: Arabic
sample:
n_final: 323
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 32.96 (sd 11.81, range 18–76); Gender % M/F/other: 44.4/55.6/0;
Total N=551; Passed comprehension check N=323 (58.6%).'
mean_age: 32.96
mean_age_prov:
page: 4
quote: 'Morocco: Age mean 32.96 (range 18–76; sd 11.81).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Morocco: N=551; Passed Check=323 (58.6%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Morocco (Arabic) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=47, n_high=105, mean_low=5.17021276595745,
mean_high=7.96190476190476, sd_low=4.41006333847925, sd_high=13.3113050633979.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.245969711197567
v: 0.0309994220409463
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 47
mean: 5.17021276595745
sd: 4.41006333847925
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 105
mean: 7.96190476190476
sd: 13.3113050633979
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s9_e1
site_id: 9
site_label: Peru (Shipibo)
language: other
language_other: Shipibo
sample:
n_final: 102
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 34.68 (sd 13.77, range 18–83); Gender % M/F/other: 53.9/46.1/0;
Total N=200; Passed comprehension check N=102 (51%).'
mean_age: 34.68
mean_age_prov:
page: 4
quote: 'Peru (Shipibo): Age mean 34.68 (range 18–83; sd 13.77).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Peru (Shipibo): N=200; Passed Check=102 (51%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Peru (Shipibo) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=4, low_no=4, high_yes=36,
high_no=7; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.902861044993359
v: 0.203848571851846
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 8
mean: 0.5
sd: 0.534522483824849
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 43
mean: 0.837209302325581
sd: 0.373543683818814
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s9_e2
site_id: 9
site_label: Peru (Shipibo)
language: other
language_other: Shipibo
sample:
n_final: 102
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 34.68 (sd 13.77, range 18–83); Gender % M/F/other: 53.9/46.1/0;
Total N=200; Passed comprehension check N=102 (51%).'
mean_age: 34.68
mean_age_prov:
page: 4
quote: 'Peru (Shipibo): Age mean 34.68 (range 18–83; sd 13.77).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Peru (Shipibo): N=200; Passed Check=102 (51%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Peru (Shipibo) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=0, low_no=5, high_yes=37,
high_no=9; 0.5 continuity correction applied.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -2.07903061470105
v: 0.703295059969437
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 with 0.5 continuity correction.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 5
mean: 0.0
sd: 0.0
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 46
mean: 0.804347826086957
sd: 0.40108548367822
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s9_e3
site_id: 9
site_label: Peru (Shipibo)
language: other
language_other: Shipibo
sample:
n_final: 102
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 34.68 (sd 13.77, range 18–83); Gender % M/F/other: 53.9/46.1/0;
Total N=200; Passed comprehension check N=102 (51%).'
mean_age: 34.68
mean_age_prov:
page: 4
quote: 'Peru (Shipibo): Age mean 34.68 (range 18–83; sd 13.77).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Peru (Shipibo): N=200; Passed Check=102 (51%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Peru (Shipibo) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=0, n_high=1, mean_low=None, mean_high=5.0,
sd_low=None, sd_high=None.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: null
v: null
computed_from: groups
needs_review: true
notes: Insufficient per-group data for esc_mean_sd (need n>=2 and finite SD in both stakes groups).
quality_flags:
- insufficient_data_for_split_effect
notes: null
groups:
- group_id: low_stakes
label: null
n: 0
mean: null
sd: null
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 1
mean: 5.0
sd: null
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s9_e4
site_id: 9
site_label: Peru (Shipibo)
language: other
language_other: Shipibo
sample:
n_final: 102
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 34.68 (sd 13.77, range 18–83); Gender % M/F/other: 53.9/46.1/0;
Total N=200; Passed comprehension check N=102 (51%).'
mean_age: 34.68
mean_age_prov:
page: 4
quote: 'Peru (Shipibo): Age mean 34.68 (range 18–83; sd 13.77).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Peru (Shipibo): N=200; Passed Check=102 (51%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Peru (Shipibo) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=0, n_high=2, mean_low=None,
mean_high=4.5, sd_low=None, sd_high=0.707106781186548.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: null
v: null
computed_from: groups
needs_review: true
notes: Insufficient per-group data for esc_mean_sd (need n>=2 and finite SD in both stakes groups).
quality_flags:
- insufficient_data_for_split_effect
notes: null
groups:
- group_id: low_stakes
label: null
n: 0
mean: null
sd: null
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 2
mean: 4.5
sd: 0.707106781186548
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s10_e1
site_id: 10
site_label: Peru (Spanish)
language: other
language_other: Spanish
sample:
n_final: 216
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: students; Age mean 22.75 (sd 3.28, range 18–49); Gender % M/F/other: 43.1/56.9/0;
Total N=286; Passed comprehension check N=216 (75.5%).'
mean_age: 22.75
mean_age_prov:
page: 4
quote: 'Peru (Spanish): Age mean 22.75 (range 18–49; sd 3.28).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Peru (Spanish): N=286; Passed Check=216 (75.5%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Peru (Spanish) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked only once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=13, low_no=28, high_yes=17,
high_no=51; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.182686763755891
v: 0.0580779312183859
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 41
mean: 0.317073170731707
sd: 0.471116991321896
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 68
mean: 0.25
sd: 0.436232171512701
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s10_e2
site_id: 10
site_label: Peru (Spanish)
language: other
language_other: Spanish
sample:
n_final: 216
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: students; Age mean 22.75 (sd 3.28, range 18–49); Gender % M/F/other: 43.1/56.9/0;
Total N=286; Passed comprehension check N=216 (75.5%).'
mean_age: 22.75
mean_age_prov:
page: 4
quote: 'Peru (Spanish): Age mean 22.75 (range 18–49; sd 3.28).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Peru (Spanish): N=286; Passed Check=216 (75.5%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Peru (Spanish) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=9, low_no=30,
high_yes=15, high_no=53; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.0321253327534255
v: 0.0699052443117261
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 39
mean: 0.230769230769231
sd: 0.426832794918354
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 68
mean: 0.220588235294118
sd: 0.417726191664839
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s10_e3
site_id: 10
site_label: Peru (Spanish)
language: other
language_other: Spanish
sample:
n_final: 216
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: students; Age mean 22.75 (sd 3.28, range 18–49); Gender % M/F/other: 43.1/56.9/0;
Total N=286; Passed comprehension check N=216 (75.5%).'
mean_age: 22.75
mean_age_prov:
page: 4
quote: 'Peru (Spanish): Age mean 22.75 (range 18–49; sd 3.28).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Peru (Spanish): N=286; Passed Check=216 (75.5%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Peru (Spanish) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=27, n_high=35, mean_low=2.22222222222222,
mean_high=3.77142857142857, sd_low=1.08604197869474, sd_high=2.00126010723412.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.929046137166019
v: 0.0725691650034906
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 27
mean: 2.22222222222222
sd: 1.08604197869474
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 35
mean: 3.77142857142857
sd: 2.00126010723412
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s10_e4
site_id: 10
site_label: Peru (Spanish)
language: other
language_other: Spanish
sample:
n_final: 216
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: students; Age mean 22.75 (sd 3.28, range 18–49); Gender % M/F/other: 43.1/56.9/0;
Total N=286; Passed comprehension check N=216 (75.5%).'
mean_age: 22.75
mean_age_prov:
page: 4
quote: 'Peru (Spanish): Age mean 22.75 (range 18–49; sd 3.28).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'Peru (Spanish): N=286; Passed Check=216 (75.5%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: Peru (Spanish) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=23, n_high=41, mean_low=7.08695652173913,
mean_high=6.68292682926829, sd_low=20.293109093479, sd_high=15.2846966348538.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.0234501004569504
v: 0.0678728009220936
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 23
mean: 7.08695652173913
sd: 20.293109093479
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 41
mean: 6.68292682926829
sd: 15.2846966348538
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s11_e1
site_id: 11
site_label: South Africa (Afrikaans)
language: other
language_other: Afrikaans
sample:
n_final: 178
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 41.63 (sd 12.85, range 18–73); Gender % M/F/other: 34.3/65.7/0;
Total N=270; Passed comprehension check N=178 (65.9%).'
mean_age: 41.63
mean_age_prov:
page: 4
quote: 'South Africa (Afrikaans): Age mean 41.63 (range 18–73; sd 12.85).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Africa (Afrikaans): N=270; Passed Check=178 (65.9%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Africa (Afrikaans) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=15, low_no=10, high_yes=30,
high_no=31; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.241622606983428
v: 0.0705979860217579
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 25
mean: 0.6
sd: 0.5
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 61
mean: 0.491803278688525
sd: 0.504081700377764
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s11_e2
site_id: 11
site_label: South Africa (Afrikaans)
language: other
language_other: Afrikaans
sample:
n_final: 178
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 41.63 (sd 12.85, range 18–73); Gender % M/F/other: 34.3/65.7/0;
Total N=270; Passed comprehension check N=178 (65.9%).'
mean_age: 41.63
mean_age_prov:
page: 4
quote: 'South Africa (Afrikaans): Age mean 41.63 (range 18–73; sd 12.85).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Africa (Afrikaans): N=270; Passed Check=178 (65.9%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Africa (Afrikaans) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=11, low_no=9,
high_yes=42, high_no=30; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.0748713136838026
v: 0.0787761237323111
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 20
mean: 0.55
sd: 0.51041778553404
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 72
mean: 0.583333333333333
sd: 0.496466386817312
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s11_e3
site_id: 11
site_label: South Africa (Afrikaans)
language: other
language_other: Afrikaans
sample:
n_final: 178
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 41.63 (sd 12.85, range 18–73); Gender % M/F/other: 34.3/65.7/0;
Total N=270; Passed comprehension check N=178 (65.9%).'
mean_age: 41.63
mean_age_prov:
page: 4
quote: 'South Africa (Afrikaans): Age mean 41.63 (range 18–73; sd 12.85).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Africa (Afrikaans): N=270; Passed Check=178 (65.9%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Africa (Afrikaans) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=24, n_high=48, mean_low=1.75, mean_high=2.5625,
sd_low=0.793999233380421, sd_high=1.55613063500192.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.600119731518484
v: 0.0650009978622071
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 24
mean: 1.75
sd: 0.793999233380421
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 48
mean: 2.5625
sd: 1.55613063500192
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s11_e4
site_id: 11
site_label: South Africa (Afrikaans)
language: other
language_other: Afrikaans
sample:
n_final: 178
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 41.63 (sd 12.85, range 18–73); Gender % M/F/other: 34.3/65.7/0;
Total N=270; Passed comprehension check N=178 (65.9%).'
mean_age: 41.63
mean_age_prov:
page: 4
quote: 'South Africa (Afrikaans): Age mean 41.63 (range 18–73; sd 12.85).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Africa (Afrikaans): N=270; Passed Check=178 (65.9%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Africa (Afrikaans) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=15, n_high=45, mean_low=10.2,
mean_high=5.31111111111111, sd_low=25.0718966175278, sd_high=3.29477701150708.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.386541332590345
v: 0.0901340072372282
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 15
mean: 10.2
sd: 25.0718966175278
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 45
mean: 5.31111111111111
sd: 3.29477701150708
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s12_e1
site_id: 12
site_label: South Africa (Sepedi)
language: other
language_other: Sepedi
sample:
n_final: 122
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 29.33 (sd 7.88, range 18–57); Gender % M/F/other: 36.5/62/1.5;
Total N=258; Passed comprehension check N=122 (47.3%).'
mean_age: 29.33
mean_age_prov:
page: 4
quote: 'South Africa (Sepedi): Age mean 29.33 (range 18–57; sd 7.88).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Africa (Sepedi): N=258; Passed Check=122 (47.3%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Africa (Sepedi) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=6, low_no=3, high_yes=40,
high_no=16; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.123025487666559
v: 0.17857858616962
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 9
mean: 0.666666666666667
sd: 0.5
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 56
mean: 0.714285714285714
sd: 0.455842305838552
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s12_e2
site_id: 12
site_label: South Africa (Sepedi)
language: other
language_other: Sepedi
sample:
n_final: 122
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 29.33 (sd 7.88, range 18–57); Gender % M/F/other: 36.5/62/1.5;
Total N=258; Passed comprehension check N=122 (47.3%).'
mean_age: 29.33
mean_age_prov:
page: 4
quote: 'South Africa (Sepedi): Age mean 29.33 (range 18–57; sd 7.88).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Africa (Sepedi): N=258; Passed Check=122 (47.3%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Africa (Sepedi) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=1, low_no=3, high_yes=32,
high_no=21; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.8379238540455
v: 0.429258050341868
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 4
mean: 0.25
sd: 0.5
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 53
mean: 0.60377358490566
sd: 0.493793114632085
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s12_e3
site_id: 12
site_label: South Africa (Sepedi)
language: other
language_other: Sepedi
sample:
n_final: 122
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 29.33 (sd 7.88, range 18–57); Gender % M/F/other: 36.5/62/1.5;
Total N=258; Passed comprehension check N=122 (47.3%).'
mean_age: 29.33
mean_age_prov:
page: 4
quote: 'South Africa (Sepedi): Age mean 29.33 (range 18–57; sd 7.88).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Africa (Sepedi): N=258; Passed Check=122 (47.3%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Africa (Sepedi) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=1, n_high=10, mean_low=3.0, mean_high=4.1,
sd_low=None, sd_high=2.28278582243519.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: null
v: null
computed_from: groups
needs_review: true
notes: Insufficient per-group data for esc_mean_sd (need n>=2 and finite SD in both stakes groups).
quality_flags:
- insufficient_data_for_split_effect
notes: null
groups:
- group_id: low_stakes
label: null
n: 1
mean: 3.0
sd: null
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 10
mean: 4.1
sd: 2.28278582243519
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s12_e4
site_id: 12
site_label: South Africa (Sepedi)
language: other
language_other: Sepedi
sample:
n_final: 122
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 29.33 (sd 7.88, range 18–57); Gender % M/F/other: 36.5/62/1.5;
Total N=258; Passed comprehension check N=122 (47.3%).'
mean_age: 29.33
mean_age_prov:
page: 4
quote: 'South Africa (Sepedi): Age mean 29.33 (range 18–57; sd 7.88).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Africa (Sepedi): N=258; Passed Check=122 (47.3%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Africa (Sepedi) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=1, n_high=10, mean_low=2.0,
mean_high=6.3, sd_low=None, sd_high=3.43349514181816.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: null
v: null
computed_from: groups
needs_review: true
notes: Insufficient per-group data for esc_mean_sd (need n>=2 and finite SD in both stakes groups).
quality_flags:
- insufficient_data_for_split_effect
notes: null
groups:
- group_id: low_stakes
label: null
n: 1
mean: 2.0
sd: null
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 10
mean: 6.3
sd: 3.43349514181816
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s13_e1
site_id: 13
site_label: South Africa (isiZulu)
language: other
language_other: isiZulu
sample:
n_final: 130
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 31.05 (sd 9.84, range 18–76); Gender % M/F/other: 27.9/69.9/2.2;
Total N=268; Passed comprehension check N=130 (48.5%).'
mean_age: 31.05
mean_age_prov:
page: 4
quote: 'South Africa (isiZulu): Age mean 31.05 (range 18–76; sd 9.84).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Africa (isiZulu): N=268; Passed Check=130 (48.5%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Africa (isiZulu) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=3, low_no=1, high_yes=38,
high_no=19; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.223544630185352
v: 0.429281857010957
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 4
mean: 0.75
sd: 0.5
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 57
mean: 0.666666666666667
sd: 0.475594865605671
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s13_e2
site_id: 13
site_label: South Africa (isiZulu)
language: other
language_other: isiZulu
sample:
n_final: 130
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 31.05 (sd 9.84, range 18–76); Gender % M/F/other: 27.9/69.9/2.2;
Total N=268; Passed comprehension check N=130 (48.5%).'
mean_age: 31.05
mean_age_prov:
page: 4
quote: 'South Africa (isiZulu): Age mean 31.05 (range 18–76; sd 9.84).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Africa (isiZulu): N=268; Passed Check=130 (48.5%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Africa (isiZulu) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=2, low_no=2, high_yes=44,
high_no=21; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.407799898257834
v: 0.32534626825413
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 4
mean: 0.5
sd: 0.577350269189626
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 65
mean: 0.676923076923077
sd: 0.471291188773336
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s13_e3
site_id: 13
site_label: South Africa (isiZulu)
language: other
language_other: isiZulu
sample:
n_final: 130
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 31.05 (sd 9.84, range 18–76); Gender % M/F/other: 27.9/69.9/2.2;
Total N=268; Passed comprehension check N=130 (48.5%).'
mean_age: 31.05
mean_age_prov:
page: 4
quote: 'South Africa (isiZulu): Age mean 31.05 (range 18–76; sd 9.84).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Africa (isiZulu): N=268; Passed Check=130 (48.5%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Africa (isiZulu) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=0, n_high=7, mean_low=None, mean_high=8.71428571428571,
sd_low=None, sd_high=11.1162686442632.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: null
v: null
computed_from: groups
needs_review: true
notes: Insufficient per-group data for esc_mean_sd (need n>=2 and finite SD in both stakes groups).
quality_flags:
- insufficient_data_for_split_effect
notes: null
groups:
- group_id: low_stakes
label: null
n: 0
mean: null
sd: null
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 7
mean: 8.71428571428571
sd: 11.1162686442632
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s13_e4
site_id: 13
site_label: South Africa (isiZulu)
language: other
language_other: isiZulu
sample:
n_final: 130
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: non-students; Age mean 31.05 (sd 9.84, range 18–76); Gender % M/F/other: 27.9/69.9/2.2;
Total N=268; Passed comprehension check N=130 (48.5%).'
mean_age: 31.05
mean_age_prov:
page: 4
quote: 'South Africa (isiZulu): Age mean 31.05 (range 18–76; sd 9.84).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Africa (isiZulu): N=268; Passed Check=130 (48.5%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Africa (isiZulu) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=1, n_high=4, mean_low=5.0,
mean_high=5.5, sd_low=None, sd_high=1.91485421551268.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: null
v: null
computed_from: groups
needs_review: true
notes: Insufficient per-group data for esc_mean_sd (need n>=2 and finite SD in both stakes groups).
quality_flags:
- insufficient_data_for_split_effect
notes: null
groups:
- group_id: low_stakes
label: null
n: 1
mean: 5.0
sd: null
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 4
mean: 5.5
sd: 1.91485421551268
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s14_e1
site_id: 14
site_label: South Korea (Korean)
language: other
language_other: Korean
sample:
n_final: 193
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 35.40 (sd 10.37, range 18–68); Gender % M/F/other: 41.5/58.5/0;
Total N=256; Passed comprehension check N=193 (75.4%).'
mean_age: 35.4
mean_age_prov:
page: 4
quote: 'South Korea: Age mean 35.40 (range 18–68; sd 10.37).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Korea: N=256; Passed Check=193 (75.4%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Korea (Korean) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=7, low_no=25, high_yes=19,
high_no=46; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.214336417883997
v: 0.0781878913639849
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 32
mean: 0.21875
sd: 0.420013440645154
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 65
mean: 0.292307692307692
sd: 0.458362469936353
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s14_e2
site_id: 14
site_label: South Korea (Korean)
language: other
language_other: Korean
sample:
n_final: 193
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 35.40 (sd 10.37, range 18–68); Gender % M/F/other: 41.5/58.5/0;
Total N=256; Passed comprehension check N=193 (75.4%).'
mean_age: 35.4
mean_age_prov:
page: 4
quote: 'South Korea: Age mean 35.40 (range 18–68; sd 10.37).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Korea: N=256; Passed Check=193 (75.4%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Korea (Korean) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=7, low_no=31,
high_yes=19, high_no=39; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.423946773623045
v: 0.0770206590854943
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 38
mean: 0.184210526315789
sd: 0.392859452063192
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 58
mean: 0.327586206896552
sd: 0.473432076473999
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s14_e3
site_id: 14
site_label: South Korea (Korean)
language: other
language_other: Korean
sample:
n_final: 193
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 35.40 (sd 10.37, range 18–68); Gender % M/F/other: 41.5/58.5/0;
Total N=256; Passed comprehension check N=193 (75.4%).'
mean_age: 35.4
mean_age_prov:
page: 4
quote: 'South Korea: Age mean 35.40 (range 18–68; sd 10.37).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Korea: N=256; Passed Check=193 (75.4%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Korea (Korean) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=32, n_high=65, mean_low=7.21875,
mean_high=12.9230769230769, sd_low=18.9630104711523, sd_high=25.8658242742159.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.239334748336968
v: 0.04692987889885
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 32
mean: 7.21875
sd: 18.9630104711523
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 65
mean: 12.9230769230769
sd: 25.8658242742159
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s14_e4
site_id: 14
site_label: South Korea (Korean)
language: other
language_other: Korean
sample:
n_final: 193
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students and non-students; Age mean 35.40 (sd 10.37, range 18–68); Gender % M/F/other: 41.5/58.5/0;
Total N=256; Passed comprehension check N=193 (75.4%).'
mean_age: 35.4
mean_age_prov:
page: 4
quote: 'South Korea: Age mean 35.40 (range 18–68; sd 10.37).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'South Korea: N=256; Passed Check=193 (75.4%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: South Korea (Korean) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=38, n_high=58, mean_low=6.89473684210526,
mean_high=19.2241379310345, sd_low=9.95880562057196, sd_high=31.507750705294.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.486975335219731
v: 0.044792298873156
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 38
mean: 6.89473684210526
sd: 9.95880562057196
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 58
mean: 19.2241379310345
sd: 31.507750705294
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s15_e1
site_id: 15
site_label: United States (English)
language: English
language_other: null
sample:
n_final: 348
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: students; Age mean 35.85 (sd 10.52, range 19–73); Gender % M/F/other: 55.5/44.5/0;
Total N=396; Passed comprehension check N=348 (87.9%).'
mean_age: 35.85
mean_age_prov:
page: 4
quote: 'United States: Age mean 35.85 (range 19–73; sd 10.52).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'United States: N=396; Passed Check=348 (87.9%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: United States (English) — Evidence-fixed (weak evidence (checked once))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within weak evidence (checked once); low_yes=30, low_no=46, high_yes=27,
high_no=70; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.289565853630032
v: 0.0323402673806634
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 76
mean: 0.394736842105263
sd: 0.492041932316642
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 97
mean: 0.278350515463918
sd: 0.450515169029605
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s15_e2
site_id: 15
site_label: United States (English)
language: English
language_other: null
sample:
n_final: 348
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: students; Age mean 35.85 (sd 10.52, range 19–73); Gender % M/F/other: 55.5/44.5/0;
Total N=396; Passed comprehension check N=348 (87.9%).'
mean_age: 35.85
mean_age_prov:
page: 4
quote: 'United States: Age mean 35.85 (range 19–73; sd 10.52).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'United States: N=396; Passed Check=348 (87.9%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: United States (English) — Evidence-fixed (strong evidence (checked several times))
subgroup_desc: 'Binary choice: ''[name] knows'' vs ''only thinks he knows'' that the dam is secure.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from exact 2x2 counts via esc::esc_2x2.
paradigm: Agreement with knowledge claim
scale:
label: binary
points: 2
anchors: knows / only thinks he knows
direction: higher probability of selecting 'knows'
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data 2x2 stakes contrast within strong evidence (checked several times); low_yes=33, low_no=48,
high_yes=37, high_no=57; no continuity correction.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: 0.0316682797896812
v: 0.0290915156544521
computed_from: groups
needs_review: false
notes: Computed with esc::esc_2x2 from exact 2x2 counts.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 81
mean: 0.407407407407407
sd: 0.494413232473044
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 94
mean: 0.393617021276596
sd: 0.491171194261993
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s15_e3
site_id: 15
site_label: United States (English)
language: English
language_other: null
sample:
n_final: 348
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: students; Age mean 35.85 (sd 10.52, range 19–73); Gender % M/F/other: 55.5/44.5/0;
Total N=396; Passed comprehension check N=348 (87.9%).'
mean_age: 35.85
mean_age_prov:
page: 4
quote: 'United States: Age mean 35.85 (range 19–73; sd 10.52).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'United States: N=396; Passed Check=348 (87.9%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: United States (English) — Evidence-seeking (weak evidence (checked once))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to weak evidence (checked once); stakes
contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: Medium
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked once
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within weak evidence (checked once) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within weak evidence (checked once); n_low=72, n_high=91, mean_low=2.65277777777778,
mean_high=8.62637362637363, sd_low=3.97229745926099, sd_high=20.1993665201265.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.389640360498061
v: 0.0253436042046761
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 72
mean: 2.65277777777778
sd: 3.97229745926099
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 91
mean: 8.62637362637363
sd: 20.1993665201265
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- effect_id: s15_e4
site_id: 15
site_label: United States (English)
language: English
language_other: null
sample:
n_final: 348
recruitment: other
recruitment_other: Convenience sample (students/non-students; see Table 1).
compensation: null
compensation_other: null
characteristics: 'Students: students; Age mean 35.85 (sd 10.52, range 19–73); Gender % M/F/other: 55.5/44.5/0;
Total N=396; Passed comprehension check N=348 (87.9%).'
mean_age: 35.85
mean_age_prov:
page: 4
quote: 'United States: Age mean 35.85 (range 19–73; sd 10.52).'
table_ref: tabula_stream_p4_t1.csv
provenance:
page: 4
quote: 'United States: N=396; Passed Check=348 (87.9%).'
table_ref: tabula_stream_p4_t1.csv
subgroup: United States (English) — Evidence-seeking (strong evidence (checked several times))
subgroup_desc: 'Free response (coded numeric): number of checks required before knowing.'
design: Between-Subjects
design_other: Computed from raw data after paper exclusions, stratified to strong evidence (checked several
times); stakes contrast from group means/SDs via esc::esc_mean_sd.
paradigm: Rating how much evidence is needed for knowledge
scale:
label: numeric/text input
points: null
anchors: How many times does the protagonist have to check before knowing?
direction: higher numbers = more checks required
provenance:
page: 5
quote: 'Evidence-seeking: How many times do you think [name] has to check the logs before he knows that the dam is secure?'
moderators:
scenario: other
skeptical_pressure: 'No'
awareness: 'Yes'
evidence: First Person
attribution_person: Other
evidence_reliability: High
moderators_coding:
scenario:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The vignette concerns building/checking a dam (not a bank/peanuts/bridge/typos case).
skeptical_pressure:
provenance:
page: 5
quote: Once he has finished building the dam, he checks the logs once to make sure the dam is secure.
tei_id: null
table_ref: null
reason: No explicit doubt/counterconsideration is introduced; stakes are manipulated via consequences only.
awareness:
provenance:
page: 5
quote: It is very important that the dam is secure. Due to the high water level, if it breaks, his kids
will be swept away by the water.
tei_id: null
table_ref: null
reason: The stakes are stated in the vignette presented to participants/protagonist.
evidence:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: Evidence is the agent’s own checking of the logs (first-person evidence).
attribution_person:
provenance:
page: 5
quote: 'Evidence-fixed: [name] ____________ that the dam is secure. ○ knows ○ only thinks he knows.'
tei_id: null
table_ref: null
reason: Participants attribute knowledge to a third person ([name]).
evidence_reliability:
provenance:
page: 5
quote: 'Weak evidence: Once he has finished building the dam, he checks the logs once to make sure the
dam is secure. Strong evidence: Once he has finished building the dam, he checks the logs several times
to make sure the dam is secure.'
tei_id: null
table_ref: null
reason: checked several times
contrast:
group_high: high_stakes
group_low: low_stakes
sign_convention: d = mean(low) - mean(high)
other_notes: Within strong evidence (checked several times) stratum.
reported_test:
test: raw_data_stakes_contrast
notes: Raw-data stakes contrast within strong evidence (checked several times); n_low=80, n_high=83, mean_low=4.775,
mean_high=7.59036144578313, sd_low=3.0769662849936, sd_high=11.0266154113009.
provenance:
page: null
quote: Computed from OSF raw dataset (GPP study 3 nlp.csv) using paper filtering rules.
effect_size:
metric: SMD
d: -0.345056147414946
v: 0.0249134189823385
computed_from: groups
needs_review: false
notes: Computed with esc::esc_mean_sd from raw group means/SDs.
quality_flags: []
notes: null
groups:
- group_id: low_stakes
label: null
n: 80
mean: 4.775
sd: 3.0769662849936
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
- group_id: high_stakes
label: null
n: 83
mean: 7.59036144578313
sd: 11.0266154113009
se: null
provenance:
page: null
quote: Derived from OSF raw dataset (GPP study 3 nlp.csv) after paper filtering logic.
tei_id: null
table_ref: null
notes: 'Recoded on 2026-04-20: former site-level study entries were moved to effect-level site/sample fields so
study_id matches the single cross-cultural study reported in the paper. Effect sizes and effect_id values were
retained.'