62 lines
3.7 KiB
YAML
62 lines
3.7 KiB
YAML
|
dataset_name: logical_fallacies
|
||
|
|
description: The following are multiple choice questions (with answers) about logical
|
||
|
|
fallacies.
|
||
|
|
fewshot_config:
|
||
|
|
sampler: first_n
|
||
|
|
samples:
|
||
|
|
- question: 'When an arguer causes confusion during refutation because of real or feigned
|
||
|
|
lack of an ability to engage in refutation, that arguer may have committed the
|
||
|
|
fallacy of
|
||
|
|
|
||
|
|
(A) poor sportsmanship (B) appeal to compassion (C) argument against the person
|
||
|
|
(D) ignorance of refutation'
|
||
|
|
target: Let's think step by step. We refer to Wikipedia articles on logical fallacies
|
||
|
|
for help. Ignorance of refutation, one of Aristotle's original list of logical
|
||
|
|
fallacies in his Organon, is when someone causes confusion in an argument through
|
||
|
|
real or feigned inability to engage in refutation, in order to win the argument.
|
||
|
|
The answer is (D).
|
||
|
|
- question: 'The complex question fallacy consists of
|
||
|
|
|
||
|
|
(A) arguing something is inferior just because it doesn''t do something it was
|
||
|
|
never intended to do. (B) including more than one claim in the proposition and
|
||
|
|
treating proof for one claim as proof for all the claims. (C) drawing a conclusion
|
||
|
|
before examining the evidence, and only considering evidence that supports that
|
||
|
|
conclusion. (D) asking a question that includes either an unproven assumption
|
||
|
|
or more than one question, thus making a straightforward yes or no answer meaningless.'
|
||
|
|
target: Let's think step by step. We refer to Wikipedia articles on logical fallacies
|
||
|
|
for help. The complex question fallacy is when someone makes a single yes or
|
||
|
|
no answer to a question meaningless, by including either an unproven assumption
|
||
|
|
or many questions. The latter is also known as the many questions fallacy. The
|
||
|
|
answer is (D).
|
||
|
|
- question: 'Arguing that what is true of the parts must be true of the whole is the
|
||
|
|
fallacy of...
|
||
|
|
|
||
|
|
(A) Division (B) Composition (C) Appeal to the person (D) Appeal to ignorance'
|
||
|
|
target: Let's think step by step. We refer to Wikipedia articles on logical fallacies
|
||
|
|
for help. Fallacy of composition occurs when someone argues what is true of
|
||
|
|
the parts must be true of the whole. The answer is (B).
|
||
|
|
- question: 'Which of the following is true of a valid categorical syllogism?
|
||
|
|
|
||
|
|
(A) The minor premise must deny the antecedent (B) The major premise must affirm
|
||
|
|
the consequent (C) The middle term must be used in at least one premise in a
|
||
|
|
universal or unqualified sense (D) All of the above'
|
||
|
|
target: 'Let''s think step by step. We refer to Wikipedia articles on logical
|
||
|
|
fallacies for help. A valid categorical syllogism must satisfy several conditions:
|
||
|
|
(1) the syllogism must have exactly three terms (2) every term of the syllogism
|
||
|
|
must be used twice exactly, (3) a term may be used only once in any premise,
|
||
|
|
and (4) the middle term must be used in at least one premise in a universal
|
||
|
|
or unqualified sense, etc. Only (C) is true. The answer is (C).'
|
||
|
|
- question: 'If someone attacks the character of an opposing arguer, instead of responding
|
||
|
|
to that opponent''s arguments, the first person has probably committed which
|
||
|
|
of the following fallacies?
|
||
|
|
|
||
|
|
(A) tu quoque (B) horse laugh (C) argument against the person (D) ignoratio
|
||
|
|
elenchi'
|
||
|
|
target: 'Let''s think step by step. We refer to Wikipedia articles on logical
|
||
|
|
fallacies for help. The argument against the person fallacy occurs when someone
|
||
|
|
irrelevantly attacks the character of an opposing arguer, instead of addressing
|
||
|
|
that opponent''s arguments. The answer is (C).'
|
||
|
|
tag: mmlu_flan_cot_fewshot_humanities
|
||
|
|
include: _mmlu_flan_cot_fewshot_template_yaml
|
||
|
|
task: mmlu_flan_cot_fewshot_logical_fallacies
|