初始化项目，由ModelHub XC社区提供模型

Model: nv-community/Nemotron-Cascade-8B
Source: Original Platform

evaluation/data/mmlu/flan_cot_fewshot/mmlu_logical_fallacies.yaml

@@ -0,0 +1,61 @@
+dataset_name: logical_fallacies
+description: The following are multiple choice questions (with answers) about logical
+  fallacies.
+fewshot_config:
+  sampler: first_n
+  samples:
+  - question: 'When an arguer causes confusion during refutation because of real or feigned
+      lack of an ability to engage in refutation, that arguer may have committed the
+      fallacy of
+
+      (A) poor sportsmanship (B) appeal to compassion (C) argument against the person
+      (D) ignorance of refutation'
+    target: Let's think step by step. We refer to Wikipedia articles on logical fallacies
+      for help. Ignorance of refutation, one of Aristotle's original list of logical
+      fallacies in his Organon, is when someone causes confusion in an argument through
+      real or feigned inability to engage in refutation, in order to win the argument.
+      The answer is (D).
+  - question: 'The complex question fallacy consists of
+
+      (A) arguing something is inferior just because it doesn''t do something it was
+      never intended to do. (B) including more than one claim in the proposition and
+      treating proof for one claim as proof for all the claims. (C) drawing a conclusion
+      before examining the evidence, and only considering evidence that supports that
+      conclusion. (D) asking a question that includes either an unproven assumption
+      or more than one question, thus making a straightforward yes or no answer meaningless.'
+    target: Let's think step by step. We refer to Wikipedia articles on logical fallacies
+      for help. The complex question fallacy is when someone makes a single yes or
+      no answer to a question meaningless, by including either an unproven assumption
+      or many questions. The latter is also known as the many questions fallacy. The
+      answer is (D).
+  - question: 'Arguing that what is true of the parts must be true of the whole is the
+      fallacy of...
+
+      (A) Division (B) Composition (C) Appeal to the person (D) Appeal to ignorance'
+    target: Let's think step by step. We refer to Wikipedia articles on logical fallacies
+      for help. Fallacy of composition occurs when someone argues what is true of
+      the parts must be true of the whole. The answer is (B).
+  - question: 'Which of the following is true of a valid categorical syllogism?
+
+      (A) The minor premise must deny the antecedent (B) The major premise must affirm
+      the consequent (C) The middle term must be used in at least one premise in a
+      universal or unqualified sense (D) All of the above'
+    target: 'Let''s think step by step. We refer to Wikipedia articles on logical
+      fallacies for help. A valid categorical syllogism must satisfy several conditions:
+      (1) the syllogism must have exactly three terms (2) every term of the syllogism
+      must be used twice exactly, (3) a term may be used only once in any premise,
+      and (4) the middle term must be used in at least one premise in a universal
+      or unqualified sense, etc. Only (C) is true. The answer is (C).'
+  - question: 'If someone attacks the character of an opposing arguer, instead of responding
+      to that opponent''s arguments, the first person has probably committed which
+      of the following fallacies?
+
+      (A) tu quoque (B) horse laugh (C) argument against the person (D) ignoratio
+      elenchi'
+    target: 'Let''s think step by step. We refer to Wikipedia articles on logical
+      fallacies for help. The argument against the person fallacy occurs when someone
+      irrelevantly attacks the character of an opposing arguer, instead of addressing
+      that opponent''s arguments. The answer is (C).'
+tag: mmlu_flan_cot_fewshot_humanities
+include: _mmlu_flan_cot_fewshot_template_yaml
+task: mmlu_flan_cot_fewshot_logical_fallacies