初始化项目，由ModelHub XC社区提供模型

Model: nv-community/Nemotron-Cascade-8B
Source: Original Platform

evaluation/data/mmlu/flan_cot_fewshot/mmlu_sociology.yaml

@@ -0,0 +1,58 @@
+dataset_name: sociology
+description: The following are multiple choice questions (with answers) about sociology.
+fewshot_config:
+  sampler: first_n
+  samples:
+  - question: 'Which of the following is not a problem associated with official statistics
+      on strike action?
+
+      (A) most strikes go unnoticed by employers and the mass media (B) not all industrial
+      disputes will be reported by the employer (C) the definition of strikes excludes
+      those that involve fewer than ten workers or last less than one day (D) it is
+      hard to compare strikes that were measured in different ways'
+    target: Let's think step by step. We refer to Wikipedia articles on sociology
+      for help. Official statistics on strike action can be problematic because not
+      all industrial disputes will be reported by employers, the definition of strikes
+      excludes those that involves fewer than ten workers or last less than one day,
+      and it is hard to compare strikes that were measured in different ways. Thus,
+      (A) is not a problem associated with official statistics on strike action. The
+      answer is (A).
+  - question: 'What does Berger (1963) describe as a metaphor for social reality?
+
+      (A) a fairground ride (B) a circus (C) a puppet theatre (D) a ballet'
+    target: Let's think step by step. We refer to Wikipedia articles on sociology
+      for help. Berger describes social reality using the metaphor of a puppet theatre.
+      The answer is (C).
+  - question: 'The term ''hegemony'' refers to:
+
+      (A) the tendency for the working class not to realize their own interests (B)
+      a dominant ideology that legitimates economic, political and cultural power
+      (C) a form of dual consciousness based on ideology and everyday experiences
+      (D) a mode of payment given for outstanding topiary'
+    target: Let's think step by step. We refer to Wikipedia articles on sociology
+      for help. Hegemony refers to a dominant ideology that legitimates economic,
+      policital, and cultural power. The answer is (B).
+  - question: 'The shift from ''civil religion'' to ''common religion'' means that:
+
+      (A) the increasing bureaucracy of the state has made religion only a marginal
+      part of our lives (B) despite the weakening of traditional authority, our everyday
+      lives and ''common sense'' remain shaped by religious beliefs and values (C)
+      religious participation in collective worship may have declined, but people
+      still practise their faiths in private (D) people are much more likely to discuss
+      their religious beliefs in public, informal settings'
+    target: Let's think step by step. We refer to Wikipedia articles on sociology
+      for help. The shift from civil religion to common religion means that despite
+      the weakening of traditional authority, our everyday lives and common sense
+      remain shaped by religious beliefs and values. The answer is (B).
+  - question: 'Which of the following did the post-war welfare state of 1948 not aim
+      to provide:
+
+      (A) free health care and education for all (B) a minimum wage (C) full employment
+      (D) universal welfare'
+    target: 'Let''s think step by step. We refer to Wikipedia articles on sociology
+      for help. The post-war welfare state of 1948 aimed to provide free healthcare
+      and education, full employment, and universal welfare. But it did not aim to
+      provide a minimum wage. The answer is (B).'
+tag: mmlu_flan_cot_fewshot_social_sciences
+include: _mmlu_flan_cot_fewshot_template_yaml
+task: mmlu_flan_cot_fewshot_sociology