初始化项目，由ModelHub XC社区提供模型

Model: elinas/Llama-3-15B-Instruct-zeroed
Source: Original Platform

README.md

@@ -0,0 +1,63 @@
+---
+base_model:
+- meta-llama/Meta-Llama-3-8B-Instruct
+library_name: transformers
+tags:
+- mergekit
+- merge
+license: llama3
+---
+# Llama-3-15B-Instruct-zeroed
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+## Merge Details
+### Merge Method
+
+This model was merged using the passthrough merge method while zeroing `o_proj` and `down_proj` which led to an decrease in perplexity (good)
+compared to similar 15B merges. This was a recommendation from [Charles Goddard](https://huggingface.co/chargoddard) - thank you for sharing the method of merging as well as Toasty
+Pigeon for bringing it to my attention!
+
+## Finetuned Version
+A finetuned version of this model can be found at [elinas/Llama-3-15B-Instruct-zeroed-ft](https://huggingface.co/elinas/Llama-3-15B-Instruct-zeroed-ft) which seems to improve performance.
+
+### Models Merged
+
+The following models were included in the merge:
+* [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+dtype: bfloat16
+merge_method: passthrough
+slices:
+- sources:
+  - layer_range: [0, 24]
+    model: meta-llama/Meta-Llama-3-8B-Instruct
+- sources:
+  - layer_range: [8, 24]
+    model: meta-llama/Meta-Llama-3-8B-Instruct
+    parameters:
+      scale:
+      - filter: o_proj
+        value: 0.0
+      - filter: down_proj
+        value: 0.0
+      - value: 1.0
+- sources:
+  - layer_range: [8, 24]
+    model: meta-llama/Meta-Llama-3-8B-Instruct
+    parameters:
+      scale:
+      - filter: o_proj
+        value: 0.0
+      - filter: down_proj
+        value: 0.0
+      - value: 1.0
+- sources:
+  - layer_range: [24, 32]
+    model: meta-llama/Meta-Llama-3-8B-Instruct
+```