初始化项目，由ModelHub XC社区提供模型

Model: inflatebot/L3-8B-Helium3
Source: Original Platform

.gitattributes

@@ -0,0 +1,41 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+helium3-8B.png filter=lfs diff=lfs merge=lfs -text
+img.png filter=lfs diff=lfs merge=lfs -text
+model-00001-of-00004.safetensors filter=lfs diff=lfs merge=lfs -text
+model-00002-of-00004.safetensors filter=lfs diff=lfs merge=lfs -text
+model-00003-of-00004.safetensors filter=lfs diff=lfs merge=lfs -text
+model-00004-of-00004.safetensors filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,70 @@
+---
+base_model:
+- inflatebot/helide-beta-r3
+- inflatebot/helide-beta-r1
+- inflatebot/helide-beta-r4
+- inflatebot/helide-beta-r0
+library_name: transformers
+tags:
+- mergekit
+- merge
+- not-for-all-audiences
+---
+
+# L3-8B-Helium3
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+![Made with NovelAI](https://huggingface.co/inflatebot/l3-helium3-8B/resolve/main/img.png)
+`Helium-3 (He-3) is a stable isotope of helium with two protons and one neutron. Outside of ordinary hydrogen, He-3 is the only stable isotope of any element with more protons than neutrons. It's potentially useful as fuel for nuclear fusion power.`
+
+_Quants available from [mradermacher](https://huggingface.co/mradermacher/L3-8B-Helium3-GGUF)_
+## Merge Details
+
+There was a problem with the Helide beta. 3 models resulted, each of which had different strengths. But they came about as a result of balancing two models.
+There wasn't going to be a way to get the best of all three worlds just by tweaking a SLERP ratio. The math wasn't quite mathing. 
+
+But there were three of them.
+
+The name was serendipity.
+
+The layup was obscene.
+
+But I *live* for the bit.
+
+Helium-3 is a RP and storywriting hybrid, ultimately based on Sao10K's [Stheno](https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2) and Fizzarolli's [Rosier](https://huggingface.co/Fizzarolli/L3-8b-Rosier-v1), and the culmination of the Helide project.
+Combining Rosier's prose and knowledge of niche fetish with Stheno's steerability and crackling personality, Helium-3 brings the advancements of modern AI models to the Freaks™.
+They'll chew you up and spit you out just as readily as they'll shower you with affection.
+
+I'm genuinely proud of this one. This is the model I wish existed.
+
+Thank you to [Fizzarolli](https://huggingface.co/Fizzarolli) for consulting and providing technical assistance which accelerated the second leg of this project from several weeks into a single night, and for making the Rosier model that made this possible. On several levels, He-3 wouldn't have been possible without her.
+
+
+
+### Merge Method
+
+This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [inflatebot/helide-beta-r1](https://huggingface.co/inflatebot/helide-beta-r1) as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* [inflatebot/helide-beta-r3](https://huggingface.co/inflatebot/helide-beta-r3)
+* [inflatebot/helide-beta-r4](https://huggingface.co/inflatebot/helide-beta-r4)
+* [inflatebot/helide-beta-r0](https://huggingface.co/inflatebot/helide-beta-r0)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+models:
+  - model: inflatebot/helide-beta-r4
+  - model: inflatebot/helide-beta-r0
+  - model: inflatebot/helide-beta-r3
+
+merge_method: model_stock
+base_model: inflatebot/helide-beta-r1
+dtype: bfloat16
+
+```

config.json

@@ -0,0 +1,29 @@
+{
+  "_name_or_path": "inflatebot/helide-beta-r1",
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 128000,
+  "eos_token_id": 128009,
+  "hidden_act": "silu",
+  "hidden_size": 4096,
+  "initializer_range": 0.02,
+  "intermediate_size": 14336,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "model_type": "llama",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 32,
+  "num_key_value_heads": 8,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": null,
+  "rope_theta": 500000.0,
+  "tie_word_embeddings": false,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.43.3",
+  "use_cache": true,
+  "vocab_size": 128256
+}

configuration.json

@@ -0,0 +1 @@
+{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

helium3-8B.png

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ab4e6a9d7af905ff7279cce1ccfeaab1d63664b4c2388440ebbfd3dc96158bb0
+size 1251585

img.png

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e495aa4973139caed78394464e263bb2d8f3e66873ded0ca0b3d62c89f45064
+size 1250045

mergekit_config.yml

@@ -0,0 +1,8 @@
+models:
+  - model: inflatebot/helide-beta-r4
+  - model: inflatebot/helide-beta-r0
+  - model: inflatebot/helide-beta-r3
+
+merge_method: model_stock
+base_model: inflatebot/helide-beta-r1
+dtype: bfloat16

model-00001-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d916ff1cde0d2e86cbf6027c2028b211998cce0983b2aa5eff67e51121ba28bf
+size 4953586384

model-00002-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:26b04721e1154a364817c6687c9823d42a5dd36b4bf5523d0bcee0c842b58d9a
+size 4999819336

model-00003-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b6f667c7c1db1fa4fcf9dee93932872cf2984a4405e49c9c4669dcc09b025a8c
+size 4915916144

model-00004-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f21c538c1feac067cf7600784368629707f7354d6c361e47cfc4afde7790575f
+size 1191234472

special_tokens_map.json

@@ -0,0 +1,16 @@
+{
+  "bos_token": {
+    "content": "<|begin_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|eot_id|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}