初始化项目，由ModelHub XC社区提供模型

Model: KoboldAI/GPT-NeoX-20B-Erebus
Source: Original Platform

.gitattributes

@@ -0,0 +1,50 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bin.* filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zstandard filter=lfs diff=lfs merge=lfs -text
+*.tfevents* filter=lfs diff=lfs merge=lfs -text
+*.db* filter=lfs diff=lfs merge=lfs -text
+*.ark* filter=lfs diff=lfs merge=lfs -text
+**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
+**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
+**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.gguf* filter=lfs diff=lfs merge=lfs -text
+*.ggml filter=lfs diff=lfs merge=lfs -text
+*.llamafile* filter=lfs diff=lfs merge=lfs -text
+*.pt2 filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+
+tokenizer.json filter=lfs diff=lfs merge=lfs -text
+vocab.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,49 @@
+---
+language: en
+license: apache-2.0
+inference: false
+---
+
+# GPT-NeoX-20B-Erebus
+## Model description
+This is the second generation of the original Shinen made by Mr. Seeker. The full dataset consists of 6 different sources, all surrounding the "Adult" theme. The name "Erebus" comes from the greek mythology, also named "darkness". This is in line with Shin'en, or "deep abyss". For inquiries, please contact the KoboldAI community. **Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.**
+
+## Training procedure
+GPT-NeoX-20B-Erebus was trained on a TPUv3-256 TPU pod using a heavily modified version of Ben Wang's Mesh Transformer JAX library, the original version of which was used by EleutherAI to train their GPT-J-6B model.
+
+## Training data
+The data can be divided in 6 different datasets:
+- Literotica (everything with 4.5/5 or higher)
+- Sexstories (everything with 90 or higher)
+- Dataset-G (private dataset of X-rated stories)
+- Doc's Lab (all stories)
+- Pike Dataset (novels with "adult" rating)
+- SoFurry (collection of various animals)
+
+The dataset uses `[Genre: <comma-separated list of genres>]` for tagging.
+
+## Limitations and biases
+Based on known problems with NLP technology, potential relevant factors include bias (gender, profession, race and religion). **Warning: This model has a very strong NSFW bias!**
+
+## Citation details
+The GPT-NeoX-20B model weights:
+```bibtex
+@inproceedings{gpt-neox-20b,
+  title={{GPT-NeoX-20B}: An Open-Source Autoregressive Language Model},
+  author={Black, Sid and Biderman, Stella and Hallahan, Eric and Anthony, Quentin and Gao, Leo and Golding, Laurence and He, Horace and Leahy, Connor and McDonell, Kyle and Phang, Jason and Pieler, Michael and Prashanth, USVSN Sai and Purohit, Shivanshu and Reynolds, Laria and Tow, Jonathan and Wang, Ben and Weinbach, Samuel},
+  booktitle={Proceedings of the ACL Workshop on Challenges \& Perspectives in Creating Large Language Models},
+  url={https://arxiv.org/abs/2204.06745},
+  year={2022}
+}
+```
+
+The Mesh Transformer JAX library:
+```bibtex
+@misc{mesh-transformer-jax,
+  author = {Wang, Ben},
+  title = {{Mesh-Transformer-JAX: Model-Parallel Implementation of Transformer Language Model with JAX}},
+  howpublished = {\url{https://github.com/kingoflolz/mesh-transformer-jax}},
+  year = 2021,
+  month = May
+}
+```

config.json

@@ -0,0 +1,29 @@
+{
+  "architectures": [
+    "GPTNeoXForCausalLM"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "bos_token_id": 0,
+  "eos_token_id": 0,
+  "hidden_act": "gelu_fast",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 6144,
+  "initializer_range": 0.02,
+  "intermediate_size": 24576,
+  "layer_norm_eps": 1e-05,
+  "max_position_embeddings": 2048,
+  "model_type": "gpt_neox",
+  "num_attention_heads": 64,
+  "num_hidden_layers": 44,
+  "rotary_emb_base": 10000,
+  "rotary_pct": 0.25,
+  "tie_word_embeddings": false,
+  "torch_dtype": "float16",
+  "transformers_version": "4.19.0.dev0",
+  "use_cache": true,
+  "max_length": 2048,
+  "rep_pen": 1.07,
+  "vocab_size": 50432,
+  "welcome": "## Warning: This model has a very heavy NSFW bias and is not suitable for use by minors!\n\nYou are currently running story-writing model `Erebus, version 1 (20B).`\n\n This model is made by [Mr. Seeker](https://www.patreon.com/mrseeker) with help of ProudNoob and the KoboldAI team.\n\n### How to use this model\n\nErebus is designed to generate short stories and novels. Use the author's note to give it a certain genre to follow, use memory to give an overview of the story and use World Information to give specific details about the characters. To start off, give the AI an idea of what you are writing about by setting the scene. Give the AI around 10 sentences that make your story interesting to read. Introduce your character, describe the world, blow something up, or let the AI use its creative mind.",
+  "antemplate": "[Genre: <|>]"
+}

configuration.json

@@ -0,0 +1 @@
+{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

pytorch_model-00001-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:40ba993549855e3e8b4c7bc8200b6fc95140ddc46b1b1645226176cd6d47809b
+size 1971915343

pytorch_model-00002-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4169935a7e9708597bc90d4929accc84cfa813eb0a2beff7ea841d17b149e385
+size 1971700552

pytorch_model-00003-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3656ba3d58d52200fd2a8d80554a51ecf2a1caf1516dc29d15c6634105237d60
+size 1887577705

pytorch_model-00004-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a93e1c8a385a25588b7b337e95a23f760be16fdea5a0485db7889cf5e9ed28ce
+size 1816249900

pytorch_model-00005-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:73f4e88ce7691013a865461d27362b8a6102df45033beaea28ef20d546e0f295
+size 1900311368

pytorch_model-00006-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7b76fe675961b3aa4ea7805b259cae7b28bd9367932e35710480b80973967a8b
+size 1820818800

pytorch_model-00007-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9afe0d072742e932eeb7520997f1dd02c21ce6ed4a0c6f0aafd5be880541c986
+size 1758015466

pytorch_model-00008-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:761ffd8c001303ff7d88100dbafbbd1c62241cb7fd607470c50772ea16b06b94
+size 1896128340

pytorch_model-00009-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cbc582533d91cb9862503054bb0cfb6c96af1c0a7391bd975e84d5ae31dce263
+size 1975956741

pytorch_model-00010-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f00661bdec1729f7823014703778b750578546fe1e861a3bd73b7eb4747bd669
+size 1829033983

pytorch_model-00011-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cd3ee8f1fb91df7ab4b2e8d821cfe3057a69576bb8b13d22ca9f31d29b1ff73b
+size 1907498369

pytorch_model-00012-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9aa2d18500777d5760b6a6d50826e434fdddf4c981858034058068d393cdb894
+size 1967481736

pytorch_model-00013-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0cfac9d64faf76fe41b78b6afaf3034f5d2ea242e51154527684cc5cae5d8c3d
+size 1816511938

pytorch_model-00014-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c8c8f079e243d0b4b32e75a378d4bbcf4f428b5e69d5be3a4c851bf55b076cfa
+size 1749603678

pytorch_model-00015-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fdee61f80b61e415c5c57938b5636605c523ecc250247cdf4f8b02a9c39ab420
+size 1971426796

pytorch_model-00016-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:24b8ffd2a275a85991d54f98ed3e48163f572d622cec7a6a3b17f5b17c763cb8
+size 1896315827

pytorch_model-00017-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:661e82a5885ccf925ae945f4ff9d49e5b05b71ebc195941680179feaf8f27c8d
+size 1975671962

pytorch_model-00018-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:399f2cfdcdaa2519c9936c97f51ee0f6686dcbddbab0e20c49edc2902c488046
+size 1438848492

pytorch_model-00019-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:91a5ba80bafbe48ea9bb20629620ed6129f4a2eaa5ac2c14a77511f27b6d7e1a
+size 1832177617

pytorch_model-00020-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:52b068aa5b4775d99f265eef6073601788809189a23c49579d4cb236d1bafe70
+size 1812078840

pytorch_model-00021-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c1dbd1c74b12fe8795e91ac1c1caef41421bbf1e36e77513a35df4ed754dd131
+size 1975809919

pytorch_model-00022-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8c22a1bd56e093fec879bcdfa19c1ff1d54755fb30cbee4e30abfacf9fa886d1
+size 1820669759

pytorch_model-00023-of-00023.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a71ba8c252c021c281b93225687cade26b2f4b8744a2b53a7aa99b7dc55f4c28
+size 302078099

pytorch_model.bin.index.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2eefa080d662aa2f5d1d68eb0e2d134b13d8eafcc9183c92f4d00bad9a4b7ea8
+size 57711

special_tokens_map.json

@@ -0,0 +1 @@
+{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e74ca9064c4f0d2232253bfe5f48caa78b6827212e87d831899d8fc64542e62b
+size 2113711

tokenizer_config.json

@@ -0,0 +1 @@
+{"unk_token": "<|endoftext|>", "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "add_prefix_space": false, "tokenizer_class": "GPTNeoXTokenizer"}

vocab.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5ea14061eabeb16dba865236c04e8b5689597a843e8fc2b73ebf816ae3253306
+size 1077393