KoboldAI/OPT-13B-Nerybus-Mix
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: KoboldAI/OPT-13B-Nerybus-Mix
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-05 10:55:12 +08:00
commit 04f4943617
23 changed files with 100499 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

34
README.md Normal file
View File

@@ -0,0 +1,34 @@
---
language: en
license: other
commercial: no
inference: false
---
# OPT 13B - Nerybus Mix
## Model description
This is a merged (50/50) model of both Erebus 13B and Nerys V2 13B by Mr. Seeker.
**Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.**
## Information:
For more information, check out the two source models:
- https://huggingface.co/KoboldAI/OPT-13B-Erebus
- https://huggingface.co/KoboldAI/OPT-13B-Nerys-v2
## Limitations and biases
Based on known problems with NLP technology, potential relevant factors include bias (gender, profession, race and religion).
**Warning: This model has a very strong NSFW bias!**
### License
OPT-13B is licensed under the OPT-175B license, Copyright (c) Meta Platforms, Inc. All Rights Reserved.
### BibTeX entry and citation info
```
@misc{zhang2022opt,
title={OPT: Open Pre-trained Transformer Language Models},
author={Susan Zhang and Stephen Roller and Naman Goyal and Mikel Artetxe and Moya Chen and Shuohui Chen and Christopher Dewan and Mona Diab and Xian Li and Xi Victoria Lin and Todor Mihaylov and Myle Ott and Sam Shleifer and Kurt Shuster and Daniel Simig and Punit Singh Koura and Anjali Sridhar and Tianlu Wang and Luke Zettlemoyer},
year={2022},
eprint={2205.01068},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```

34
config.json Normal file
View File

@@ -0,0 +1,34 @@
{
"_name_or_path": "facebook/opt-13b",
"_remove_final_layer_norm": false,
"activation_dropout": 0.0,
"activation_function": "relu",
"antemplate": "[Genre: <|>]",
"architectures": [
"OPTForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 2,
"do_layer_norm_before": true,
"dropout": 0.1,
"enable_bias": true,
"eos_token_id": 2,
"ffn_dim": 20480,
"hidden_size": 5120,
"init_std": 0.02,
"layer_norm_elementwise_affine": true,
"layerdrop": 0.0,
"max_position_embeddings": 2048,
"model_type": "opt",
"num_attention_heads": 40,
"num_hidden_layers": 40,
"output_projection": true,
"pad_token_id": 1,
"prefix": "</s>",
"torch_dtype": "float16",
"transformers_version": "4.25.1",
"use_cache": false,
"vocab_size": 50265,
"welcome": "## Warning: This model has a very heavy NSFW bias and is not suitable for use by minors!\n\nYou are currently running the model `OPT-13B-Nerybus-Mix.`\n\nThis is an experimental model containing a parameter-wise 50/50 blend (weighted average) of NerysV2-13B and ErebusV1-13B.\n\n",
"word_embed_proj_dim": 5120
}

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

50001
merges.txt Normal file
View File

File diff suppressed because it is too large Load Diff

3
pytorch_model-00001-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34c3c7c91f62fee58a70d892e7c7e5afec4a26cf75b01a4abcec4105f9ae367c
size 2004073947

3
pytorch_model-00002-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21dbfff1ac2503e4b7593723d097a46595310ceab2bd0e8a0854cb4068357bbd
size 1887850581

3
pytorch_model-00003-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:505492116358de18de3f68f399efdc7e875cb121366d3f50d2144675ed324472
size 1887850581

3
pytorch_model-00004-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:392a72013cc3ce401b67bc91de1479e3176f8b4f32d07444eb4a2a474d8b8bc1
size 1887850581

3
pytorch_model-00005-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dfc0245540fa99edace5d15ff00c4b7e162544f4a8f72f214580f7cbbfe1261d
size 1887850581

3
pytorch_model-00006-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0a98e26159ebb142de40aed53de9bcfaa3637851672146f150cd3b53af18d13
size 1887850581

3
pytorch_model-00007-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1493b99287e5f47b528b4188f307d1a3692fba493261460fa35d64ec60e32b52
size 1887850581

3
pytorch_model-00008-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6923daf77c326a0f3b8d8c40cac80c150db06a7a241cbebe87b6caf75e474201
size 1887850581

3
pytorch_model-00009-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7b77ce43d389d13a4b7984b0022d232296b430b4f4b033db4718eb6255eed75
size 1887850581

3
pytorch_model-00010-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:afeec9819435090ee1abdb75346c4df1d5a49d355e90a787e413ccf0810c64fd
size 1887850581

3
pytorch_model-00011-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8f0441302140600ed2f2bf4e2275b7ec1df81522762faa4dd3b2f364390a0700
size 1887850581

3
pytorch_model-00012-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71f295a1fdfa241beacc46f64e9e917d8b9876a3921554757a139146710004c8
size 1887850581

3
pytorch_model-00013-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6a57510202f8c35663e86e0002c5cd4cf36d7d01466ae29a3cac321ce0420b7
size 1887850581

3
pytorch_model-00014-of-00014.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00f6dcf165f36a56ee1c3afd7b4b827340554a52b8460572f3ff50293d3227cf
size 1563501024

3
pytorch_model.bin.index.json Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2cca8696870b6232047b7bbdaa9f9af1cad7df6542e24cf82381ffc0745fd6e4
size 56291

30
special_tokens_map.json Normal file
View File

@@ -0,0 +1,30 @@
{
"bos_token": {
"content": "</s>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false
},
"eos_token": {
"content": "</s>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false
},
"pad_token": {
"content": "<pad>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false
},
"unk_token": {
"content": "</s>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false
}
}

40
tokenizer_config.json Normal file
View File

@@ -0,0 +1,40 @@
{
"add_bos_token": true,
"add_prefix_space": false,
"bos_token": {
"__type": "AddedToken",
"content": "</s>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false
},
"eos_token": {
"__type": "AddedToken",
"content": "</s>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false
},
"errors": "replace",
"name_or_path": "facebook/opt-13b",
"pad_token": {
"__type": "AddedToken",
"content": "<pad>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false
},
"special_tokens_map_file": null,
"tokenizer_class": "GPT2Tokenizer",
"unk_token": {
"__type": "AddedToken",
"content": "</s>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false
}
}

50267
vocab.json Normal file
View File

File diff suppressed because it is too large Load Diff