KoboldAI/LLaMA2-13B-Erebus-v3-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: KoboldAI/LLaMA2-13B-Erebus-v3-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-11 03:34:06 +08:00
commit a671844c6c
19 changed files with 135 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

0
LICENSE Normal file
View File

42
README.md Normal file
View File

@@ -0,0 +1,42 @@
---
license: llama2
license_name: llama-2
license_link: LICENSE
language:
- en
pipeline_tag: text-generation
inference: false
tags:
- pytorch
- llama
- llama-2
- finetuned
- not-for-all-audiences
---
# LLaMA2-13B-Erebus
This is the GGUF version of this model designed to be used with [Koboldcpp](https://koboldai.org/cpp), the easy and versitile program for AI co-writing and more.
Because this is a co-writing model, you are expected to use the Story Mode inside the KoboldAI Lite interface.
## Model description
This is the third generation of the original Shinen made by Mr. Seeker. The full dataset consists of 8 different sources, all surrounding the "Adult" theme. The name "Erebus" comes from the greek mythology, also named "darkness". This is in line with Shin'en, or "deep abyss". For inquiries, please contact the KoboldAI community. **Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.**
## Training procedure
LLaMA2-13B-Erebus was trained on 8x A6000 Ada GPU's for a single epoch. No special frameworks have been used.
## Training data
The data can be divided in 8 different datasets:
- Literotica (everything with 3.0/5 or higher)
- Sexstories (everything with 70 or higher)
- Dataset-G (private dataset of X-rated stories)
- Doc's Lab (all stories)
- Lushstories (Editor's pick)
- Swinglifestyle (all stories)
- Pike-v2 Dataset (novels with "adult" rating)
- SoFurry (collection of various animals)
The dataset uses `[Genre: <comma-separated list of genres>]` for tagging.
The full dataset is 2.3B tokens in size.
## Limitations and biases
Based on known problems with NLP technology, potential relevant factors include bias (gender, profession, race and religion). **Warning: This model has a very strong NSFW bias!**

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

3
llama2-13b-erebus-v3.F16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:30e3f39d96c39a0e86e0508c56864a4473d1d029ba160f0c55150375a496c9d8
size 26033303456

3
llama2-13b-erebus-v3.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f7e89dc04555581890b496682ee83dde41c9d5723b96face433d3b2d7fc080a3
size 5429348320

3
llama2-13b-erebus-v3.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c52237e6bbaa74c9e2a1c2d3eede948072e654da676acc0db7099aca8dd5c191
size 6929559520

3
llama2-13b-erebus-v3.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0841b9cd5e16f4111bd493cc091f3ee2e41444cb536d8267a7194c588cb89a91
size 6337769440

3
llama2-13b-erebus-v3.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c89fe2a1b4edd127e2547a83496f28feff5da62911e6784ce8f7cf6e53d9b26
size 5658980320

3
llama2-13b-erebus-v3.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d37925d1f7cc7ba68995fb3daebb02ca80bc4ad9173ce1f6061ad4507ef92de8
size 7365834720

3
llama2-13b-erebus-v3.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c041c9a66a36c576f4c772c6295a91b5fb6b6323110409980c8a9e2676e0e37e
size 8169060320

3
llama2-13b-erebus-v3.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c24b1f2c37f57f218a8ac61a74baa9e7e6ca2cf10dc0e0f353625fbb648b8ea
size 7865956320

3
llama2-13b-erebus-v3.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:83633ae6150a8a83845506967d78c924301f4dd37bae70cdaa55002b0c39b51f
size 7414331360

3
llama2-13b-erebus-v3.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:255480f1141d9536ad4cbc53d39d88d7ca47239c05c7fe5e193e54336ce6e975
size 8972285920

3
llama2-13b-erebus-v3.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38c6ccfc40f00c7b556b9330ddb4d59d8cc48d21743ea125e335e689f5991920
size 9775511520

3
llama2-13b-erebus-v3.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b67938ceedcc0cd96959583092adbfea4a095a64f742d1d09818919941c069e
size 9229924320

3
llama2-13b-erebus-v3.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2fd393076fb8ab8a8a868ee7f1b90bcbe64a27e703c51139e8716a5e810dd493
size 8972285920

3
llama2-13b-erebus-v3.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:899a1e9c767d1de4d5895f8f615c3ddfaadfb4376e13c82ff2014c2b79697925
size 10679140320

3
llama2-13b-erebus-v3.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49bae35ab835e514da722fde411c4cbb30eaf9ab6516247d8074c34cedc49a29
size 13831319520