初始化项目,由ModelHub XC社区提供模型
Model: RemySkye/rwkv7-g1g-7.2b-GGUF Source: Original Platform
This commit is contained in:
45
.gitattributes
vendored
Normal file
45
.gitattributes
vendored
Normal file
@@ -0,0 +1,45 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
rwkv7-g1g-7.2b-20260523-ctx8192-bf16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
rwkv7-g1g-7.2b-20260523-ctx8192-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
rwkv7-g1g-7.2b-20260523-ctx8192-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
rwkv7-g1g-7.2b-20260523-ctx8192-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
rwkv7-g1g-7.2b-20260523-ctx8192-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
rwkv7-g1g-7.2b-20260523-ctx8192-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
rwkv7-g1g-7.2b-20260523-ctx8192-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
rwkv7-g1g-7.2b-20260523-ctx8192-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
rwkv7-g1g-7.2b-20260523-ctx8192-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
rwkv7-g1g-7.2b-20260523-ctx8192-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
40
README.md
Normal file
40
README.md
Normal file
@@ -0,0 +1,40 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
- zh
|
||||
- fr
|
||||
- es
|
||||
- de
|
||||
- pt
|
||||
- ru
|
||||
- it
|
||||
- ja
|
||||
- ko
|
||||
- vi
|
||||
- ar
|
||||
tags:
|
||||
- text-generation
|
||||
- causal-lm
|
||||
- rwkv
|
||||
- gguf
|
||||
- llama.cpp
|
||||
- lmstudio
|
||||
base_model: BlinkDL/rwkv7-g1
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
|
||||
# RWKV7-G1G 7.2B - GGUF Quantizations
|
||||
|
||||
GGUF conversions of [BlinkDL/rwkv7-g1g-7.2b](https://huggingface.co/BlinkDL/rwkv7-g1) (Apache 2.0)
|
||||
for use with [llama.cpp](https://github.com/ggml-org/llama.cpp), LM Studio, and other GGUF-compatible runtimes.
|
||||
|
||||
All quants converted from **BF16 base** for maximum lossless quality.
|
||||
**Static quantizations** — no importance matrix (imatrix) was used.
|
||||
Check out this for imatrix quantizations: [RemySkye/rwkv7-g1g-7.2b-i1-GGUF](https://huggingface.co/RemySkye/rwkv7-g1g-7.2b-i1-GGUF)
|
||||
|
||||
*S/M/L K-quant variants had **no effect on size** for RWKV architecture — only `_M` variants are included.*
|
||||
|
||||
See [UncheatableEval](https://huggingface.co/spaces/Jellyfish042/UncheatableEval) for benchmarks.
|
||||
|
||||
> **Note:** Q4_0, Q3_K_M, and Q2_K were tested but produced completely unintelligible / broken output without an importance matrix. For lower BPW quantizations (below ~4.5 BPW), an imatrix would be required — these quants currently use **no imatrix** at all. Stick to Q4_K_M or higher for usable results.
|
||||
3
rwkv7-g1g-7.2b-20260523-ctx8192-BF16.gguf
Normal file
3
rwkv7-g1g-7.2b-20260523-ctx8192-BF16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:165f1e970db765e44bd761325bec07b3aeec299f875f5de6a6b2d89e8c27ca17
|
||||
size 14473934784
|
||||
3
rwkv7-g1g-7.2b-20260523-ctx8192-F16.gguf
Normal file
3
rwkv7-g1g-7.2b-20260523-ctx8192-F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:99908b9900504b152c7f51f0fe7698d1aa3a5bfd870ea7916bb61e87fa387379
|
||||
size 14473934784
|
||||
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q4_1.gguf
Normal file
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8c8752e1b4c2887addac7258f6ad7d92afc34e2527c5d90bd4b601baa1d86771
|
||||
size 4929796032
|
||||
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q4_K_M.gguf
Normal file
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a4e4e7f206f13126f0b4520d2d1b5a829a24f36d47622b21718e0bcaff37e7cd
|
||||
size 4510365632
|
||||
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q5_0.gguf
Normal file
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q5_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:63ba49346127710d50b78316c224d6e71803dd942f63c2599750ab785d91fcf1
|
||||
size 5349226432
|
||||
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q5_1.gguf
Normal file
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q5_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:70f82c06db29e3996c2a9951355ea8a558cf1d7b07dc842c23b216d849963bb4
|
||||
size 5768656832
|
||||
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q5_K_M.gguf
Normal file
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9b0dff488e88abb8e915a4f65cec1008a2bdc34e413db0c034e8c42af0ca6ffa
|
||||
size 5349226432
|
||||
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q6_K.gguf
Normal file
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a4f3e34d05124dd68536a365c9c3f82988f9ce6e6c58a00da11a0399922fe008
|
||||
size 6240516032
|
||||
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q8_0.gguf
Normal file
3
rwkv7-g1g-7.2b-20260523-ctx8192-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e25282d22ccdd5fe1f1c0860fe3fc9df546d59a7249a8c1b4767f1ea22247769
|
||||
size 7930820544
|
||||
Reference in New Issue
Block a user