QuantFactory/llama-7b-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: QuantFactory/llama-7b-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-09 05:11:07 +08:00
commit 5181db12bf
17 changed files with 112 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

49
.gitattributes vendored Normal file
View File

@@ -0,0 +1,49 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
llama-7b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
llama-7b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text

20
README.md Normal file
View File

@@ -0,0 +1,20 @@
---
license: other
---
[![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
# QuantFactory/llama-7b-GGUF
This is quantized version of [huggyllama/llama-7b](https://huggingface.co/huggyllama/llama-7b) created using llama.cpp
# Original Model Card
This contains the weights for the LLaMA-7b model. This model is under a non-commercial license (see the LICENSE file).
You should only use this repository if you have been granted access to the model by filling out [this form](https://docs.google.com/forms/d/e/1FAIpQLSfqNECQnMkycAp2jP4Z9TFX0cGR4uf7b_fBxjY_OjhJILlKGA/viewform?usp=send_form) but either lost your copy of the weights or got some trouble converting them to the Transformers format.

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "others", "allow_remote": true}

3
llama-7b.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3283d2db140f069e8814bc869a91e647fcaf3a2a074243f3cfb4d82dc103aef0
size 2532865536

3
llama-7b.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59ae73eabb1b0e72904ffb540c2f5340cfe982f61b58665411e2d5b4f50085df
size 3597112832

3
llama-7b.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3565da54b8be96d086f6e7eb25e8c1dff1e443d25bf447e165ddc2d4ce42ca0
size 3298006528

3
llama-7b.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:18f7dad34b75e93c0c16c3eb3f9def981a3cb1edfe47663d2948ef2cd875674d
size 2948306432

3
llama-7b.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eaaae3ab6f952b8b10379d4afc2ab6b8ee21c1968035de82607df896f01c5022
size 3825808896

3
llama-7b.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ecafc1ec5dc4e49a99c41cf80be667f50fd59e845cce6fa12f24744de7f8431c
size 4238751232

3
llama-7b.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a6a03a80540e8f6a50b9fe4ecd3ad134c6208fb5d39c3556db06046612f3369
size 4081006080

3
llama-7b.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:984dcf76d4128529ffa1370a0333f4ebbd5f16107b6c8a6d1344524b03e66ec6
size 3856741888

3
llama-7b.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b81542bbe14d79201e195e95c4f09c4fda505e6f1f866dd94ab1420ff3aabbf1
size 4651693568

3
llama-7b.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e1f6b3518dfcdbc08a62afc9965b2eaef24f678b16ae4ce7974baa8c5ff92bb2
size 5064635904

3
llama-7b.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f66c696c0b2c3c97dff1d8c281f76f0645d02f56653b821918185a1b4233a2b6
size 4783158784

3
llama-7b.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e123c79fd61d7a4cac2797f6137a021b619e28545b6dd45f0db7fadbb1fd39b
size 4651693568

3
llama-7b.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:344dcb8186dfa79f2f3868207db6dacc09d8abbad5085cb758d4a3d1470ca4ed
size 5529196032

3
llama-7b.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99b51364feb0bbb7cd964a3331705f052333dac79d452665ed9db14b23532259
size 7161091584