mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-25 06:15:17 +08:00
commit 4d98660fda
17 changed files with 162 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

50
.gitattributes vendored Normal file
View File

@@ -0,0 +1,50 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.f16.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Halu-8B-Llama3-CR-v0.45.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

3
Halu-8B-Llama3-CR-v0.45.IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:11af94188ba772a6f91989bb2bb7cd1931922e6b137675eb50aabfbfea23bb2d
size 3784823552

3
Halu-8B-Llama3-CR-v0.45.IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a81c421ebcd2510469be6a8d89cd4c360afa34cdf50480350c91c22b9ccddd93
size 3682325248

3
Halu-8B-Llama3-CR-v0.45.IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:07f86be1516400003da9013751b52dddc127840984fc7cb87fc2e8a1c6dd48c0
size 3518747392

3
Halu-8B-Llama3-CR-v0.45.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:669f24ecce2ad7f7ca4b122ee73156c3e8472ab20a61e932ea78afdee4377841
size 4484363008

3
Halu-8B-Llama3-CR-v0.45.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8445eb62e2f649c3e2c3f8bd667923db093992da4d42305a7d7b33e80e5dc5fd
size 3179131648

3
Halu-8B-Llama3-CR-v0.45.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6df9a81fdc71ad5ccf4a945dcfb579c2c0e4464bfe64ff443964e3d4aa0cf73a
size 4321956608

3
Halu-8B-Llama3-CR-v0.45.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bcace33e8062307d6460a6d6c10388162341606ff74c2874e38b8e0451621ec2
size 4018918144

3
Halu-8B-Llama3-CR-v0.45.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b642a52472d9b1b93b55faaa8be9b4de157beac70246493c860be90c3e2dc409
size 3664499456

3
Halu-8B-Llama3-CR-v0.45.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72334b5d09ba38727effc0bafa932b9c3cc45179356a947773f6dedb9bd1d26e
size 4920734464

3
Halu-8B-Llama3-CR-v0.45.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:89d07a18667d78a853770b3779c76c6577f3649ed42eac58eb60264807b31bdb
size 4692669184

3
Halu-8B-Llama3-CR-v0.45.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:73caf50e8b834be5a4418fad44bfccaef9b469d5c47ec1f80fc442b5b72dd4d7
size 5732987648

3
Halu-8B-Llama3-CR-v0.45.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b8bde1a59c0c9f2796be72681f3ffade4ace862e1eeb812d8a1407e0a5dda84
size 5599294208

3
Halu-8B-Llama3-CR-v0.45.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c5a95834943d5883e2210e6e56c6551934e88fc8a67f9889adc921e428ab952
size 6596006656

3
Halu-8B-Llama3-CR-v0.45.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f161daefe42c977bf171b9556d3d2f7ed371ff690911a4998a3f35700060ab4e
size 8540771072

3
Halu-8B-Llama3-CR-v0.45.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6eec13d460f31a3f8e76215195adec93cdb7a4812c5cdbe675a7902e6857d245
size 16068891392

67
README.md Normal file
View File

@@ -0,0 +1,67 @@
---
base_model: Hastagaras/Halu-8B-Llama3-CR-v0.45
language:
- en
library_name: transformers
license: llama3
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/Hastagaras/Halu-8B-Llama3-CR-v0.45
<!-- provided-files -->
weighted/imatrix quants are available at https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.Q2_K.gguf) | Q2_K | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.IQ3_XS.gguf) | IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.Q3_K_S.gguf) | Q3_K_S | 3.8 | |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.IQ3_S.gguf) | IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.IQ3_M.gguf) | IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.Q3_K_M.gguf) | Q3_K_M | 4.1 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.Q3_K_L.gguf) | Q3_K_L | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.IQ4_XS.gguf) | IQ4_XS | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.Q4_K_S.gguf) | Q4_K_S | 4.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.Q4_K_M.gguf) | Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.Q5_K_S.gguf) | Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.Q5_K_M.gguf) | Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.Q6_K.gguf) | Q6_K | 6.7 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.Q8_0.gguf) | Q8_0 | 8.6 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/Halu-8B-Llama3-CR-v0.45-GGUF/resolve/main/Halu-8B-Llama3-CR-v0.45.f16.gguf) | f16 | 16.2 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->