mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-23 07:09:17 +08:00
commit 95442eab34
14 changed files with 157 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Llama-VARCO-8B-Instruct-LLaMAfied.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-VARCO-8B-Instruct-LLaMAfied.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-VARCO-8B-Instruct-LLaMAfied.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-VARCO-8B-Instruct-LLaMAfied.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-VARCO-8B-Instruct-LLaMAfied.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Llama-VARCO-8B-Instruct-LLaMAfied.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-VARCO-8B-Instruct-LLaMAfied.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-VARCO-8B-Instruct-LLaMAfied.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-VARCO-8B-Instruct-LLaMAfied.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Llama-VARCO-8B-Instruct-LLaMAfied.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-VARCO-8B-Instruct-LLaMAfied.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama-VARCO-8B-Instruct-LLaMAfied.f16.gguf filter=lfs diff=lfs merge=lfs -text

3
Llama-VARCO-8B-Instruct-LLaMAfied.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:107a9b0df6a1d72942490709078a9cd469df5e2529296d1a661ca4fe360cee89
size 4484367840

3
Llama-VARCO-8B-Instruct-LLaMAfied.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:087cad8232236ccc1a88415d83bc305ba87c114f977d2042e0843a8474d2799c
size 3179136480

3
Llama-VARCO-8B-Instruct-LLaMAfied.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dadab5722e8ccb1c0b4df6982f0f904a0a4ec84ad0abf074878f58c6617d89e2
size 4321961440

3
Llama-VARCO-8B-Instruct-LLaMAfied.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:700bc0e69e09fe8bc92d17c7bb85443b0ad52276a821e36a61bf2a8e15ae3de1
size 4018922976

3
Llama-VARCO-8B-Instruct-LLaMAfied.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94c0bde50004b4e74cdf555db89738059eb1958ec7a13093bb4c48fc8a1ff74e
size 3664504288

3
Llama-VARCO-8B-Instruct-LLaMAfied.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6b0352a2dfedf6b12b5fdfcf7d2e64c82eca8de97b640fed96a3def97cef128
size 4920739296

3
Llama-VARCO-8B-Instruct-LLaMAfied.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dea53e2903f092f1f7e4c799c0ceded049ad1c7889503719204f2f867c3491a7
size 4692674016

3
Llama-VARCO-8B-Instruct-LLaMAfied.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:918cea7dfd1cf2298399e0ad52d7750af0dc97289f4342d3b15906e45682c11a
size 5732992480

3
Llama-VARCO-8B-Instruct-LLaMAfied.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0bf843901ac80f6619cb8a9dddd6b971fd4e5600ca15302f904ccf0c1192d3fb
size 5599299040

3
Llama-VARCO-8B-Instruct-LLaMAfied.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3187773252ba37d0f243252bc3ad0a69d9e4cdfd5e69738e1743313f76a0d428
size 6596011488

3
Llama-VARCO-8B-Instruct-LLaMAfied.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e48980a06b61a99014d9275540be98d074218f864e2ed79c8db4517ba2f6b35b
size 8540775904

3
Llama-VARCO-8B-Instruct-LLaMAfied.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:14663047aa84980d9d226a96909e63ef66930f6fc859c77e16bd2dce21c93000
size 16068896224

74
README.md Normal file
View File

@@ -0,0 +1,74 @@
---
base_model: lemon-mint/Llama-VARCO-8B-Instruct-LLaMAfied
language:
- en
- ko
library_name: transformers
license: llama3.1
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- llama-3.1
- ncsoft
- varco
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/lemon-mint/Llama-VARCO-8B-Instruct-LLaMAfied
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Llama-VARCO-8B-Instruct-LLaMAfied-GGUF).***
weighted/imatrix quants are available at https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF/resolve/main/Llama-VARCO-8B-Instruct-LLaMAfied.Q2_K.gguf) | Q2_K | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF/resolve/main/Llama-VARCO-8B-Instruct-LLaMAfied.Q3_K_S.gguf) | Q3_K_S | 3.8 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF/resolve/main/Llama-VARCO-8B-Instruct-LLaMAfied.Q3_K_M.gguf) | Q3_K_M | 4.1 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF/resolve/main/Llama-VARCO-8B-Instruct-LLaMAfied.Q3_K_L.gguf) | Q3_K_L | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF/resolve/main/Llama-VARCO-8B-Instruct-LLaMAfied.IQ4_XS.gguf) | IQ4_XS | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF/resolve/main/Llama-VARCO-8B-Instruct-LLaMAfied.Q4_K_S.gguf) | Q4_K_S | 4.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF/resolve/main/Llama-VARCO-8B-Instruct-LLaMAfied.Q4_K_M.gguf) | Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF/resolve/main/Llama-VARCO-8B-Instruct-LLaMAfied.Q5_K_S.gguf) | Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF/resolve/main/Llama-VARCO-8B-Instruct-LLaMAfied.Q5_K_M.gguf) | Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF/resolve/main/Llama-VARCO-8B-Instruct-LLaMAfied.Q6_K.gguf) | Q6_K | 6.7 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF/resolve/main/Llama-VARCO-8B-Instruct-LLaMAfied.Q8_0.gguf) | Q8_0 | 8.6 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF/resolve/main/Llama-VARCO-8B-Instruct-LLaMAfied.f16.gguf) | f16 | 16.2 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->