afrideva/Marx-3B-V2-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: afrideva/Marx-3B-V2-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-16 00:14:06 +08:00
commit 685c4ad750
9 changed files with 119 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

42
.gitattributes vendored Normal file
View File

@@ -0,0 +1,42 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
marx-3b-v2.fp16.gguf filter=lfs diff=lfs merge=lfs -text
marx-3b-v2.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
marx-3b-v2.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
marx-3b-v2.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
marx-3b-v2.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
marx-3b-v2.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
marx-3b-v2.q8_0.gguf filter=lfs diff=lfs merge=lfs -text

56
README.md Normal file
View File

@@ -0,0 +1,56 @@
---
base_model: acrastt/Marx-3B-V2
datasets:
- totally-not-an-llm/EverythingLM-data-V2-sharegpt
inference: false
language:
- en
library_name: transformers
license: apache-2.0
model_creator: acrastt
model_name: Marx-3B-V2
pipeline_tag: text-generation
quantized_by: afrideva
tags:
- gguf
- ggml
- quantized
- q2_k
- q3_k_m
- q4_k_m
- q5_k_m
- q6_k
- q8_0
---
# acrastt/Marx-3B-V2-GGUF
Quantized GGUF model files for [Marx-3B-V2](https://huggingface.co/acrastt/Marx-3B-V2) from [acrastt](https://huggingface.co/acrastt)
| Name | Quant method | Size |
| ---- | ---- | ---- |
| [marx-3b-v2.fp16.gguf](https://huggingface.co/afrideva/Marx-3B-V2-GGUF/resolve/main/marx-3b-v2.fp16.gguf) | fp16 | 6.85 GB |
| [marx-3b-v2.q2_k.gguf](https://huggingface.co/afrideva/Marx-3B-V2-GGUF/resolve/main/marx-3b-v2.q2_k.gguf) | q2_k | 2.15 GB |
| [marx-3b-v2.q3_k_m.gguf](https://huggingface.co/afrideva/Marx-3B-V2-GGUF/resolve/main/marx-3b-v2.q3_k_m.gguf) | q3_k_m | 2.27 GB |
| [marx-3b-v2.q4_k_m.gguf](https://huggingface.co/afrideva/Marx-3B-V2-GGUF/resolve/main/marx-3b-v2.q4_k_m.gguf) | q4_k_m | 2.58 GB |
| [marx-3b-v2.q5_k_m.gguf](https://huggingface.co/afrideva/Marx-3B-V2-GGUF/resolve/main/marx-3b-v2.q5_k_m.gguf) | q5_k_m | 2.76 GB |
| [marx-3b-v2.q6_k.gguf](https://huggingface.co/afrideva/Marx-3B-V2-GGUF/resolve/main/marx-3b-v2.q6_k.gguf) | q6_k | 3.64 GB |
| [marx-3b-v2.q8_0.gguf](https://huggingface.co/afrideva/Marx-3B-V2-GGUF/resolve/main/marx-3b-v2.q8_0.gguf) | q8_0 | 3.64 GB |
## Original Model Card:
<a href="https://www.buymeacoffee.com/acrastt" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>
This is [OpenLLaMA 3B V2](https://huggingface.co/openlm-research/open_llama_3b_v2) finetuned on [EverythingLM Data V2(ShareGPT format)](https://huggingface.co/datasets/totally-not-an-llm/EverythingLM-data-V2-sharegpt) for 2 epochs.
Prompt template:
```
### HUMAN:
{prompt}
### RESPONSE:
<leave a newline for the model to answer>
```
q4_1 GGML quant available [here](https://huggingface.co/NikolayKozloff/Marx-3B-V2/).</br>
q4_1 GGUF quant available [here]( https://huggingface.co/NikolayKozloff/Marx-3B-V2-GGUF/).

3
marx-3b-v2.fp16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd3e1fdddd012feb428f2e5ba1a4fd1fc4a8c212a315ad8fdbb1549294590c4d
size 6854036128

3
marx-3b-v2.q2_k.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:508d6c83e9b4583f6e7b756fcb79591efd4efcd6a7d108f0d2f657691bb332e8
size 2147988192

3
marx-3b-v2.q3_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7693096302729b5b5dcf84f01a4bdde7453242e6d969af7b246cd34d246c47f
size 2270612192

3
marx-3b-v2.q4_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a98fe9202cee4e59bd37b032f21a923792f679c7177fcbbefbffabfa2996790
size 2580116192

3
marx-3b-v2.q5_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b49d88b216a519a0113dc09cfbd61652bf61a97037701490dc18af24a0393a82
size 2757076192

3
marx-3b-v2.q6_k.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:804439dfb2046fc48fa7f71abe8cdb858d23f50c842aa8520bfb5b3db79f4be0
size 3641876192

3
marx-3b-v2.q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aeeebc7f29d9d5ad456de60cbe3a02c548927c634854fadff356353f55ae5149
size 3641876192