commit 336805f2016bd28924e9383dd20db19b0b20c535 Author: ModelHub XC Date: Tue Apr 21 21:27:36 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: seyf1elislam/llama3-openhermes-2.5-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..33b9076 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,41 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +llama3-openhermes-2.5.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +llama3-openhermes-2.5.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +llama3-openhermes-2.5.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +llama3-openhermes-2.5.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +llama3-openhermes-2.5.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +llama3-openhermes-2.5.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..9ac4d78 --- /dev/null +++ b/README.md @@ -0,0 +1,25 @@ +--- +tags: +- GGUF +base_model: +- sumandas/llama3-openhermes-2.5 +--- +# llama3-openhermes-2.5 +- Model creator: [sumandas](https://huggingface.co/sumandas) +- Original model: [llama3-openhermes-2.5](https://huggingface.co/sumandas/llama3-openhermes-2.5) + + +## Description +This repo contains GGUF format model files for [sumandas's llama3-openhermes-2.5 ](https://huggingface.co/sumandas/llama3-openhermes-2.5). + +## Provided files + +| Name | Quant method | Bits | Size | Max RAM required | Use case | +| ---- | ---- | ---- | ---- | ---- | ----- | +| [llama3-openhermes-2.5.Q2_K.gguf ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q2_K.gguf ) | Q2_K | 2 | 2.72 GB| 5.22 GB | significant quality loss - not recommended for most purposes | +| [llama3-openhermes-2.5.Q3_K_M.gguf ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q3_K_M.gguf ) | Q3_K_M | 3 | 3.52 GB| 6.02 GB | very small, high quality loss | +| [llama3-openhermes-2.5.Q4_K_S.gguf ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q4_K_S.gguf ) | Q4_K_S | 4 | 4.14 GB| 6.64 GB | small, greater quality loss | +| [llama3-openhermes-2.5.Q4_K_M.gguf ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q4_K_M.gguf ) | Q4_K_M | 4 | 4.37 GB| 6.87 GB | medium, balanced quality - recommended | +| [llama3-openhermes-2.5.Q5_K_M.gguf ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q5_K_M.gguf ) | Q5_K_M | 5 | 5.13 GB| 7.63 GB | large, very low quality loss - recommended | +| [llama3-openhermes-2.5.Q6_K.gguf ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q6_K.gguf ) | Q6_K | 6 | 5.94 GB| 8.44 GB | very large, extremely low quality loss | +| [llama3-openhermes-2.5.Q8_0.gguf ](https://huggingface.co/seyf1elislam/llama3-openhermes-2.5-GGUF/blob/main/llama3-openhermes-2.5.Q8_0.gguf ) | Q8_0 | 8 | 7.70 GB| 10.20 GB | very large, extremely low quality loss - not recommended | \ No newline at end of file diff --git a/llama3-openhermes-2.5.Q3_K_L.gguf b/llama3-openhermes-2.5.Q3_K_L.gguf new file mode 100644 index 0000000..a438ffb --- /dev/null +++ b/llama3-openhermes-2.5.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:88c2016e9e6de90a91938d30f8198f4ed1128f73be03e13ec8ed20f5e9514c56 +size 4322469184 diff --git a/llama3-openhermes-2.5.Q4_K_M.gguf b/llama3-openhermes-2.5.Q4_K_M.gguf new file mode 100644 index 0000000..34f3c47 --- /dev/null +++ b/llama3-openhermes-2.5.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6bd706c5862b06cefde8a439a772834cbaa7ffd896b68231c4cb877f801ff69c +size 4921247040 diff --git a/llama3-openhermes-2.5.Q4_K_S.gguf b/llama3-openhermes-2.5.Q4_K_S.gguf new file mode 100644 index 0000000..48f781c --- /dev/null +++ b/llama3-openhermes-2.5.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:48cd1fd3e9f24bb0718c6675b1b984ce718db3ee97cb2fc1e85e11b482cc865e +size 4693181760 diff --git a/llama3-openhermes-2.5.Q5_K_M.gguf b/llama3-openhermes-2.5.Q5_K_M.gguf new file mode 100644 index 0000000..6d64e42 --- /dev/null +++ b/llama3-openhermes-2.5.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9d96950287a8b7f6b387f85f4f2ea5fe13b3d2953b1770009142ada1e7014c87 +size 5733500224 diff --git a/llama3-openhermes-2.5.Q6_K.gguf b/llama3-openhermes-2.5.Q6_K.gguf new file mode 100644 index 0000000..88c65c0 --- /dev/null +++ b/llama3-openhermes-2.5.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9bd8d17f013c256d37839addce3641e588c8302a60ac4e95359cb4b8900f9638 +size 6596519232 diff --git a/llama3-openhermes-2.5.Q8_0.gguf b/llama3-openhermes-2.5.Q8_0.gguf new file mode 100644 index 0000000..c2cb012 --- /dev/null +++ b/llama3-openhermes-2.5.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fb471727627917bd7ee5d2be40a7c7d5c5dcb7b8bff3ffceb4371297efaaefa7 +size 8541283648