From 206cd712455547faf9b18c5b440e42e8abf6167d Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Thu, 30 Jul 2026 06:32:17 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: Aryanne/TinyAiroboros-1.1B-2.2.1-gguf Source: Original Platform --- .gitattributes | 39 ++++++++++++++++++++++++++++++ README.md | 36 +++++++++++++++++++++++++++ q2_k-tinyairoboros-1.1b-2.2.1.gguf | 3 +++ q4_0-tinyairoboros-1.1b-2.2.1.gguf | 3 +++ q6_k-tinyairoboros-1.1b-2.2.1.gguf | 3 +++ q8_0-tinyairoboros-1.1b-2.2.1.gguf | 3 +++ 6 files changed, 87 insertions(+) create mode 100644 .gitattributes create mode 100644 README.md create mode 100644 q2_k-tinyairoboros-1.1b-2.2.1.gguf create mode 100644 q4_0-tinyairoboros-1.1b-2.2.1.gguf create mode 100644 q6_k-tinyairoboros-1.1b-2.2.1.gguf create mode 100644 q8_0-tinyairoboros-1.1b-2.2.1.gguf diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..412afd6 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,39 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +q4_0-tinyairoboros-1.1b-2.2.1.gguf filter=lfs diff=lfs merge=lfs -text +q8_0-tinyairoboros-1.1b-2.2.1.gguf filter=lfs diff=lfs merge=lfs -text +q6_k-tinyairoboros-1.1b-2.2.1.gguf filter=lfs diff=lfs merge=lfs -text +q2_k-tinyairoboros-1.1b-2.2.1.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..4f5243b --- /dev/null +++ b/README.md @@ -0,0 +1,36 @@ +--- +datasets: +- jondurbin/airoboros-2.2.1 +tags: +- airoboros +- tinyllama +--- + +Some GGUF v3 quantizations of the model [aloobun/TinyAiroboros-2.2.1](https://huggingface.co/aloobun/TinyAiroboros-2.2.1) + +This model is a fine-tuned version of PY007/TinyLlama-1.1B-Chat-v0.3 (finetuned on 15k rows of airoboros-2.2.1 dataset) + +## lm-eval + +``` +| Task |Version| Metric |Value | |Stderr| +|-------------|------:|--------|-----:|---|-----:| +|arc_challenge| 0|acc |0.2671|± |0.0129| +| | |acc_norm|0.2850|± |0.0132| +|arc_easy | 0|acc |0.5673|± |0.0102| +| | |acc_norm|0.5109|± |0.0103| +|boolq | 1|acc |0.6040|± |0.0086| +|hellaswag | 0|acc |0.4155|± |0.0049| +| | |acc_norm|0.5420|± |0.0050| +|openbookqa | 0|acc |0.2200|± |0.0185| +| | |acc_norm|0.3420|± |0.0212| +|piqa | 0|acc |0.7057|± |0.0106| +| | |acc_norm|0.6970|± |0.0107| +|winogrande | 0|acc |0.5714|± |0.0139| + +``` +## Usage: +It uses the llama2 prompt format. +``` +[INST] Write a short story about a dystopian society. [/INST] +``` \ No newline at end of file diff --git a/q2_k-tinyairoboros-1.1b-2.2.1.gguf b/q2_k-tinyairoboros-1.1b-2.2.1.gguf new file mode 100644 index 0000000..960653a --- /dev/null +++ b/q2_k-tinyairoboros-1.1b-2.2.1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9a6257b1566432e67162ffb3cbd553c5a418524a571f1510a69304cebec428c0 +size 482149888 diff --git a/q4_0-tinyairoboros-1.1b-2.2.1.gguf b/q4_0-tinyairoboros-1.1b-2.2.1.gguf new file mode 100644 index 0000000..51fc1a3 --- /dev/null +++ b/q4_0-tinyairoboros-1.1b-2.2.1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d7252dd2ba0eb781a40c58a477e633c439b2961b3c056b15269120aaedfe0862 +size 636734368 diff --git a/q6_k-tinyairoboros-1.1b-2.2.1.gguf b/q6_k-tinyairoboros-1.1b-2.2.1.gguf new file mode 100644 index 0000000..93fe586 --- /dev/null +++ b/q6_k-tinyairoboros-1.1b-2.2.1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5c1a9c9727fb1737e859e77181d12998a049dd3eb4e4cc21b51bad9d0d76b412 +size 903422432 diff --git a/q8_0-tinyairoboros-1.1b-2.2.1.gguf b/q8_0-tinyairoboros-1.1b-2.2.1.gguf new file mode 100644 index 0000000..b5ad58a --- /dev/null +++ b/q8_0-tinyairoboros-1.1b-2.2.1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f36b185b9379a7fdce0c224170319821ab315ebdf42565dc747ec75e81f86c49 +size 1169821024