初始化项目，由ModelHub XC社区提供模型

Model: Aryanne/TinyAiroboros-1.1B-2.2.1-gguf
Source: Original Platform

.gitattributes

@@ -0,0 +1,39 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+q4_0-tinyairoboros-1.1b-2.2.1.gguf filter=lfs diff=lfs merge=lfs -text
+q8_0-tinyairoboros-1.1b-2.2.1.gguf filter=lfs diff=lfs merge=lfs -text
+q6_k-tinyairoboros-1.1b-2.2.1.gguf filter=lfs diff=lfs merge=lfs -text
+q2_k-tinyairoboros-1.1b-2.2.1.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,36 @@
+---
+datasets:
+- jondurbin/airoboros-2.2.1
+tags:
+- airoboros
+- tinyllama
+---
+
+Some GGUF v3 quantizations of the model [aloobun/TinyAiroboros-2.2.1](https://huggingface.co/aloobun/TinyAiroboros-2.2.1)
+
+This model is a fine-tuned version of PY007/TinyLlama-1.1B-Chat-v0.3 (finetuned on 15k rows of airoboros-2.2.1 dataset)
+
+## lm-eval
+
+```
+|    Task     |Version| Metric |Value |   |Stderr|
+|-------------|------:|--------|-----:|---|-----:|
+|arc_challenge|      0|acc     |0.2671|±  |0.0129|
+|             |       |acc_norm|0.2850|±  |0.0132|
+|arc_easy     |      0|acc     |0.5673|±  |0.0102|
+|             |       |acc_norm|0.5109|±  |0.0103|
+|boolq        |      1|acc     |0.6040|±  |0.0086|
+|hellaswag    |      0|acc     |0.4155|±  |0.0049|
+|             |       |acc_norm|0.5420|±  |0.0050|
+|openbookqa   |      0|acc     |0.2200|±  |0.0185|
+|             |       |acc_norm|0.3420|±  |0.0212|
+|piqa         |      0|acc     |0.7057|±  |0.0106|
+|             |       |acc_norm|0.6970|±  |0.0107|
+|winogrande   |      0|acc     |0.5714|±  |0.0139|
+
+```
+## Usage:
+It uses the llama2 prompt format.
+```
+[INST] Write a short story about a dystopian society. [/INST]
+```

q2_k-tinyairoboros-1.1b-2.2.1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9a6257b1566432e67162ffb3cbd553c5a418524a571f1510a69304cebec428c0
+size 482149888

q4_0-tinyairoboros-1.1b-2.2.1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7252dd2ba0eb781a40c58a477e633c439b2961b3c056b15269120aaedfe0862
+size 636734368

q6_k-tinyairoboros-1.1b-2.2.1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5c1a9c9727fb1737e859e77181d12998a049dd3eb4e4cc21b51bad9d0d76b412
+size 903422432

q8_0-tinyairoboros-1.1b-2.2.1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f36b185b9379a7fdce0c224170319821ab315ebdf42565dc747ec75e81f86c49
+size 1169821024