commit 58f0a6b93f9dfcf55e1dcc385171ecd79a937b13 Author: ModelHub XC Date: Sat Apr 11 09:52:55 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: afrideva/TinyMistral-248M-Alpaca-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..ab73026 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,42 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +tinymistral-248m-alpaca.fp16.gguf filter=lfs diff=lfs merge=lfs -text +tinymistral-248m-alpaca.q2_k.gguf filter=lfs diff=lfs merge=lfs -text +tinymistral-248m-alpaca.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text +tinymistral-248m-alpaca.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text +tinymistral-248m-alpaca.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text +tinymistral-248m-alpaca.q6_k.gguf filter=lfs diff=lfs merge=lfs -text +tinymistral-248m-alpaca.q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..e021858 --- /dev/null +++ b/README.md @@ -0,0 +1,85 @@ +--- +base_model: Felladrin/TinyMistral-248M-Alpaca +datasets: +- tatsu-lab/alpaca +inference: false +license: apache-2.0 +model_creator: Felladrin +model_name: TinyMistral-248M-Alpaca +pipeline_tag: text-generation +quantized_by: afrideva +tags: +- autotrain +- text-generation +- gguf +- ggml +- quantized +- q2_k +- q3_k_m +- q4_k_m +- q5_k_m +- q6_k +- q8_0 +widget: +- text: 'Below is an instruction that describes a task. Write a response that appropriately + completes the request. + + + ### Instruction: + + Tell me all you know about the Earth. + + + ### Response:' +--- +# Felladrin/TinyMistral-248M-Alpaca-GGUF + +Quantized GGUF model files for [TinyMistral-248M-Alpaca](https://huggingface.co/Felladrin/TinyMistral-248M-Alpaca) from [Felladrin](https://huggingface.co/Felladrin) + + +| Name | Quant method | Size | +| ---- | ---- | ---- | +| [tinymistral-248m-alpaca.q2_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q2_k.gguf) | q2_k | 115.26 MB | +| [tinymistral-248m-alpaca.q3_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q3_k_m.gguf) | q3_k_m | 130.08 MB | +| [tinymistral-248m-alpaca.q4_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q4_k_m.gguf) | q4_k_m | 155.67 MB | +| [tinymistral-248m-alpaca.q5_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q5_k_m.gguf) | q5_k_m | 179.23 MB | +| [tinymistral-248m-alpaca.q6_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q6_k.gguf) | q6_k | 204.26 MB | +| [tinymistral-248m-alpaca.q8_0.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q8_0.gguf) | q8_0 | 264.32 MB | + + + +## Original Model Card: +# Locutusque's TinyMistral-248M Trained trained on the Alpaca dataset using AutoTrain + +- Base model: [Locutusque/TinyMistral-248M](https://huggingface.co/Locutusque/TinyMistral-248M) +- Dataset: [tatsu-lab/alpaca](https://huggingface.co/datasets/tatsu-lab/alpaca) +- Trained for 3 epochs. + +## Prompt format + +The training used these two following formats. + +### Prompt format #1 + +``` +Below is an instruction that describes a task. Write a response that appropriately completes the request. + +### Instruction: + + +### Response: +``` + +### Prompt format #2 + +``` +Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request. + +### Instruction: + + +### Input: + + +### Response: +``` \ No newline at end of file diff --git a/tinymistral-248m-alpaca.fp16.gguf b/tinymistral-248m-alpaca.fp16.gguf new file mode 100644 index 0000000..bb4cd66 --- /dev/null +++ b/tinymistral-248m-alpaca.fp16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a50690219e0174ccd795b370e79df5ada82d2e88484aabe529966a8657489dce +size 496815296 diff --git a/tinymistral-248m-alpaca.q2_k.gguf b/tinymistral-248m-alpaca.q2_k.gguf new file mode 100644 index 0000000..dcc1e3a --- /dev/null +++ b/tinymistral-248m-alpaca.q2_k.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:540f113dfce2ad298d3855018a69cf2556c671d5780147f481efd1969c32b7b5 +size 115262144 diff --git a/tinymistral-248m-alpaca.q3_k_m.gguf b/tinymistral-248m-alpaca.q3_k_m.gguf new file mode 100644 index 0000000..206a251 --- /dev/null +++ b/tinymistral-248m-alpaca.q3_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b1f362ec36aac81676bc0ff4079e31bf0f0b57dd28cdcf77c20f4ce33eca8549 +size 130075648 diff --git a/tinymistral-248m-alpaca.q4_k_m.gguf b/tinymistral-248m-alpaca.q4_k_m.gguf new file mode 100644 index 0000000..71af160 --- /dev/null +++ b/tinymistral-248m-alpaca.q4_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:314ebcbde83deb60398bf6bf2969e61793d3841d88bfa9a1fcad1e594eb57b54 +size 155665792 diff --git a/tinymistral-248m-alpaca.q5_k_m.gguf b/tinymistral-248m-alpaca.q5_k_m.gguf new file mode 100644 index 0000000..19e4bac --- /dev/null +++ b/tinymistral-248m-alpaca.q5_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:129a21cbbabd5aaebe139fe1f138727494f9a11c70ab86ef0a95e5470464847f +size 179226368 diff --git a/tinymistral-248m-alpaca.q6_k.gguf b/tinymistral-248m-alpaca.q6_k.gguf new file mode 100644 index 0000000..6b32176 --- /dev/null +++ b/tinymistral-248m-alpaca.q6_k.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bc0ade64cafa06590ed851005d34d243033a0f134074ded34fe0bde66feec731 +size 204259488 diff --git a/tinymistral-248m-alpaca.q8_0.gguf b/tinymistral-248m-alpaca.q8_0.gguf new file mode 100644 index 0000000..e9cbe18 --- /dev/null +++ b/tinymistral-248m-alpaca.q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3bdb5ee3ca1304389fbb1ceb9607e80beacc3211da7e23aab1d0e7d011331973 +size 264320608