初始化项目，由ModelHub XC社区提供模型

Model: featherless-ai-quants/tmd-rahul-tinyllama-chatbot-merged-v6-GGUF Source: Original Platform
2026-04-11 23:58:58 +08:00
commit a2e8c295be
14 changed files with 130 additions and 0 deletions
--- a/.gitattributes
+++ b/.gitattributes
@@ -0,0 +1,47 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+featherless-quants.png filter=lfs diff=lfs merge=lfs -text
+tmd-rahul-tinyllama-chatbot-merged-v6-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+tmd-rahul-tinyllama-chatbot-merged-v6-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+tmd-rahul-tinyllama-chatbot-merged-v6-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+tmd-rahul-tinyllama-chatbot-merged-v6-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+tmd-rahul-tinyllama-chatbot-merged-v6-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+tmd-rahul-tinyllama-chatbot-merged-v6-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+tmd-rahul-tinyllama-chatbot-merged-v6-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+tmd-rahul-tinyllama-chatbot-merged-v6-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
--- a/README.md
+++ b/README.md
@@ -0,0 +1,47 @@
+---
+base_model: tmd-rahul/tinyllama-chatbot-merged-v6
+pipeline_tag: text-generation
+quantized_by: featherless-ai-quants
+---
+
+# tmd-rahul/tinyllama-chatbot-merged-v6 GGUF Quantizations 🚀
+
+![Featherless AI Quants](./featherless-quants.png)
+
+*Optimized GGUF quantization files for enhanced model performance*
+
+> Powered by [Featherless AI](https://featherless.ai) - run any model you'd like for a simple small fee.
+---
+
+## Available Quantizations 📊
+
+| Quantization Type | File | Size |
+|-------------------|------|------|
+| IQ4_XS | [tmd-rahul-tinyllama-chatbot-merged-v6-IQ4_XS.gguf](https://huggingface.co/featherless-ai-quants/tmd-rahul-tinyllama-chatbot-merged-v6-GGUF/blob/main/tmd-rahul-tinyllama-chatbot-merged-v6-IQ4_XS.gguf) | 581.56 MB |
+| Q2_K | [tmd-rahul-tinyllama-chatbot-merged-v6-Q2_K.gguf](https://huggingface.co/featherless-ai-quants/tmd-rahul-tinyllama-chatbot-merged-v6-GGUF/blob/main/tmd-rahul-tinyllama-chatbot-merged-v6-Q2_K.gguf) | 412.11 MB |
+| Q3_K_L | [tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_L.gguf](https://huggingface.co/featherless-ai-quants/tmd-rahul-tinyllama-chatbot-merged-v6-GGUF/blob/main/tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_L.gguf) | 564.12 MB |
+| Q3_K_M | [tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_M.gguf](https://huggingface.co/featherless-ai-quants/tmd-rahul-tinyllama-chatbot-merged-v6-GGUF/blob/main/tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_M.gguf) | 523.00 MB |
+| Q3_K_S | [tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_S.gguf](https://huggingface.co/featherless-ai-quants/tmd-rahul-tinyllama-chatbot-merged-v6-GGUF/blob/main/tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_S.gguf) | 476.21 MB |
+| Q4_K_M | [tmd-rahul-tinyllama-chatbot-merged-v6-Q4_K_M.gguf](https://huggingface.co/featherless-ai-quants/tmd-rahul-tinyllama-chatbot-merged-v6-GGUF/blob/main/tmd-rahul-tinyllama-chatbot-merged-v6-Q4_K_M.gguf) | 636.88 MB |
+| Q4_K_S | [tmd-rahul-tinyllama-chatbot-merged-v6-Q4_K_S.gguf](https://huggingface.co/featherless-ai-quants/tmd-rahul-tinyllama-chatbot-merged-v6-GGUF/blob/main/tmd-rahul-tinyllama-chatbot-merged-v6-Q4_K_S.gguf) | 610.23 MB |
+| Q5_K_M | [tmd-rahul-tinyllama-chatbot-merged-v6-Q5_K_M.gguf](https://huggingface.co/featherless-ai-quants/tmd-rahul-tinyllama-chatbot-merged-v6-GGUF/blob/main/tmd-rahul-tinyllama-chatbot-merged-v6-Q5_K_M.gguf) | 745.82 MB |
+| Q5_K_S | [tmd-rahul-tinyllama-chatbot-merged-v6-Q5_K_S.gguf](https://huggingface.co/featherless-ai-quants/tmd-rahul-tinyllama-chatbot-merged-v6-GGUF/blob/main/tmd-rahul-tinyllama-chatbot-merged-v6-Q5_K_S.gguf) | 730.54 MB |
+| Q6_K | [tmd-rahul-tinyllama-chatbot-merged-v6-Q6_K.gguf](https://huggingface.co/featherless-ai-quants/tmd-rahul-tinyllama-chatbot-merged-v6-GGUF/blob/main/tmd-rahul-tinyllama-chatbot-merged-v6-Q6_K.gguf) | 861.56 MB |
+| Q8_0 | [tmd-rahul-tinyllama-chatbot-merged-v6-Q8_0.gguf](https://huggingface.co/featherless-ai-quants/tmd-rahul-tinyllama-chatbot-merged-v6-GGUF/blob/main/tmd-rahul-tinyllama-chatbot-merged-v6-Q8_0.gguf) | 1115.62 MB |
+
+
+---
+
+## ⚡ Powered by [Featherless AI](https://featherless.ai)
+
+### Key Features
+
+- 🔥 **Instant Hosting** - Deploy any Llama model on HuggingFace instantly
+- 🛠️ **Zero Infrastructure** - No server setup or maintenance required
+- 📚 **Vast Compatibility** - Support for 2400+ models and counting
+- 💎 **Affordable Pricing** - Starting at just $10/month
+
+---
+
+**Links:**  
+[Get Started](https://featherless.ai) | [Documentation](https://featherless.ai/docs) | [Models](https://featherless.ai/models)
--- a/featherless-quants.png
+++ b/featherless-quants.png
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e1b4d66c8306c7b0614089381fdf86ea4efb02dffb78d22767a084cb8b88d6b
+size 1614532
--- a/tmd-rahul-tinyllama-chatbot-merged-v6-IQ4_XS.gguf
+++ b/tmd-rahul-tinyllama-chatbot-merged-v6-IQ4_XS.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4f410c98a89b348c397adf2a7818f520f1281db24f55caf170d5ecb57c943630
+size 609807808
--- a/tmd-rahul-tinyllama-chatbot-merged-v6-Q2_K.gguf
+++ b/tmd-rahul-tinyllama-chatbot-merged-v6-Q2_K.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:212aa76939f354127d722989669a84a61474491e00c392a0bfde762e0bb6ad29
+size 432131520
--- a/tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_L.gguf
+++ b/tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_L.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5488688dad603d4b63b2029d7c1db79ca2d544ecbf0c1240cb4e5eabf3dcc9fb
+size 591527360
--- a/tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_M.gguf
+++ b/tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3dfcf4d0852e98886320feee75eca195f141e2e809d9fd2013b430d967a7e531
+size 548404672
--- a/tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_S.gguf
+++ b/tmd-rahul-tinyllama-chatbot-merged-v6-Q3_K_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b7bd88054bface2fcd606deb6e6cd93047e5ac1913d3e2184aeca77d5222de25
+size 499342784
--- a/tmd-rahul-tinyllama-chatbot-merged-v6-Q4_K_M.gguf
+++ b/tmd-rahul-tinyllama-chatbot-merged-v6-Q4_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a41f4ea0b89e686177c7b16bc9edebbfdd4b1faf8c5d2eab3b6b35cff8ab7ee3
+size 667815360
--- a/tmd-rahul-tinyllama-chatbot-merged-v6-Q4_K_S.gguf
+++ b/tmd-rahul-tinyllama-chatbot-merged-v6-Q4_K_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4cf6989a24e1927d381b0620f618dd34f20630146306e0fe1f0ae3f1148c1e04
+size 639872448
--- a/tmd-rahul-tinyllama-chatbot-merged-v6-Q5_K_M.gguf
+++ b/tmd-rahul-tinyllama-chatbot-merged-v6-Q5_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:79519da07e1a88060d4dd52c18a30fd1672c2b17765bfe78b2c671dba931b7fa
+size 782044608
--- a/tmd-rahul-tinyllama-chatbot-merged-v6-Q5_K_S.gguf
+++ b/tmd-rahul-tinyllama-chatbot-merged-v6-Q5_K_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3898b39fd8e93f9bd06ee628b440157f1df16db5dfb65e1e6480825678938b23
+size 766029248
--- a/tmd-rahul-tinyllama-chatbot-merged-v6-Q6_K.gguf
+++ b/tmd-rahul-tinyllama-chatbot-merged-v6-Q6_K.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2895387b3dadbb5bf8ca7b3e97eecc1e426a846b49b8d7693b682011d9f90a2b
+size 903413184
--- a/tmd-rahul-tinyllama-chatbot-merged-v6-Q8_0.gguf
+++ b/tmd-rahul-tinyllama-chatbot-merged-v6-Q8_0.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:19badf3e700fd1901128f3be544b9aeb1b608a713bbe786b47ab019e38a6571e
+size 1169808832