初始化项目，由ModelHub XC社区提供模型

Model: afrideva/Smol-Llama-101M-Chat-v1-GGUF Source: Original Platform
2026-04-22 00:04:55 +08:00
commit ffb70ffd87
9 changed files with 251 additions and 0 deletions
--- a/README.md
+++ b/README.md
@@ -0,0 +1,188 @@
+---
+base_model: Felladrin/Smol-Llama-101M-Chat-v1
+datasets:
+- Open-Orca/SlimOrca-Dedup
+- VMware/open-instruct
+- LDJnr/Capybara
+- cognitivecomputations/ultrachat-uncensored
+- starfishmedical/webGPT_x_dolly
+- THUDM/webglm-qa
+inference: false
+language:
+- en
+license: apache-2.0
+model_creator: Felladrin
+model_name: Smol-Llama-101M-Chat-v1
+pipeline_tag: text-generation
+quantized_by: afrideva
+tags:
+- text-generation
+- gguf
+- ggml
+- quantized
+- q2_k
+- q3_k_m
+- q4_k_m
+- q5_k_m
+- q6_k
+- q8_0
+widget:
+- text: '<|im_start|>system
+
+    You are a helpful assistant who gives creative responses.<|im_end|>
+
+    <|im_start|>user
+
+    Write the background story of a game about wizards and llamas in a sci-fi world.<|im_end|>
+
+    <|im_start|>assistant'
+- text: '<|im_start|>system
+
+    A friendly chat between a user and an assistant.<|im_end|>
+
+    <|im_start|>user
+
+    Got a question for you!<|im_end|>
+
+    <|im_start|>assistant
+
+    Sure! What''s it?<|im_end|>
+
+    <|im_start|>user
+
+    I need to build a simple website. Where should I start learning about web development?<|im_end|>
+
+    <|im_start|>assistant'
+- text: '<|im_start|>system
+
+    You are a helpful assistant who provides concise answers to the user''s questions.<|im_end|>
+
+    <|im_start|>user
+
+    How to become more healthy?<|im_end|>
+
+    <|im_start|>assistant'
+- text: '<|im_start|>system
+
+    You are a helpful assistant, who always answers with empathy.<|im_end|>
+
+    <|im_start|>user
+
+    List the pros and cons of social media.<|im_end|>
+
+    <|im_start|>assistant'
+- text: '<|im_start|>system
+
+    You are a helpful assistant, who always answers with empathy.<|im_end|>
+
+    <|im_start|>user
+
+    Hello!<|im_end|>
+
+    <|im_start|>assistant
+
+    Hi! How can I help you today?<|im_end|>
+
+    <|im_start|>user
+
+    Take a look at the info below.
+
+
+    - The tape inside the VHS cassettes is very delicate and can be easily ruined,
+    making them unplayable and unrepairable. The reason the tape deteriorates is that
+    the magnetic charge needed for them to work is not permanent, and the magnetic
+    particles end up losing their charge in a process known as remanence decay. These
+    particles could also become demagnetised via being stored too close to a magnetic
+    source.
+
+    - One of the most significant issues with VHS tapes is that they have moving parts,
+    meaning that there are more occasions when something can go wrong, damaging your
+    footage or preventing it from playing back. The tape itself is a prominent cause
+    of this, and tape slippage can occur. Tapes slippage can be caused when the tape
+    loses its tension, or it has become warped. These problems can occur in storage
+    due to high temperatures or frequent changes in humidity.
+
+    - VHS tapes deteriorate over time from infrequent or overuse. Neglect means mold
+    and dirt, while overuse can lead to scratches and technical difficulties. This
+    is why old VHS tapes inevitably experience malfunctions after a long period of
+    time. Usually anywhere between 10 to 25+ years.
+
+    - Some VHS tapes like newer mini DVs and Digital 8 tapes can suffer from digital
+    corruption, meaning that the footage becomes lost and cannot be recovered. These
+    tapes were the steppingstone from VHS to the digital age when capturing footage
+    straight to digital became the norm. Unfortunately,they are susceptible to digital
+    corruption, which causes video pixilation and/or loss of audio.<|im_end|>
+
+    <|im_start|>assistant
+
+    Alright!<|im_end|>
+
+    <|im_start|>user
+
+    Now I''m going to write my question, and if the info above is useful, you can
+    use them in your response.
+
+    Ready?<|im_end|>
+
+    <|im_start|>assistant
+
+    Ready for your question!<|im_end|>
+
+    <|im_start|>user
+
+    Why do VHS tapes deteriorate over time?<|im_end|>
+
+    <|im_start|>assistant'
+---
+# Felladrin/Smol-Llama-101M-Chat-v1-GGUF
+
+Quantized GGUF model files for [Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/Smol-Llama-101M-Chat-v1) from [Felladrin](https://huggingface.co/Felladrin)
+
+
+| Name | Quant method | Size |
+| ---- | ---- | ---- |
+| [smol-llama-101m-chat-v1.fp16.gguf](https://huggingface.co/afrideva/Smol-Llama-101M-Chat-v1-GGUF/resolve/main/smol-llama-101m-chat-v1.fp16.gguf) | fp16 | 204.25 MB  |
+| [smol-llama-101m-chat-v1.q2_k.gguf](https://huggingface.co/afrideva/Smol-Llama-101M-Chat-v1-GGUF/resolve/main/smol-llama-101m-chat-v1.q2_k.gguf) | q2_k | 51.90 MB  |
+| [smol-llama-101m-chat-v1.q3_k_m.gguf](https://huggingface.co/afrideva/Smol-Llama-101M-Chat-v1-GGUF/resolve/main/smol-llama-101m-chat-v1.q3_k_m.gguf) | q3_k_m | 58.04 MB  |
+| [smol-llama-101m-chat-v1.q4_k_m.gguf](https://huggingface.co/afrideva/Smol-Llama-101M-Chat-v1-GGUF/resolve/main/smol-llama-101m-chat-v1.q4_k_m.gguf) | q4_k_m | 66.38 MB  |
+| [smol-llama-101m-chat-v1.q5_k_m.gguf](https://huggingface.co/afrideva/Smol-Llama-101M-Chat-v1-GGUF/resolve/main/smol-llama-101m-chat-v1.q5_k_m.gguf) | q5_k_m | 75.31 MB  |
+| [smol-llama-101m-chat-v1.q6_k.gguf](https://huggingface.co/afrideva/Smol-Llama-101M-Chat-v1-GGUF/resolve/main/smol-llama-101m-chat-v1.q6_k.gguf) | q6_k | 84.80 MB  |
+| [smol-llama-101m-chat-v1.q8_0.gguf](https://huggingface.co/afrideva/Smol-Llama-101M-Chat-v1-GGUF/resolve/main/smol-llama-101m-chat-v1.q8_0.gguf) | q8_0 | 109.33 MB  |
+
+
+
+## Original Model Card:
+# A Llama Chat Model of 101M Parameters
+
+- Base model: [BEE-spoke-data/smol_llama-101M-GQA](https://huggingface.co/BEE-spoke-data/smol_llama-101M-GQA)
+- Datasets:
+  - [Open-Orca/SlimOrca-Dedup](https://huggingface.co/datasets/Open-Orca/SlimOrca-Dedup)
+  - [VMware/open-instruct](https://huggingface.co/datasets/VMware/open-instruct)
+  - [LDJnr/Capybara](https://huggingface.co/datasets/LDJnr/Capybara)
+  - [cognitivecomputations/ultrachat-uncensored](https://huggingface.co/datasets/cognitivecomputations/ultrachat-uncensored)
+  - [starfishmedical/webGPT_x_dolly](https://huggingface.co/datasets/starfishmedical/webGPT_x_dolly)
+  - [THUDM/webglm-qa](https://huggingface.co/datasets/THUDM/webglm-qa)
+- Availability in other ML formats:
+  - ONNX: [Felladrin/onnx-Smol-Llama-101M-Chat-v1](https://huggingface.co/Felladrin/onnx-Smol-Llama-101M-Chat-v1)
+
+## Recommended Prompt Format
+
+The recommended prompt format is as follows:
+
+```
+<|im_start|>system
+{system_message}<|im_end|>
+<|im_start|>user
+{user_message}<|im_end|>
+<|im_start|>assistant
+```
+
+## Recommended Inference Parameters
+
+To get the best results, add special tokens and prefer using [contrastive search](https://huggingface.co/docs/transformers/main/en/generation_strategies#contrastive-search) for inference:
+
+```yml
+add_special_tokens: true
+penalty_alpha: 0.5
+top_k: 5
+```