uploaded readme

uploaded model
2025-02-22 23:37:28 +00:00 · 2025-02-22 23:37:25 +00:00 · 2025-02-22 23:36:28 +00:00 · 2025-02-22 23:35:23 +00:00 · 2025-02-22 23:34:33 +00:00 · 2025-02-22 23:33:34 +00:00
11 changed files with 138 additions and 0 deletions
--- a/.gitattributes
+++ b/.gitattributes
@@ -46,3 +46,12 @@ openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_0.gguf filter=lfs diff=lfs merge=lfs -te
 openai-gsm8k_meta-llama-Llama-3.2-1B.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
 openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
+openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
+openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
+openai-gsm8k_meta-llama-Llama-3.2-1B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+openai-gsm8k_meta-llama-Llama-3.2-1B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
--- a/README.md
+++ b/README.md
@@ -0,0 +1,102 @@
+Quantization made by Richard Erkhov.
+
+[Github](https://github.com/RichardErkhov)
+
+[Discord](https://discord.gg/pvy7H8DZMG)
+
+[Request more models](https://github.com/RichardErkhov/quant_request)
+
+
+openai-gsm8k_meta-llama-Llama-3.2-1B - GGUF
+- Model creator: https://huggingface.co/YWZBrandon/
+- Original model: https://huggingface.co/YWZBrandon/openai-gsm8k_meta-llama-Llama-3.2-1B/
+
+
+| Name | Quant method | Size |
+| ---- | ---- | ---- |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q2_K.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q2_K.gguf) | Q2_K | 0.54GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.IQ3_XS.gguf) | IQ3_XS | 0.58GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.IQ3_S.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.IQ3_S.gguf) | IQ3_S | 0.6GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q3_K_S.gguf) | Q3_K_S | 0.6GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.IQ3_M.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.IQ3_M.gguf) | IQ3_M | 0.61GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q3_K.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q3_K.gguf) | Q3_K | 0.64GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q3_K_M.gguf) | Q3_K_M | 0.64GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q3_K_L.gguf) | Q3_K_L | 0.68GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.IQ4_XS.gguf) | IQ4_XS | 0.7GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_0.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_0.gguf) | Q4_0 | 0.72GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.IQ4_NL.gguf) | IQ4_NL | 0.72GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_K_S.gguf) | Q4_K_S | 0.72GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_K.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_K.gguf) | Q4_K | 0.75GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_K_M.gguf) | Q4_K_M | 0.75GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_1.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_1.gguf) | Q4_1 | 0.77GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_0.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_0.gguf) | Q5_0 | 0.83GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K_S.gguf) | Q5_K_S | 0.83GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K.gguf) | Q5_K | 0.85GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K_M.gguf) | Q5_K_M | 0.85GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_1.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_1.gguf) | Q5_1 | 0.89GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q6_K.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q6_K.gguf) | Q6_K | 0.95GB |
+| [openai-gsm8k_meta-llama-Llama-3.2-1B.Q8_0.gguf](https://huggingface.co/RichardErkhov/YWZBrandon_-_openai-gsm8k_meta-llama-Llama-3.2-1B-gguf/blob/main/openai-gsm8k_meta-llama-Llama-3.2-1B.Q8_0.gguf) | Q8_0 | 1.23GB |
+
+
+
+
+Original model description:
+---
+base_model: meta-llama/Llama-3.2-1B
+datasets: openai/gsm8k
+library_name: transformers
+model_name: openai-gsm8k_meta-llama-Llama-3.2-1B
+tags:
+- generated_from_trainer
+- trl
+- sft
+licence: license
+---
+
+# Model Card for openai-gsm8k_meta-llama-Llama-3.2-1B
+
+This model is a fine-tuned version of [meta-llama/Llama-3.2-1B](https://huggingface.co/meta-llama/Llama-3.2-1B) on the [openai/gsm8k](https://huggingface.co/datasets/openai/gsm8k) dataset.
+It has been trained using [TRL](https://github.com/huggingface/trl).
+
+## Quick start
+
+```python
+from transformers import pipeline
+
+question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
+generator = pipeline("text-generation", model="YWZBrandon/openai-gsm8k_meta-llama-Llama-3.2-1B", device="cuda")
+output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
+print(output["generated_text"])
+```
+
+## Training procedure
+
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yuweiz/ActionEditV1/runs/fz4agnju)
+
+This model was trained with SFT.
+
+### Framework versions
+
+- TRL: 0.12.2
+- Transformers: 4.46.3
+- Pytorch: 2.5.1
+- Datasets: 3.1.0
+- Tokenizers: 0.20.3
+
+## Citations
+
+
+
+Cite TRL as:
+    
+```bibtex
+@misc{vonwerra2022trl,
+	title        = {{TRL: Transformer Reinforcement Learning}},
+	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallouédec},
+	year         = 2020,
+	journal      = {GitHub repository},
+	publisher    = {GitHub},
+	howpublished = {\url{https://github.com/huggingface/trl}}
+}
+```
+
--- a/openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_1.gguf
+++ b/openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_1.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99c4c8ba0d76d86c6e982711710070a00cff2caf15860e1245debeb682c2e2e9
+size 831742368
--- a/openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_K_M.gguf
+++ b/openai-gsm8k_meta-llama-Llama-3.2-1B.Q4_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf43ca106dfcbb38d87fbe490d4af571e26aab800dc54ab2513d08eb2b527f5e
+size 807690656
--- a/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_0.gguf
+++ b/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_0.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0002b7171bee426c629245fffea6a3e71426df29ed832fb5387be7019d6580dc
+size 892559776
--- a/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_1.gguf
+++ b/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_1.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:379e1b9d46ccdcfb057141cb1b694ad31b96470398e3125667f70689caec097e
+size 953377184
--- a/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K.gguf
+++ b/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e5b374e111cf75f6ee1ee07f6c9abdc3aa3cee01f1c576495b94d981d409176
+size 911499680
--- a/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K_M.gguf
+++ b/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e5b374e111cf75f6ee1ee07f6c9abdc3aa3cee01f1c576495b94d981d409176
+size 911499680
--- a/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K_S.gguf
+++ b/openai-gsm8k_meta-llama-Llama-3.2-1B.Q5_K_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0b1bc7fafbca23b76fa988a1de1c2c9da1b68906c7da7f7c0cc2ce8d4974be9f
+size 892559776
--- a/openai-gsm8k_meta-llama-Llama-3.2-1B.Q6_K.gguf
+++ b/openai-gsm8k_meta-llama-Llama-3.2-1B.Q6_K.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2109e55adc7558068ac44ff52b45cce78c2dc143c78e0f0a403e9863b17b1f77
+size 1021796768
--- a/openai-gsm8k_meta-llama-Llama-3.2-1B.Q8_0.gguf
+++ b/openai-gsm8k_meta-llama-Llama-3.2-1B.Q8_0.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:50ac1cd4f222046cb2f88b38d9cf662429ef4f24ea03545f2344c4923b9e6d66
+size 1321079200
Author	SHA1	Message	Date
Richard Erkhov	5082a89dd6	uploaded readme	2025-02-22 23:37:28 +00:00
Richard Erkhov	ac925eaebf	uploaded model	2025-02-22 23:37:25 +00:00
Richard Erkhov	e198315095	uploaded model	2025-02-22 23:36:28 +00:00
Richard Erkhov	cc7a5617c4	uploaded model	2025-02-22 23:35:23 +00:00
Richard Erkhov	be76fdf2c4	uploaded model	2025-02-22 23:34:33 +00:00
Richard Erkhov	b6df20c4e2	uploaded model	2025-02-22 23:33:34 +00:00
Richard Erkhov	d6a80bee25	uploaded model	2025-02-22 23:32:15 +00:00
Richard Erkhov	c56b87f88f	uploaded model	2025-02-22 23:31:06 +00:00
Richard Erkhov	838e9fc720	uploaded model	2025-02-22 23:30:15 +00:00
Richard Erkhov	0702b7c293	uploaded model	2025-02-22 23:29:24 +00:00