初始化项目，由ModelHub XC社区提供模型

Model: ArindamSingh/gemma-3-1b-it-medical-o1-reasoning-finetune-16bit
Source: Original Platform

.gitattributes

@@ -0,0 +1,36 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,117 @@
+---
+base_model: unsloth/gemma-3-1b-it
+tags:
+- text-generation-inference
+- transformers
+- unsloth
+- gemma3_text
+license: apache-2.0
+language:
+- en
+---
+
+# ArindamSingh/gemma-3-1b-it-medical-o1-reasoning-finetune-16bit
+
+- **Developed by:** ArindamSingh
+- **License:** apache-2.0
+- **Finetuned from model :** unsloth/gemma-3-1b-it
+
+This gemma-3-1b-it-medical-o1-reasoning-finetune-16bit model was trained with Unsloth and Huggingface's TRL library.
+
+Finetuned one of my own as could not find one on internet, at the time of finetuning there were no gemma3 finetunes for medical dataset, esp. on medical reasoning.
+
+### 1. Model Card Snapshot
+
+|  | Details |
+| :-- | :-- |
+| **Base model** | `google/gemma-3-1b-it` |
+| **Parameter count** | 1 B (full) – LoRA rank 8 adapters merged |
+| **Precision** | 16-bit (`fp16`) |
+| **Domain** | Clinical \& biomedical reasoning |
+| **Fine-tuning stack** | FreedomIntelligence **Medical-O1 Reasoning (20 k Q-CoT-A)** + *Unsloth* LoRA |
+| **Training recipe** | Supervised CoT SFT → LoRA merge \& quantize |
+| **Last updated** | *See HF page* |
+| **License** | Apache-2.0 |
+
+### 2. What’s New vs. Base Gemma-3 1B-IT
+
+* **Chain-of-Thought answers** (step-by-step rationales) thanks to Medical-O1 dataset.
+* **Unsloth** accelerated LoRA cut training wall-time by ~40% on a single A100.
+* **Merged weights** – no adapter step required; drop-in replacement for Gemma.
+* **Tiny footprint** – < 2 GB download; runs in ≤ 4 GB VRAM or CPU via GGUF/HF library.
+
+
+### 3. Intended Use
+
+| ✔️ **Intended** | ❌ **Use with caution / Out-of-scope** |
+| :-- | :-- |
+| Medical education, PubMed triage, coding suggestions (ICD, SNOMED), research ideation | Automated diagnosis, emergency triage, any decision requiring regulatory clearance |
+
+### 4. Quick Start
+
+```python
+from transformers import pipeline
+
+msg = "What is type 2 diabetes?"
+
+pipe = pipeline("text-generation", model="ArindamSingh/gemma-3-1b-it-medical-o1-reasoning-finetune-16bit")
+messages = [
+    {"role": "user", "content": msg},
+]
+pipe(messages)
+```
+
+
+### 5. Fine-tuning Overview
+
+| Item | Setting |
+| :-- | :-- |
+| **Dataset** | FreedomIntelligence/`medical-o1-reasoning-SFT` (19 704 rows) |
+| **Prompt format** | `Question` + `Complex_CoT` → `Response` |
+| **Library** | *Unsloth* 0.6 + 8-bit **paged_adamw** |
+| **LoRA config** | r = 8, α = 32, dropout = 0.05 (q/k/v/o \& MLP proj) |
+| **Hardware** | 2 × T4-16 GB (flash-attn 2) |
+| **Training** | 3 epochs -  LR = 2 e-5 cosine -  batch = 1 × 4 grad-accum |
+| **Runtime** | ~4 h (Unsloth vs. ~6.5 h vanilla PEFT) |
+
+### 6. Evaluation Highlights<sup>*</sup>
+
+| Task (dev subsets) | Metric | Base Gemma-1B-IT | **This model** |
+| :-- | :-- | :-- | :-- |
+| PubMedQA | QA-F1 | 46% | **57%** |
+
+<sup>*100-Q samples, greedy decoding; scripts in `eval/`.</sup>
+
+### 7. Limitations \& Biases
+
+* Possible hallucination of citations or outdated guidelines.
+* English-centric dataset; limited pediatrics / rare diseases coverage.
+* Not a medical device – always keep a human in the loop.
+
+
+### 8. Responsible-AI Checklist
+
+- [x] Human review before clinical use
+- [x] “Not medical advice” disclaimer
+
+
+### 9. Citation
+
+```bibtex
+@misc{singh2025gemma1bmed,
+  title   = {Gemma-3 1B Medical-O1: Compact Chain-of-Thought Clinical LLM},
+  author  = {Arindam Singh},
+  year    = {2025},
+  url     = {https://huggingface.co/ArindamSingh/gemma-3-1b-it-medical-o1-reasoning-finetune-16bit}
+}
+```
+
+
+### 10. Acknowledgements
+
+Google DeepMind (Gemma), FreedomIntelligence (Medical-O1 dataset), the Unsloth team, Kaggle, Google Colab and Hugging Face for the open ecosystem.
+
+### 11. Sample Output
+[{'generated_text': [{'role': 'user', 'content': 'What is type 2 diabetes?'},
+   {'role': 'assistant',
+    'content': "Okay, let's break down type 2 diabetes. It's a complex condition, but here's a comprehensive explanation:\n\n**What is Type 2 Diabetes?**\n\nType 2 diabetes is a chronic metabolic disorder in which the body doesn't use insulin properly. Insulin is a hormone produced by the pancreas that helps glucose (sugar) from food get into your cells to be used for energy. When insulin resistance develops, the pancreas has to work harder to produce more insulin to compensate, and eventually, it can't keep up with the demand.\n\n**Here's a more detailed breakdown:**\n\n1. **It's Not About Insulin Resistance (Initially):**  The key difference between type 1 and type 2 diabetes is *how* the body handles insulin.\n   * **Type 1 Diabetes:** This is an autoimmune condition where the body's immune system attacks and destroys the insulin-producing cells (beta cells) in the pancreas.  People with type 1 diabetes *require* insulin injections or pump to survive.\n   * **Type 2 Diabetes:**  This is a process where the body becomes resistant to insulin, and the pancreas initially tries to compensate by producing more insulin. Over time, the pancreas can't keep up, and blood sugar levels rise.\n\n2. **How it Develops:**\n   * **Lifestyle Factors:**  Type 2 diabetes often develops gradually, often as a result of a combination of:\n      * **Genetics:**  A family history of diabetes increases your risk.\n      * **Diet:**  A diet high in processed foods, sugary drinks, and unhealthy fats can contribute.\n      * **Lack of Exercise:**  Being physically inactive increases your risk.\n      * **Obesity:** Excess weight, particularly around the abdomen, is strongly linked to insulin resistance.\n   * **Pancreatic Dysfunction:**  As the pancreas struggles to produce enough insulin, it can gradually lose its ability to do so effectively.\n\n3. **Symptoms:**  Many people with type 2 diabetes have no noticeable symptoms for months or even years.  However, as the condition progresses, symptoms can develop:\n   * **Frequent Urination:**  The kidneys try to get rid of excess sugar in the urine.\n   * **Excessive Thirst:**  Due to the body’s attempt to regulate fluid balance.\n   * **Increased Hunger:**  The body isn't using glucose effectively.\n   * **Fatigue:**  Lack of energy.\n   * **Blurred Vision:**  High blood sugar can affect the lens of the eye.\n   * **Slow-Healing Sores:** High blood sugar can impair wound healing.\n   * **Frequent Infections:** High blood sugar can weaken the immune system.\n\n4. **Complications (if not managed):**  If left untreated, type 2 diabetes can lead to serious health problems:\n   * **Cardiovascular Disease:** Heart disease, stroke.\n   * **Neuropathy:** Nerve damage, causing pain, numbness, and tingling (especially in the hands and feet).\n   * **Nephropathy:** Kidney disease.\n   * **Retinopathy:** Eye damage.\n   * **Foot Problems:**  Poor circulation and nerve damage can lead to infections and ulcers.\n\n**Diagnosis:**\n\n* **Blood Tests:**  A fasting blood glucose test is the primary test.  A random blood glucose test can also be done.\n* **A1C Test:** This tests your average blood sugar level over the past 2-3 months.\n\n**Treatment:**\n\n* **Lifestyle Changes:**  Diet and exercise are crucial.\n* **Metformin:**  A common medication that helps lower blood sugar.\n* **Other Medications:**  Oral medications, insulin injections, or a combination of these may be needed.\n* **Regular Monitoring:**  Blood sugar levels need to be monitored regularly to adjust treatment as needed.\n\n**Important Note:**  This information is for general knowledge and informational purposes only, and does not constitute medical advice. It is essential to consult with a qualified healthcare professional for any health concerns or before making any decisions related to your health or treatment.\n\n**Resources:**\n\n* **American Diabetes Association:** [https://www.diabetes.org/](https://www.diabetes.org/)\n* **Centers for Disease Control and Prevention (CDC) - Diabetes:** [https://www.cdc.gov/diabetes/index.html](https://www.cdc.gov/diabetes/index.html)\n\n---\n\n**Disclaimer:** *I am an AI Chatbot and not a medical professional. This information is intended for general knowledge and informational purposes only, and does not constitute medical advice. It is essential to consult with a qualified healthcare professional for any health concerns or before making any decisions related to your health or treatment.*\n\nTo help me give you even more tailored information, could you tell me:\n\n*   Are you interested in learning more about a specific aspect of type 2 diabetes (e.g., treatment options, prevention, symptoms)?"}]}]

added_tokens.json

@@ -0,0 +1,3 @@
+{
+  "<image_soft_token>": 262144
+}

config.json

@@ -0,0 +1,36 @@
+{
+  "architectures": [
+    "Gemma3ForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "attn_logit_softcapping": null,
+  "bos_token_id": 2,
+  "cache_implementation": "hybrid",
+  "eos_token_id": 106,
+  "final_logit_softcapping": null,
+  "head_dim": 256,
+  "hidden_activation": "gelu_pytorch_tanh",
+  "hidden_size": 1152,
+  "initializer_range": 0.02,
+  "intermediate_size": 6912,
+  "max_position_embeddings": 32768,
+  "model_type": "gemma3_text",
+  "num_attention_heads": 4,
+  "num_hidden_layers": 26,
+  "num_key_value_heads": 1,
+  "pad_token_id": 0,
+  "query_pre_attn_scalar": 256,
+  "rms_norm_eps": 1e-06,
+  "rope_local_base_freq": 10000,
+  "rope_scaling": null,
+  "rope_theta": 1000000,
+  "sliding_window": 512,
+  "sliding_window_pattern": 6,
+  "torch_dtype": "float16",
+  "transformers_version": "4.51.3",
+  "unsloth_fixed": true,
+  "unsloth_version": "2025.6.6",
+  "use_cache": true,
+  "vocab_size": 262144
+}

generation_config.json

@@ -0,0 +1,14 @@
+{
+  "bos_token_id": 2,
+  "cache_implementation": "hybrid",
+  "do_sample": true,
+  "eos_token_id": [
+    1,
+    106
+  ],
+  "max_length": 32768,
+  "pad_token_id": 0,
+  "top_k": 64,
+  "top_p": 0.95,
+  "transformers_version": "4.51.3"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:779eef2725a8760ecbf9f47c1093b0d81e43b437412de1ec978f3e0064eb5446
+size 1999810800

special_tokens_map.json

@@ -0,0 +1,33 @@
+{
+  "boi_token": "<start_of_image>",
+  "bos_token": {
+    "content": "<bos>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eoi_token": "<end_of_image>",
+  "eos_token": {
+    "content": "<end_of_turn>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "image_token": "<image_soft_token>",
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4667f2089529e8e7657cfb6d1c19910ae71ff5f28aa7ab2ff2763330affad795
+size 33384568

tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1299c11d7cf632ef3b4e11937501358ada021bbdf7c47638d13c0ee982f2e79c
+size 4689074