初始化项目，由ModelHub XC社区提供模型

Model: ykarout/phi-4-deepseek-r1-distilled-latest-gguf
Source: Original Platform

.gitattributes

@@ -0,0 +1,44 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+phi4-deepseek-r1-v12-q4.gguf filter=lfs diff=lfs merge=lfs -text
+phi4-deepseek-r1-v12-q5.gguf filter=lfs diff=lfs merge=lfs -text
+phi4-deepseek-r1-v12-q6.gguf filter=lfs diff=lfs merge=lfs -text
+phi4-deepseek-r1-v12-q8.gguf filter=lfs diff=lfs merge=lfs -text
+phi4-deepseek-r1-v12-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
+phi4-deepseek-r1-v12-q5_k.gguf filter=lfs diff=lfs merge=lfs -text
+phi4-deepseek-r1-v12-q6_k.gguf filter=lfs diff=lfs merge=lfs -text
+phi4-deepseek-r1-v12-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+phi4-deepseek-r1-v12-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,108 @@
+---
+license: mit
+datasets:
+- nvidia/Llama-Nemotron-Post-Training-Dataset
+language:
+- en
+- es
+- ar
+- fr
+base_model:
+- ykarout/phi4-deepseek-r1-distilled-v8-GGUF
+- microsoft/phi-4
+library_name: transformers
+tags:
+- deepseek
+- r1
+- reasoning
+- phi-4
+- math
+- code
+- chemistry
+- science
+- biology
+- art
+- unsloth
+- finance
+- legal
+- medical
+- text-generation-inference
+---
+# Phi-4 DeepSeek Distilled v8 GGUF
+
+This repository contains GGUF quantized versions of the Phi-4 DeepSeek R1 Distilled model. These GGUF files are optimized for local inference using frameworks like [llama.cpp](https://github.com/ggerganov/llama.cpp) and [Ollama](https://ollama.ai/) and LM Studio.
+
+## Model Information
+
+- **Base Model**: Phi-4 DeepSeek R1 Distilled
+- **Parameters**: 14.7B
+- **Architecture**: Phi3
+- **Context Length**: 16384 tokens
+- **Training Data**: Improved version of Phi-4, distilled with DeepSeek R1 Reasoning
+- **License**: MIT
+
+## Available Quantizations
+
+| File | Quantization | Size | Use Case |
+|------|-------------|------|----------|
+ Q8_0 
+ Q6_K
+ Q5_K_M
+ Q4_K_M
+ 
+## Chat Template
+
+This model uses the ChatML format with the following structure:
+
+```
+<|im_start|>system<|im_sep|>System message here<|im_end|>
+<|im_start|>user<|im_sep|>User message here<|im_end|>
+<|im_start|>assistant<|im_sep|>Assistant response here<|im_end|>
+```
+
+## Usage with Ollama
+
+Create a custom Modelfile (paste this into a file named `Modelfile`):
+
+----------------------------------------------------------------------------------
+FROM /replace/with/path/to/your/gguf-file.gguf
+
+PARAMETER temperature 0.15
+PARAMETER top_p 0.93
+PARAMETER top_k 50
+PARAMETER repeat_penalty 1.15
+
+TEMPLATE """{{ if .System }}<|im_start|>system<|im_sep|>{{ .System }}<|im_end|>{{ end }}{{ range .Messages }}{{ if eq .Role "user" }}<|im_start|>user<|im_sep|>{{ .Content }}<|im_en>"""
+
+PARAMETER stop "<|im_start|>"
+
+PARAMETER stop "<|im_end|>"
+
+------------------------------------------------------------------------
+Then create and use your model:
+
+ollama create phi4-deepseek-r1 -f Modelfile
+
+ollama run phi4-deepseek-r1
+
+## Usage with LMStudio
+
+1. Use the model search option to look up the model from huggingface
+2. Download and Load the Model
+3. Set the chat parameters (top_p, top_k, repeat_penalty etc...)
+4. Chat with the model (LMStudio directly detects the chat template so there is no manual configuration here unlike Ollama)
+
+## Usage with llama.cpp
+
+```bash
+# Download the model from Hugging Face
+wget https://huggingface.co/ykarout/phi4-deepseek-r1-distilled-v8-GGUF/resolve/main/phi4-deepseek-r1-distilled-v8-q8_0.gguf
+
+# Run the model with llama.cpp
+./main -m phi4-deepseek-r1-distilled-v8-q8_0.gguf -n 1024 --color -i -ins --chatml
+```
+
+## Benchmarks & Performance Notes
+
+- Q8_0: Best quality, requires ~16GB VRAM for 4K context
+- Q3_K_M: Good quality with 60% size reduction, suitable for systems with 8GB+ VRAM

phi4-deepseek-r1-v12-q4_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cac6dd9c6edcac4ee8c310e121f7573f8fa64d9dc7c9205cce66f3ef86b0975f
+size 9659239872

phi4-deepseek-r1-v12-q5_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:446e29afb0aca4f02c54185f18bc60102321d9541b23cf30ae8d407523fb3334
+size 11210313152

phi4-deepseek-r1-v12-q6_k.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:90bb12cd259e284814c47f08088224f29e79b8ac5a19d710c8194f2bfdf4de1b
+size 12636376512

phi4-deepseek-r1-v12-q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e58de19e3da4ecce48e697db42c5301df763450d5c42900cdddb9bdadfc26f13
+size 16062188992