初始化项目，由ModelHub XC社区提供模型

Model: afrideva/phi2-oasst-guanaco-bf16-custom-GGUF
Source: Original Platform

.gitattributes

@@ -0,0 +1,42 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+phi2-oasst-guanaco-bf16-custom.fp16.gguf filter=lfs diff=lfs merge=lfs -text
+phi2-oasst-guanaco-bf16-custom.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
+phi2-oasst-guanaco-bf16-custom.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
+phi2-oasst-guanaco-bf16-custom.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
+phi2-oasst-guanaco-bf16-custom.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
+phi2-oasst-guanaco-bf16-custom.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
+phi2-oasst-guanaco-bf16-custom.q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,41 @@
+---
+base_model: anilbhatt1/phi2-oasst-guanaco-bf16-custom
+inference: false
+license: mit
+model_creator: anilbhatt1
+model_name: phi2-oasst-guanaco-bf16-custom
+pipeline_tag: text-generation
+quantized_by: afrideva
+tags:
+- gguf
+- ggml
+- quantized
+- q2_k
+- q3_k_m
+- q4_k_m
+- q5_k_m
+- q6_k
+- q8_0
+---
+# anilbhatt1/phi2-oasst-guanaco-bf16-custom-GGUF
+
+Quantized GGUF model files for [phi2-oasst-guanaco-bf16-custom](https://huggingface.co/anilbhatt1/phi2-oasst-guanaco-bf16-custom) from [anilbhatt1](https://huggingface.co/anilbhatt1)
+
+
+| Name | Quant method | Size |
+| ---- | ---- | ---- |
+| [phi2-oasst-guanaco-bf16-custom.fp16.gguf](https://huggingface.co/afrideva/phi2-oasst-guanaco-bf16-custom-GGUF/resolve/main/phi2-oasst-guanaco-bf16-custom.fp16.gguf) | fp16 | 5.56 GB  |
+| [phi2-oasst-guanaco-bf16-custom.q2_k.gguf](https://huggingface.co/afrideva/phi2-oasst-guanaco-bf16-custom-GGUF/resolve/main/phi2-oasst-guanaco-bf16-custom.q2_k.gguf) | q2_k | 1.17 GB  |
+| [phi2-oasst-guanaco-bf16-custom.q3_k_m.gguf](https://huggingface.co/afrideva/phi2-oasst-guanaco-bf16-custom-GGUF/resolve/main/phi2-oasst-guanaco-bf16-custom.q3_k_m.gguf) | q3_k_m | 1.48 GB  |
+| [phi2-oasst-guanaco-bf16-custom.q4_k_m.gguf](https://huggingface.co/afrideva/phi2-oasst-guanaco-bf16-custom-GGUF/resolve/main/phi2-oasst-guanaco-bf16-custom.q4_k_m.gguf) | q4_k_m | 1.79 GB  |
+| [phi2-oasst-guanaco-bf16-custom.q5_k_m.gguf](https://huggingface.co/afrideva/phi2-oasst-guanaco-bf16-custom-GGUF/resolve/main/phi2-oasst-guanaco-bf16-custom.q5_k_m.gguf) | q5_k_m | 2.07 GB  |
+| [phi2-oasst-guanaco-bf16-custom.q6_k.gguf](https://huggingface.co/afrideva/phi2-oasst-guanaco-bf16-custom-GGUF/resolve/main/phi2-oasst-guanaco-bf16-custom.q6_k.gguf) | q6_k | 2.29 GB  |
+| [phi2-oasst-guanaco-bf16-custom.q8_0.gguf](https://huggingface.co/afrideva/phi2-oasst-guanaco-bf16-custom-GGUF/resolve/main/phi2-oasst-guanaco-bf16-custom.q8_0.gguf) | q8_0 | 2.96 GB  |
+
+
+
+## Original Model Card:
+# Finetuned microsoft-phi2 model 
+
+- microsoft-phi2 model finetuned on "timdettmers/openassistant-guanaco" dataset with qlora technique
+- Will run on a colab T4 gpu

phi2-oasst-guanaco-bf16-custom.fp16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:20a9d9ec135d811c632934c66fecad1739206fc0d098fd02b28acc3c000647f0
+size 5563088736

phi2-oasst-guanaco-bf16-custom.q2_k.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c7c9099183bc3cad4b0262ca86c8913fd4c3bf67190ebd2259f7b72971260f3
+size 1173610368

phi2-oasst-guanaco-bf16-custom.q3_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d847bc7ccac352f23862b53fc4a2aa8360f8a6454032a69f14dc464d13690eab
+size 1480195968

phi2-oasst-guanaco-bf16-custom.q4_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:551bf49857cfdde2035676b5690bc4c5569729a0b394384924afab88c7c8b1c3
+size 1789239168

phi2-oasst-guanaco-bf16-custom.q5_k_m.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4a3db401e4b70fe98f4bd34d046d738ea4e04c0c3c2c10a5683061851f4fcfd6
+size 2072682368

phi2-oasst-guanaco-bf16-custom.q6_k.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c59701107327ea58cbe8caca343dc4800ca953c99cc60f537dd13bdf9ea272c2
+size 2285059968

phi2-oasst-guanaco-bf16-custom.q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dc8e287e4762e76f72502616150da38916347a0a7e40b4bcd53899cac1d5a138
+size 2958032768