From 72f01a735e20c7c1d52e5831abc1b4b655c10403 Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Mon, 11 May 2026 10:34:47 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF Source: Original Platform --- .gitattributes | 60 +++++++++++ Enesidaon-VLR-7B-no-Thinking.i1-IQ1_M.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-IQ1_S.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-IQ2_M.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-IQ2_S.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XS.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XXS.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-IQ3_M.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-IQ3_S.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XS.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XXS.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-IQ4_NL.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-IQ4_XS.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-Q2_K.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-Q2_K_S.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_L.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_M.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_S.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-Q4_0.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-Q4_1.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_M.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_S.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_M.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_S.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.i1-Q6_K.gguf | 3 + Enesidaon-VLR-7B-no-Thinking.imatrix.gguf | 3 + README.md | 100 +++++++++++++++++++ 27 files changed, 235 insertions(+) create mode 100644 .gitattributes create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-IQ1_M.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-IQ1_S.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-IQ2_M.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-IQ2_S.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XS.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XXS.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-IQ3_M.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-IQ3_S.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XS.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XXS.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-IQ4_NL.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-IQ4_XS.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-Q2_K.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-Q2_K_S.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_L.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_M.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_S.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-Q4_0.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-Q4_1.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_M.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_S.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_M.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_S.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.i1-Q6_K.gguf create mode 100644 Enesidaon-VLR-7B-no-Thinking.imatrix.gguf create mode 100644 README.md diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..ca5dd40 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Enesidaon-VLR-7B-no-Thinking.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-IQ1_M.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-IQ1_M.gguf new file mode 100644 index 0000000..ec96dbb --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6d0accc4ff140dda620d820890147b8ee411a7b7dfe6f1f440872845fe36fd66 +size 2042195872 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-IQ1_S.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-IQ1_S.gguf new file mode 100644 index 0000000..7371fbc --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e2ab642ab41d52ecb916eafb115591e42cffca3ea7e1ea146f69a27f70428324 +size 1903667104 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_M.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_M.gguf new file mode 100644 index 0000000..73c574e --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:14d04ca07e6182393cc60acafb51121a4193950e43e6aa388267a8320fa7c014 +size 2780342176 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_S.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_S.gguf new file mode 100644 index 0000000..5d68860 --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cffddc98b60d783ed4a72a84792958171de9b6a5e0068fb35f8503ba2a29e3bc +size 2595637152 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XS.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XS.gguf new file mode 100644 index 0000000..40a8305 --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e7211279b0c01c3e378c870eae31df1532ac48e6e6c8546ced6005e6930dd058 +size 2469021600 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XXS.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..2a973fc --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:737de9ca18cf7ac72d8a52a462c10e9ab7da76fb15e2f518bacf0122a30acb7f +size 2273077152 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_M.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_M.gguf new file mode 100644 index 0000000..bc1836f --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:66053d7688e052e0cb32e3f70112d317885561089b1bcf35745d68aacb253dbe +size 3574011808 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_S.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_S.gguf new file mode 100644 index 0000000..d9d3a83 --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:537a39882855a6d301e71437d4c099bb0ffe22f76db0156be10a8690dc723835 +size 3499192224 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XS.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XS.gguf new file mode 100644 index 0000000..b3464d1 --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cfe2e12dc3e8589b03f93539e3697c6dbf8eeed87ec62adceef9acb666c87dfa +size 3346255776 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XXS.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..8f939ea --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:751056a178e3284629e8f937db8c60600f5244e8458f4deef14d6e55f5fbc15e +size 3114514336 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-IQ4_NL.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-IQ4_NL.gguf new file mode 100644 index 0000000..c699e0f --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a11edbe5743b5ab83ff287efeb96373645e27351d6beaba771ca9b8f3d70e329 +size 4437813152 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-IQ4_XS.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-IQ4_XS.gguf new file mode 100644 index 0000000..0700232 --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:13243d3896263d80c21a399d11c5e267d5bfac4de7953f777e2cc43c32af1a4d +size 4218472352 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-Q2_K.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-Q2_K.gguf new file mode 100644 index 0000000..af2bd63 --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1e142aa60e18e0abac7fd9159efe07fac31fd4d563a743db9c526cd607c4dc91 +size 3015940000 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-Q2_K_S.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-Q2_K_S.gguf new file mode 100644 index 0000000..a229b37 --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d37af2abd375fca85dee374d128ea54b7a3e9f561ed232627d055c6d90388bd6 +size 2834073504 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_L.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_L.gguf new file mode 100644 index 0000000..b7f3f17 --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:075877b63c41713b70d100b33ab8a479db75eeb9d00c290326640b3891712ec6 +size 4088459168 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_M.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_M.gguf new file mode 100644 index 0000000..3610e9b --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:72086d3e6bd9acc27338030c4b4796b67e80103e1b682aac01d62a8d3402c0c2 +size 3808391072 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_S.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_S.gguf new file mode 100644 index 0000000..1b59655 --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b220e1459f05494e1fb6c44088bfaa03b5245572b07b45822da0cee5389b527b +size 3492368288 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-Q4_0.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-Q4_0.gguf new file mode 100644 index 0000000..75e673a --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8bccd506d137fbeb7cea272c120d190a9e24f380d787ba3259c884995c4952ba +size 4444120992 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-Q4_1.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-Q4_1.gguf new file mode 100644 index 0000000..d75fa7f --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eb14e2ad8fa9f7dc004f7adeb0eb8f1996a3cac3d51dff6599994eec52ada8f0 +size 4873283488 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_M.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_M.gguf new file mode 100644 index 0000000..b734ec6 --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:017d5d81f42e8584bfb8da90c29922d08997203ab43b6cdec0d6521b61d13fc0 +size 4683073440 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_S.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_S.gguf new file mode 100644 index 0000000..8567e17 --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:88431960b399ab32d36ee3d84be3da458ef29f303f2e26e7468f2df87a6cac80 +size 4457768864 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_M.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_M.gguf new file mode 100644 index 0000000..2906e9e --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:408d49ea55d72953d4684b19063e5ccb1882683c73ff0de1e679b26ee2721ceb +size 5444831136 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_S.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_S.gguf new file mode 100644 index 0000000..23f531b --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7c4a2b6697b22a05c0bea79a308acfe47204bd85b95c41c792eb65f53bff1fed +size 5315176352 diff --git a/Enesidaon-VLR-7B-no-Thinking.i1-Q6_K.gguf b/Enesidaon-VLR-7B-no-Thinking.i1-Q6_K.gguf new file mode 100644 index 0000000..157b72a --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:47a97c6b26a1ee4d34a024e21e99f56641d0a8846331dd80dc9bf773207a60cc +size 6254198688 diff --git a/Enesidaon-VLR-7B-no-Thinking.imatrix.gguf b/Enesidaon-VLR-7B-no-Thinking.imatrix.gguf new file mode 100644 index 0000000..ecf73af --- /dev/null +++ b/Enesidaon-VLR-7B-no-Thinking.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:17925c4a21c1a623fcf07cf0af919e4f7c1968b752fa2b0e05a76b08c85c6c61 +size 4560352 diff --git a/README.md b/README.md new file mode 100644 index 0000000..975a26f --- /dev/null +++ b/README.md @@ -0,0 +1,100 @@ +--- +base_model: prithivMLmods/Enesidaon-VLR-7B-no-Thinking +language: +- en +- zh +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- text-generation-inference +- trl +- ocr +- vision-language +- reasoning +- grounded-visual-reasoning +- sft +- grpo +- no-thinking +- code +- thinking=0 +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/prithivMLmods/Enesidaon-VLR-7B-no-Thinking + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Enesidaon-VLR-7B-no-Thinking-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-GGUF + +**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-GGUF).** +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-IQ1_S.gguf) | i1-IQ1_S | 2.0 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-IQ1_M.gguf) | i1-IQ1_M | 2.1 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_S.gguf) | i1-IQ2_S | 2.7 | | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-IQ2_M.gguf) | i1-IQ2_M | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.9 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-Q2_K.gguf) | i1-Q2_K | 3.1 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.2 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.4 | | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_S.gguf) | i1-IQ3_S | 3.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-IQ3_M.gguf) | i1-IQ3_M | 3.7 | | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.9 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.2 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.3 | | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.5 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-Q4_0.gguf) | i1-Q4_0 | 4.5 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.6 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-Q4_1.gguf) | i1-Q4_1 | 5.0 | | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.4 | | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.5 | | +| [GGUF](https://huggingface.co/mradermacher/Enesidaon-VLR-7B-no-Thinking-i1-GGUF/resolve/main/Enesidaon-VLR-7B-no-Thinking.i1-Q6_K.gguf) | i1-Q6_K | 6.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +