From a08305dc6ad738f932bb6e89f53085b6408fa901 Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Wed, 22 Apr 2026 11:46:48 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: chatpdflocal/gemma2-instruct-gguf Source: Original Platform --- .gitattributes | 40 +++++++++++++++++++++++++++++++++ README.md | 22 ++++++++++++++++++ gemma-2-2B-instruct-F16.gguf | 3 +++ gemma-2-2B-instruct-Q8_0.gguf | 3 +++ gemma-2-9B-instruct-F16.gguf | 3 +++ gemma-2-9B-instruct-Q4_K_M.gguf | 3 +++ gemma-2-9B-instruct-Q8_0.gguf | 3 +++ 7 files changed, 77 insertions(+) create mode 100644 .gitattributes create mode 100644 README.md create mode 100644 gemma-2-2B-instruct-F16.gguf create mode 100644 gemma-2-2B-instruct-Q8_0.gguf create mode 100644 gemma-2-9B-instruct-F16.gguf create mode 100644 gemma-2-9B-instruct-Q4_K_M.gguf create mode 100644 gemma-2-9B-instruct-Q8_0.gguf diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..cc75821 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,40 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +gemma-2-2B-instruct-F16.gguf filter=lfs diff=lfs merge=lfs -text +gemma-2-2B-instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +gemma-2-9B-instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +gemma-2-9B-instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +gemma-2-9B-instruct-F16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..944ff01 --- /dev/null +++ b/README.md @@ -0,0 +1,22 @@ +--- +license: apache-2.0 +tags: +- legal +- finance +- PC +- laptop +- mobile +- gemma2 +- small size +- chatpdf +- local +- macos +--- +# The Gemma 2 model family, developed by Google, consists of lightweight, open-source models that demonstrate state-of-the-art performance across various tasks. + +This repo covers 2b and 9b gemma2 different size gguf models, which are very applicable for deploying and using in PCs, laptops or mobiles. + +# Useful local intelligent documents assistant AI tools: +[MyDocs](https://www.mydocs.bot) is a desktop App which supports Windows and MacOS, and especially for professionals who demand absolute privacy. 100% local processing ensuring total documents sovereignty and zero-cloud dependency. +If you are using Zotero for managing and reading your personal PDFs, [PapersGPT](https://www.papersgpt.com) is a free plugin which can assist you to chat PDFs effectively by your local gemma2. +You can download the beautiful ChatPDFLocal MacOS app from [here](https://www.chatpdflocal.com), load one or batch PDF files at will, and quickly experience the effect of the model through chat reading. \ No newline at end of file diff --git a/gemma-2-2B-instruct-F16.gguf b/gemma-2-2B-instruct-F16.gguf new file mode 100644 index 0000000..b998faa --- /dev/null +++ b/gemma-2-2B-instruct-F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b71179f15eaf2cd76e2f7df80ef83dc626d837b620c5fd35407ea8c8c9984315 +size 5235213920 diff --git a/gemma-2-2B-instruct-Q8_0.gguf b/gemma-2-2B-instruct-Q8_0.gguf new file mode 100644 index 0000000..d1eeae6 --- /dev/null +++ b/gemma-2-2B-instruct-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fb7f83d89fe19a6fde5a4e8fd2c6980d2033eb41900b40ee0e45ede6c9c25bda +size 2784495200 diff --git a/gemma-2-9B-instruct-F16.gguf b/gemma-2-9B-instruct-F16.gguf new file mode 100644 index 0000000..38f47ae --- /dev/null +++ b/gemma-2-9B-instruct-F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:57d2a3cc91fed57220691f22a5350f239819cc3de00edfb4cb962286f4d5b4bd +size 18490680256 diff --git a/gemma-2-9B-instruct-Q4_K_M.gguf b/gemma-2-9B-instruct-Q4_K_M.gguf new file mode 100644 index 0000000..b95696d --- /dev/null +++ b/gemma-2-9B-instruct-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ec29ee6140fd20e82bf6e4a59341c0ed587964e913b6a129bc3ca7b1c6bb2765 +size 5761057728 diff --git a/gemma-2-9B-instruct-Q8_0.gguf b/gemma-2-9B-instruct-Q8_0.gguf new file mode 100644 index 0000000..54404d8 --- /dev/null +++ b/gemma-2-9B-instruct-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7d3bc4468ce9d806020154ed706800bbeb4226efcf224ba96a895ddf867d905c +size 9827148736