commit f40e42d4835f1d35884e8de8884471556eaf665b Author: ModelHub XC Date: Fri Apr 17 15:41:42 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/SimonGPT-simple-instruct-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..255abd4 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +SimonGPT-simple-instruct.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..a681527 --- /dev/null +++ b/README.md @@ -0,0 +1,94 @@ +--- +base_model: simonko912/SimonGPT-simple-instruct +datasets: +- simonko912/SimonGPT-simple-conversations +- OpenAssistant/oasst1 +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- gpt2 +- small +- llm +- lm +- 124M +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/simonko912/SimonGPT-simple-instruct + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#SimonGPT-simple-instruct-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/SimonGPT-simple-instruct-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-IQ1_S.gguf) | i1-IQ1_S | 0.1 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-IQ1_M.gguf) | i1-IQ1_M | 0.2 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-IQ2_S.gguf) | i1-IQ2_S | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-IQ2_M.gguf) | i1-IQ2_M | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.2 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.2 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-Q2_K.gguf) | i1-Q2_K | 0.2 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-IQ3_S.gguf) | i1-IQ3_S | 0.2 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.2 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-IQ3_M.gguf) | i1-IQ3_M | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.2 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.2 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-Q4_0.gguf) | i1-Q4_0 | 0.2 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.2 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.2 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-Q4_1.gguf) | i1-Q4_1 | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.2 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/SimonGPT-simple-instruct-i1-GGUF/resolve/main/SimonGPT-simple-instruct.i1-Q6_K.gguf) | i1-Q6_K | 0.2 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/SimonGPT-simple-instruct.i1-IQ1_M.gguf b/SimonGPT-simple-instruct.i1-IQ1_M.gguf new file mode 100644 index 0000000..a4d12d7 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0193d38056652c539eb967f81dccbd7c2153e127c8316b9c37e96bfa2c0581fe +size 51057792 diff --git a/SimonGPT-simple-instruct.i1-IQ1_S.gguf b/SimonGPT-simple-instruct.i1-IQ1_S.gguf new file mode 100644 index 0000000..20b44a2 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:65ac88bcdd67ee02a9ea4ed4d958b4f66521dca4a3039a87a68ea72a1a3a63e5 +size 49288320 diff --git a/SimonGPT-simple-instruct.i1-IQ2_M.gguf b/SimonGPT-simple-instruct.i1-IQ2_M.gguf new file mode 100644 index 0000000..95f09e5 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6f228047055e557a7adfb3e10d0da4331cb25a5f8d4c440379478fe56199bd38 +size 60181632 diff --git a/SimonGPT-simple-instruct.i1-IQ2_S.gguf b/SimonGPT-simple-instruct.i1-IQ2_S.gguf new file mode 100644 index 0000000..f9e6124 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5620e5bb08cdcab7818e3977651f81455b1e3c13527112f64398e9689832aa0f +size 57822336 diff --git a/SimonGPT-simple-instruct.i1-IQ2_XS.gguf b/SimonGPT-simple-instruct.i1-IQ2_XS.gguf new file mode 100644 index 0000000..bf09f53 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:747c825478b5c5451170a149e7a6a48c94bd28b69aab3367511ac032518a72ef +size 56587392 diff --git a/SimonGPT-simple-instruct.i1-IQ2_XXS.gguf b/SimonGPT-simple-instruct.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..32d1fd2 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a819892bcfdbf10e8c7905d31b5a36d40132af0b602c75725a4d1209c22890de +size 54006912 diff --git a/SimonGPT-simple-instruct.i1-IQ3_M.gguf b/SimonGPT-simple-instruct.i1-IQ3_M.gguf new file mode 100644 index 0000000..8af3859 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e4299ea5591845c14c059cf5d101430e858959629205f54c8a57b9db60f799a8 +size 77638848 diff --git a/SimonGPT-simple-instruct.i1-IQ3_S.gguf b/SimonGPT-simple-instruct.i1-IQ3_S.gguf new file mode 100644 index 0000000..cef91c3 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9d5056f00ea384ccffecd87ad8c02044507984c3025d9466f0e6598905d8da46 +size 73565376 diff --git a/SimonGPT-simple-instruct.i1-IQ3_XS.gguf b/SimonGPT-simple-instruct.i1-IQ3_XS.gguf new file mode 100644 index 0000000..0242961 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f58246f378ae2a0892a6d74ee3553c7e2e1101865e10b9a4bcd0e8696ed13424 +size 72570048 diff --git a/SimonGPT-simple-instruct.i1-IQ3_XXS.gguf b/SimonGPT-simple-instruct.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..038c960 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f86414e586ff8417f26a8e0612f0b3e4079a1eba267f5b6922140b2a9e7dba08 +size 64789632 diff --git a/SimonGPT-simple-instruct.i1-IQ4_NL.gguf b/SimonGPT-simple-instruct.i1-IQ4_NL.gguf new file mode 100644 index 0000000..e0aeaff --- /dev/null +++ b/SimonGPT-simple-instruct.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fd2b7bf4404f62d428ca8f1934546be37ca9349925c64dc4dd9584c1639a099f +size 84845760 diff --git a/SimonGPT-simple-instruct.i1-IQ4_XS.gguf b/SimonGPT-simple-instruct.i1-IQ4_XS.gguf new file mode 100644 index 0000000..97c638f --- /dev/null +++ b/SimonGPT-simple-instruct.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cecaec981d406561c453445cc5dccb540259d2e29cf8870e4eeedb936da18194 +size 82191552 diff --git a/SimonGPT-simple-instruct.i1-Q2_K.gguf b/SimonGPT-simple-instruct.i1-Q2_K.gguf new file mode 100644 index 0000000..9a73a28 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9d44bcb6c29633f901907de1f520ee2f2807cda6ac9a19963fe05addb7378223 +size 68533440 diff --git a/SimonGPT-simple-instruct.i1-Q2_K_S.gguf b/SimonGPT-simple-instruct.i1-Q2_K_S.gguf new file mode 100644 index 0000000..65cb4b4 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:606c32182cbeb4456d5cae5546a64d3ec2713d8b0277354fb985e123941a8040 +size 65492160 diff --git a/SimonGPT-simple-instruct.i1-Q3_K_L.gguf b/SimonGPT-simple-instruct.i1-Q3_K_L.gguf new file mode 100644 index 0000000..b0ab66c --- /dev/null +++ b/SimonGPT-simple-instruct.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e57d555c1e999e624bb9a6f9e269111518bfc41b660ed6dc3ba37a04a112577f +size 85509312 diff --git a/SimonGPT-simple-instruct.i1-Q3_K_M.gguf b/SimonGPT-simple-instruct.i1-Q3_K_M.gguf new file mode 100644 index 0000000..d2a28af --- /dev/null +++ b/SimonGPT-simple-instruct.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2a7eb709273b834363b712f134be53e6fc1f37fb208cffc075123db51d2f8a07 +size 81085632 diff --git a/SimonGPT-simple-instruct.i1-Q3_K_S.gguf b/SimonGPT-simple-instruct.i1-Q3_K_S.gguf new file mode 100644 index 0000000..65a81d1 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9ae79fdd5c9d75c62e18ee7ec25acd7b5841685c1c971e0a0baa6fd225721322 +size 73565376 diff --git a/SimonGPT-simple-instruct.i1-Q4_0.gguf b/SimonGPT-simple-instruct.i1-Q4_0.gguf new file mode 100644 index 0000000..3bc4887 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:00ca9f49e04e55019d6f2ff0033cab19c6628ce7965808029e3f9ba8afd1b46f +size 84993216 diff --git a/SimonGPT-simple-instruct.i1-Q4_1.gguf b/SimonGPT-simple-instruct.i1-Q4_1.gguf new file mode 100644 index 0000000..cc74f97 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2e95f087c592b0e85a5c70f8f1f8e100b6200635121495f3db5f5810877cde59 +size 90154176 diff --git a/SimonGPT-simple-instruct.i1-Q4_K_M.gguf b/SimonGPT-simple-instruct.i1-Q4_K_M.gguf new file mode 100644 index 0000000..4143430 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8c87706795543629babe65f8154f39286021e52abe0a32e6bb201a34014f7bc6 +size 91149504 diff --git a/SimonGPT-simple-instruct.i1-Q4_K_S.gguf b/SimonGPT-simple-instruct.i1-Q4_K_S.gguf new file mode 100644 index 0000000..35a8d91 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9faf96430df08dad353ff78c7f63d2c8dde0907b602cb5a33b3d1b84f9596564 +size 85140672 diff --git a/SimonGPT-simple-instruct.i1-Q5_K_M.gguf b/SimonGPT-simple-instruct.i1-Q5_K_M.gguf new file mode 100644 index 0000000..0e26baa --- /dev/null +++ b/SimonGPT-simple-instruct.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:523605139e8eda677b38f56f54690be03f88190b071607d2fbcb7966aa787759 +size 100162752 diff --git a/SimonGPT-simple-instruct.i1-Q5_K_S.gguf b/SimonGPT-simple-instruct.i1-Q5_K_S.gguf new file mode 100644 index 0000000..83bc7d4 --- /dev/null +++ b/SimonGPT-simple-instruct.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2c6c71d13768860946ad50f327f819b736665b6b3348037d0f664c93b94f3b80 +size 95462592 diff --git a/SimonGPT-simple-instruct.i1-Q6_K.gguf b/SimonGPT-simple-instruct.i1-Q6_K.gguf new file mode 100644 index 0000000..324b76a --- /dev/null +++ b/SimonGPT-simple-instruct.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:902126c5214b3685479e5078652bc3c4f713305aad553a76b7f19e7368a8dc6e +size 106742976 diff --git a/SimonGPT-simple-instruct.imatrix.gguf b/SimonGPT-simple-instruct.imatrix.gguf new file mode 100644 index 0000000..f88cf75 --- /dev/null +++ b/SimonGPT-simple-instruct.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:829f4147c8fea1f9e35475f4dfe1aabd063e34e4064240af49469321402b2a51 +size 265664