commit 51ae0fb6039a73458062f234bbff5c957792acd2 Author: ModelHub XC Date: Wed Jun 10 06:31:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Chat_Noir-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..41ce26c --- /dev/null +++ b/.gitattributes @@ -0,0 +1,59 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Chat_Noir.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Chat_Noir.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Chat_Noir.i1-IQ1_M.gguf b/Chat_Noir.i1-IQ1_M.gguf new file mode 100644 index 0000000..3460441 --- /dev/null +++ b/Chat_Noir.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:31d8cc6423e4dd64e2f7e62e2511d194e40829be9a308e6ad29f186c12eafa4a +size 5750496512 diff --git a/Chat_Noir.i1-IQ1_S.gguf b/Chat_Noir.i1-IQ1_S.gguf new file mode 100644 index 0000000..1110e61 --- /dev/null +++ b/Chat_Noir.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fbdddb5f47355be392013c76912b50a99da4f19a1678360f3261f05ecd87e735 +size 5273722112 diff --git a/Chat_Noir.i1-IQ2_M.gguf b/Chat_Noir.i1-IQ2_M.gguf new file mode 100644 index 0000000..9d96252 --- /dev/null +++ b/Chat_Noir.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e4c2eadcc22f07ebce6e4db02ac4b88507c35303fe292dd22ab874bbfe226508 +size 8114052352 diff --git a/Chat_Noir.i1-IQ2_S.gguf b/Chat_Noir.i1-IQ2_S.gguf new file mode 100644 index 0000000..ea95f21 --- /dev/null +++ b/Chat_Noir.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:74f549e26ae2cbae5d596118171f644ced9add80013be33182d6151ca629df56 +size 7478353152 diff --git a/Chat_Noir.i1-IQ2_XS.gguf b/Chat_Noir.i1-IQ2_XS.gguf new file mode 100644 index 0000000..2f9dc15 --- /dev/null +++ b/Chat_Noir.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:67cc964873156da02819f63fda3a8c4ad033fb66ac44b1dcccae5be7afc60d33 +size 7207034112 diff --git a/Chat_Noir.i1-IQ2_XXS.gguf b/Chat_Noir.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..3030f7d --- /dev/null +++ b/Chat_Noir.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:518474651bbadfb03078fb831d17e8c971a63b17cc232904e0fb6a302e17a03f +size 6545120512 diff --git a/Chat_Noir.i1-IQ3_M.gguf b/Chat_Noir.i1-IQ3_M.gguf new file mode 100644 index 0000000..80832f8 --- /dev/null +++ b/Chat_Noir.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:65ff1513f9d0557ab7f42ee1b14249c43d3c01752186bcf0b5d6b701955fc67d +size 10650950912 diff --git a/Chat_Noir.i1-IQ3_S.gguf b/Chat_Noir.i1-IQ3_S.gguf new file mode 100644 index 0000000..d711f5a --- /dev/null +++ b/Chat_Noir.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fd932678639f77fe1350a579471d504250695f861a850181eb6de1d081dc8bdd +size 10428128512 diff --git a/Chat_Noir.i1-IQ3_XS.gguf b/Chat_Noir.i1-IQ3_XS.gguf new file mode 100644 index 0000000..924188e --- /dev/null +++ b/Chat_Noir.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8b11f768e5ad618823705ac96782d5e360938556ee55d9ee84dd35f38f5946c0 +size 9907117312 diff --git a/Chat_Noir.i1-IQ3_XXS.gguf b/Chat_Noir.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..42f8e99 --- /dev/null +++ b/Chat_Noir.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9aab203ef098326950515ea86bc5e959d5005f289ccfdf0de7dcdcc2f85e8bcc +size 9280593152 diff --git a/Chat_Noir.i1-IQ4_XS.gguf b/Chat_Noir.i1-IQ4_XS.gguf new file mode 100644 index 0000000..43bd64b --- /dev/null +++ b/Chat_Noir.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c06e68ac562253ecea60c497c8f8e312c52c9587116a5f099bd6ee04bd0ee882 +size 12758916352 diff --git a/Chat_Noir.i1-Q2_K.gguf b/Chat_Noir.i1-Q2_K.gguf new file mode 100644 index 0000000..b9225f1 --- /dev/null +++ b/Chat_Noir.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:871f1722f1c687b9fdc1a5f3dbbd45a4baa5f6717de6c7333322ddb9c583e6e7 +size 8890326272 diff --git a/Chat_Noir.i1-Q2_K_S.gguf b/Chat_Noir.i1-Q2_K_S.gguf new file mode 100644 index 0000000..83f6439 --- /dev/null +++ b/Chat_Noir.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:db6b8fbd4c144b978f42d39ed2fbfe009b99125810a028522978e874d2e685ca +size 8320163072 diff --git a/Chat_Noir.i1-Q3_K_L.gguf b/Chat_Noir.i1-Q3_K_L.gguf new file mode 100644 index 0000000..4d05390 --- /dev/null +++ b/Chat_Noir.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2ccd5193998a839b720c2ba4a9c90fa937f240d7ffc4b5fe1b0bc470229de2d0 +size 12400762112 diff --git a/Chat_Noir.i1-Q3_K_M.gguf b/Chat_Noir.i1-Q3_K_M.gguf new file mode 100644 index 0000000..7634f9f --- /dev/null +++ b/Chat_Noir.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:943db09a0be78ea885f0f02db0f5fb7b6a89179f151605bc8c93f7c2a6d383b0 +size 11474083072 diff --git a/Chat_Noir.i1-Q3_K_S.gguf b/Chat_Noir.i1-Q3_K_S.gguf new file mode 100644 index 0000000..4e668bb --- /dev/null +++ b/Chat_Noir.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7634609842942d8ad55d20777c4def948911184c864e945899a21ff29e568708 +size 10400275712 diff --git a/Chat_Noir.i1-Q4_0.gguf b/Chat_Noir.i1-Q4_0.gguf new file mode 100644 index 0000000..65fbbc2 --- /dev/null +++ b/Chat_Noir.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9c6d183d11d649aae0a1956814fcb4c835e6e0f943aae835d61871f5b25241e7 +size 13494230272 diff --git a/Chat_Noir.i1-Q4_1.gguf b/Chat_Noir.i1-Q4_1.gguf new file mode 100644 index 0000000..5148d25 --- /dev/null +++ b/Chat_Noir.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:11fad562b60b3c6685e495d2c93754c70b6d7da7e00e79430bc8d18be22c1f38 +size 14873107712 diff --git a/Chat_Noir.i1-Q4_K_M.gguf b/Chat_Noir.i1-Q4_K_M.gguf new file mode 100644 index 0000000..cea2a83 --- /dev/null +++ b/Chat_Noir.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:98dfb816f53efe7cb71d9a28a5e95fd93288f36847c66d2e8f2d11d00c5201c4 +size 14333910272 diff --git a/Chat_Noir.i1-Q4_K_S.gguf b/Chat_Noir.i1-Q4_K_S.gguf new file mode 100644 index 0000000..9579780 --- /dev/null +++ b/Chat_Noir.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fd03d52b5d549d148ff20481500662cb13787a2363689e973e9162e44368c1d1 +size 13549280512 diff --git a/Chat_Noir.i1-Q5_K_M.gguf b/Chat_Noir.i1-Q5_K_M.gguf new file mode 100644 index 0000000..f15f512 --- /dev/null +++ b/Chat_Noir.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:90a08b75edb99b68d311c004877ed18b5e7bcf69fa475bfe180cf838ec310248 +size 16763985152 diff --git a/Chat_Noir.i1-Q5_K_S.gguf b/Chat_Noir.i1-Q5_K_S.gguf new file mode 100644 index 0000000..a1e307f --- /dev/null +++ b/Chat_Noir.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8708ca18d496e64d865f03c4aa510814c23a354947103021fe9d76f56016c7f2 +size 16304413952 diff --git a/Chat_Noir.i1-Q6_K.gguf b/Chat_Noir.i1-Q6_K.gguf new file mode 100644 index 0000000..26a87e4 --- /dev/null +++ b/Chat_Noir.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a8954d3b79e00f5906ec6529e43b00d7c4a2af542958c724786b3162af5b2d74 +size 19345939712 diff --git a/Chat_Noir.imatrix.gguf b/Chat_Noir.imatrix.gguf new file mode 100644 index 0000000..f1117d5 --- /dev/null +++ b/Chat_Noir.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:49cdc48001e664843dffbf69b9bfd34638f01cb8512721e84cef17eb5679790d +size 10037312 diff --git a/README.md b/README.md new file mode 100644 index 0000000..d9adfbd --- /dev/null +++ b/README.md @@ -0,0 +1,98 @@ +--- +base_model: VirtuoTuring/chat_noir-24b +language: +- pt +- en +- fr +- es +library_name: transformers +license: other +license_link: https://justina.cloud/licenses_models/virtuo/virtuo_1_0.txt +license_name: virtuo +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- portuguese +- chat +- legaltech +- virtuo-turing +- cláudia-gil +- octávio-viana +- chat_noir +- uncensored +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/VirtuoTuring/chat_noir-24b + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Chat_Noir-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Chat_Noir-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | | +| [GGUF](https://huggingface.co/mradermacher/Chat_Noir-i1-GGUF/resolve/main/Chat_Noir.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +