commit e25e1493ee9f5a6c1c8cdd1a2f128cddf5011ea9 Author: ModelHub XC Date: Fri Jul 10 02:56:10 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/DeepBrainz-R1-4B-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..6392571 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,47 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +DeepBrainz-R1-4B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +DeepBrainz-R1-4B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +DeepBrainz-R1-4B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +DeepBrainz-R1-4B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +DeepBrainz-R1-4B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DeepBrainz-R1-4B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +DeepBrainz-R1-4B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DeepBrainz-R1-4B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +DeepBrainz-R1-4B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +DeepBrainz-R1-4B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +DeepBrainz-R1-4B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +DeepBrainz-R1-4B.f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/DeepBrainz-R1-4B.IQ4_XS.gguf b/DeepBrainz-R1-4B.IQ4_XS.gguf new file mode 100644 index 0000000..90f9b60 --- /dev/null +++ b/DeepBrainz-R1-4B.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d4f1d0e6caf1b7de51c4a7bae233df719c9dff44bcae4f4ed5983b630c1bfa15 +size 2492949536 diff --git a/DeepBrainz-R1-4B.Q2_K.gguf b/DeepBrainz-R1-4B.Q2_K.gguf new file mode 100644 index 0000000..47fdec3 --- /dev/null +++ b/DeepBrainz-R1-4B.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:731de7620b61ae5dd2fc1f10a1bd6c49ff04b5d01b4ba0814d960ea03977d194 +size 1797126176 diff --git a/DeepBrainz-R1-4B.Q3_K_L.gguf b/DeepBrainz-R1-4B.Q3_K_L.gguf new file mode 100644 index 0000000..be113ef --- /dev/null +++ b/DeepBrainz-R1-4B.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:013a9550d2001641016c8044122942ba06934a7507a65c14cedd47555e667641 +size 2406915616 diff --git a/DeepBrainz-R1-4B.Q3_K_M.gguf b/DeepBrainz-R1-4B.Q3_K_M.gguf new file mode 100644 index 0000000..6e93913 --- /dev/null +++ b/DeepBrainz-R1-4B.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c781c5d8f59e525d936acb39425720ed94ccbe6e9fd823d564b50261d88905ac +size 2242747936 diff --git a/DeepBrainz-R1-4B.Q3_K_S.gguf b/DeepBrainz-R1-4B.Q3_K_S.gguf new file mode 100644 index 0000000..5822777 --- /dev/null +++ b/DeepBrainz-R1-4B.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:98a56240b94685497df57312d8fd83b02fd05ad94c5612cf9b9bd8f4f0341de5 +size 2054127136 diff --git a/DeepBrainz-R1-4B.Q4_K_M.gguf b/DeepBrainz-R1-4B.Q4_K_M.gguf new file mode 100644 index 0000000..e4a06ac --- /dev/null +++ b/DeepBrainz-R1-4B.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:452a9ff9a0ea4efebdbb69ce80df6d5bb0cbaad3eb012939d27e6a4da551f9bc +size 2716068896 diff --git a/DeepBrainz-R1-4B.Q4_K_S.gguf b/DeepBrainz-R1-4B.Q4_K_S.gguf new file mode 100644 index 0000000..b04bde8 --- /dev/null +++ b/DeepBrainz-R1-4B.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f895f31e868ff8bb9d33d18f3f6cf29503644917a5db7c32b0da30ef4b207bf5 +size 2602097696 diff --git a/DeepBrainz-R1-4B.Q5_K_M.gguf b/DeepBrainz-R1-4B.Q5_K_M.gguf new file mode 100644 index 0000000..1b2b3f9 --- /dev/null +++ b/DeepBrainz-R1-4B.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d518340c4810f27e4772769d29af7adba539a9373e9cba493a18f41b0fc53501 +size 3156921376 diff --git a/DeepBrainz-R1-4B.Q5_K_S.gguf b/DeepBrainz-R1-4B.Q5_K_S.gguf new file mode 100644 index 0000000..508dc73 --- /dev/null +++ b/DeepBrainz-R1-4B.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:da43c1147d0ddd8972764253d8866df3b8ccfd96b7757b07915a5ab3b5edd191 +size 3091119136 diff --git a/DeepBrainz-R1-4B.Q6_K.gguf b/DeepBrainz-R1-4B.Q6_K.gguf new file mode 100644 index 0000000..0b96501 --- /dev/null +++ b/DeepBrainz-R1-4B.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d196607464b89f788e45c38a57c4ad55ddb01a6984c599ca5965b0fb39cf405a +size 3625327136 diff --git a/DeepBrainz-R1-4B.Q8_0.gguf b/DeepBrainz-R1-4B.Q8_0.gguf new file mode 100644 index 0000000..576b118 --- /dev/null +++ b/DeepBrainz-R1-4B.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:002bf2e88ea3082736f629b9a90afdcc01d976e3016e3c75444670b1b46f9f68 +size 4693671456 diff --git a/DeepBrainz-R1-4B.f16.gguf b/DeepBrainz-R1-4B.f16.gguf new file mode 100644 index 0000000..1dd9b6b --- /dev/null +++ b/DeepBrainz-R1-4B.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:04d1e43e563eb52cda5161d104bc59eb8c19b8c2a5f2a0e04f6f89348682b61e +size 8829197856 diff --git a/README.md b/README.md new file mode 100644 index 0000000..646839b --- /dev/null +++ b/README.md @@ -0,0 +1,81 @@ +--- +base_model: DeepBrainz/DeepBrainz-R1-4B +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- deepbrainz +- reasoning +- mathematics +- code +- enterprise +- 4b +- long-context +- 32k +--- +## About + + + + + + + + + +static quants of https://huggingface.co/DeepBrainz/DeepBrainz-R1-4B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#DeepBrainz-R1-4B-GGUF).*** + +weighted/imatrix quants are available at https://huggingface.co/mradermacher/DeepBrainz-R1-4B-i1-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/DeepBrainz-R1-4B-GGUF/resolve/main/DeepBrainz-R1-4B.Q2_K.gguf) | Q2_K | 1.9 | | +| [GGUF](https://huggingface.co/mradermacher/DeepBrainz-R1-4B-GGUF/resolve/main/DeepBrainz-R1-4B.Q3_K_S.gguf) | Q3_K_S | 2.2 | | +| [GGUF](https://huggingface.co/mradermacher/DeepBrainz-R1-4B-GGUF/resolve/main/DeepBrainz-R1-4B.Q3_K_M.gguf) | Q3_K_M | 2.3 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/DeepBrainz-R1-4B-GGUF/resolve/main/DeepBrainz-R1-4B.Q3_K_L.gguf) | Q3_K_L | 2.5 | | +| [GGUF](https://huggingface.co/mradermacher/DeepBrainz-R1-4B-GGUF/resolve/main/DeepBrainz-R1-4B.IQ4_XS.gguf) | IQ4_XS | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/DeepBrainz-R1-4B-GGUF/resolve/main/DeepBrainz-R1-4B.Q4_K_S.gguf) | Q4_K_S | 2.7 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/DeepBrainz-R1-4B-GGUF/resolve/main/DeepBrainz-R1-4B.Q4_K_M.gguf) | Q4_K_M | 2.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/DeepBrainz-R1-4B-GGUF/resolve/main/DeepBrainz-R1-4B.Q5_K_S.gguf) | Q5_K_S | 3.2 | | +| [GGUF](https://huggingface.co/mradermacher/DeepBrainz-R1-4B-GGUF/resolve/main/DeepBrainz-R1-4B.Q5_K_M.gguf) | Q5_K_M | 3.3 | | +| [GGUF](https://huggingface.co/mradermacher/DeepBrainz-R1-4B-GGUF/resolve/main/DeepBrainz-R1-4B.Q6_K.gguf) | Q6_K | 3.7 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/DeepBrainz-R1-4B-GGUF/resolve/main/DeepBrainz-R1-4B.Q8_0.gguf) | Q8_0 | 4.8 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/DeepBrainz-R1-4B-GGUF/resolve/main/DeepBrainz-R1-4B.f16.gguf) | f16 | 8.9 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + +