bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-13 20:08:05 +08:00
commit 09964ce81a
28 changed files with 311 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-f16.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q6_K_L.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q5_K_L.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q4_K_L.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q2_K_L.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview-f32.gguf filter=lfs diff=lfs merge=lfs -text
agentica-org_DeepScaleR-1.5B-Preview.imatrix filter=lfs diff=lfs merge=lfs -text

175
README.md Normal file
View File

@@ -0,0 +1,175 @@
---
quantized_by: bartowski
pipeline_tag: text-generation
license: mit
language:
- en
datasets:
- AI-MO/NuminaMath-CoT
- KbsdJames/Omni-MATH
- RUC-AIBOX/STILL-3-Preview-RL-Data
- hendrycks/competition_math
base_model: agentica-org/DeepScaleR-1.5B-Preview
---
## Llamacpp imatrix Quantizations of DeepScaleR-1.5B-Preview by agentica-org
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b4671">b4671</a> for quantization.
Original model: https://huggingface.co/agentica-org/DeepScaleR-1.5B-Preview
All quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)
Run them in [LM Studio](https://lmstudio.ai/)
Run them directly with [llama.cpp](https://github.com/ggerganov/llama.cpp), or any other llama.cpp based project
## Prompt format
```
<｜begin▁of▁sentence｜>{system_prompt}<｜User｜>{prompt}<｜Assistant｜><｜end▁of▁sentence｜><｜Assistant｜>
```
## Download a file (not the whole branch) from below:
| Filename | Quant type | File Size | Split | Description |
| -------- | ---------- | --------- | ----- | ----------- |
| [DeepScaleR-1.5B-Preview-f32.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-f32.gguf) | f32 | 7.11GB | false | Full F32 weights. |
| [DeepScaleR-1.5B-Preview-f16.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-f16.gguf) | f16 | 3.56GB | false | Full F16 weights. |
| [DeepScaleR-1.5B-Preview-Q8_0.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q8_0.gguf) | Q8_0 | 1.89GB | false | Extremely high quality, generally unneeded but max available quant. |
| [DeepScaleR-1.5B-Preview-Q6_K_L.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q6_K_L.gguf) | Q6_K_L | 1.58GB | false | Uses Q8_0 for embed and output weights. Very high quality, near perfect, *recommended*. |
| [DeepScaleR-1.5B-Preview-Q6_K.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q6_K.gguf) | Q6_K | 1.46GB | false | Very high quality, near perfect, *recommended*. |
| [DeepScaleR-1.5B-Preview-Q5_K_L.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q5_K_L.gguf) | Q5_K_L | 1.43GB | false | Uses Q8_0 for embed and output weights. High quality, *recommended*. |
| [DeepScaleR-1.5B-Preview-Q5_K_M.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q5_K_M.gguf) | Q5_K_M | 1.29GB | false | High quality, *recommended*. |
| [DeepScaleR-1.5B-Preview-Q4_K_L.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q4_K_L.gguf) | Q4_K_L | 1.29GB | false | Uses Q8_0 for embed and output weights. Good quality, *recommended*. |
| [DeepScaleR-1.5B-Preview-Q5_K_S.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q5_K_S.gguf) | Q5_K_S | 1.26GB | false | High quality, *recommended*. |
| [DeepScaleR-1.5B-Preview-Q3_K_XL.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q3_K_XL.gguf) | Q3_K_XL | 1.18GB | false | Uses Q8_0 for embed and output weights. Lower quality but usable, good for low RAM availability. |
| [DeepScaleR-1.5B-Preview-Q4_1.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q4_1.gguf) | Q4_1 | 1.16GB | false | Legacy format, similar performance to Q4_K_S but with improved tokens/watt on Apple silicon. |
| [DeepScaleR-1.5B-Preview-Q4_K_M.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q4_K_M.gguf) | Q4_K_M | 1.12GB | false | Good quality, default size for most use cases, *recommended*. |
| [DeepScaleR-1.5B-Preview-Q4_K_S.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q4_K_S.gguf) | Q4_K_S | 1.07GB | false | Slightly lower quality with more space savings, *recommended*. |
| [DeepScaleR-1.5B-Preview-Q4_0.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q4_0.gguf) | Q4_0 | 1.07GB | false | Legacy format, offers online repacking for ARM and AVX CPU inference. |
| [DeepScaleR-1.5B-Preview-IQ4_NL.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-IQ4_NL.gguf) | IQ4_NL | 1.07GB | false | Similar to IQ4_XS, but slightly larger. Offers online repacking for ARM CPU inference. |
| [DeepScaleR-1.5B-Preview-IQ4_XS.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-IQ4_XS.gguf) | IQ4_XS | 1.02GB | false | Decent quality, smaller than Q4_K_S with similar performance, *recommended*. |
| [DeepScaleR-1.5B-Preview-Q3_K_L.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q3_K_L.gguf) | Q3_K_L | 0.98GB | false | Lower quality but usable, good for low RAM availability. |
| [DeepScaleR-1.5B-Preview-Q2_K_L.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q2_K_L.gguf) | Q2_K_L | 0.98GB | false | Uses Q8_0 for embed and output weights. Very low quality but surprisingly usable. |
| [DeepScaleR-1.5B-Preview-Q3_K_M.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q3_K_M.gguf) | Q3_K_M | 0.92GB | false | Low quality. |
| [DeepScaleR-1.5B-Preview-IQ3_M.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-IQ3_M.gguf) | IQ3_M | 0.88GB | false | Medium-low quality, new method with decent performance comparable to Q3_K_M. |
| [DeepScaleR-1.5B-Preview-Q3_K_S.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q3_K_S.gguf) | Q3_K_S | 0.86GB | false | Low quality, not recommended. |
| [DeepScaleR-1.5B-Preview-IQ3_XS.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-IQ3_XS.gguf) | IQ3_XS | 0.83GB | false | Lower quality, new method with decent performance, slightly better than Q3_K_S. |
| [DeepScaleR-1.5B-Preview-IQ3_XXS.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-IQ3_XXS.gguf) | IQ3_XXS | 0.77GB | false | Lower quality, new method with decent performance, comparable to Q3 quants. |
| [DeepScaleR-1.5B-Preview-Q2_K.gguf](https://huggingface.co/bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF/blob/main/agentica-org_DeepScaleR-1.5B-Preview-Q2_K.gguf) | Q2_K | 0.75GB | false | Very low quality but surprisingly usable. |
## Embed/output weights
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
## Downloading using huggingface-cli
<details>
<summary>Click to view download instructions</summary>
First, make sure you have hugginface-cli installed:
```
pip install -U "huggingface_hub[cli]"
```
Then, you can target the specific file you want:
```
huggingface-cli download bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF --include "agentica-org_DeepScaleR-1.5B-Preview-Q4_K_M.gguf" --local-dir ./
```
If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
```
huggingface-cli download bartowski/agentica-org_DeepScaleR-1.5B-Preview-GGUF --include "agentica-org_DeepScaleR-1.5B-Preview-Q8_0/*" --local-dir ./
```
You can either specify a new local-dir (agentica-org_DeepScaleR-1.5B-Preview-Q8_0) or download them all in place (./)
</details>
## ARM/AVX information
Previously, you would download Q4_0_4_4/4_8/8_8, and these would have their weights interleaved in memory in order to improve performance on ARM and AVX machines by loading up more data in one pass.
Now, however, there is something called "online repacking" for weights. details in [this PR](https://github.com/ggerganov/llama.cpp/pull/9921). If you use Q4_0 and your hardware would benefit from repacking weights, it will do it automatically on the fly.
As of llama.cpp build [b4282](https://github.com/ggerganov/llama.cpp/releases/tag/b4282) you will not be able to run the Q4_0_X_X files and will instead need to use Q4_0.
Additionally, if you want to get slightly better quality for , you can use IQ4_NL thanks to [this PR](https://github.com/ggerganov/llama.cpp/pull/10541) which will also repack the weights for ARM, though only the 4_4 for now. The loading time may be slower but it will result in an overall speed incrase.
<details>
<summary>Click to view Q4_0_X_X information (deprecated</summary>
I'm keeping this section to show the potential theoretical uplift in performance from using the Q4_0 with online repacking.
<details>
<summary>Click to view benchmarks on an AVX2 system (EPYC7702)</summary>
| model | size | params | backend | threads | test | t/s | % (vs Q4_0) |
| ------------------------------ | ---------: | ---------: | ---------- | ------: | ------------: | -------------------: |-------------: |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp512 | 204.03 ± 1.03 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp1024 | 282.92 ± 0.19 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp2048 | 259.49 ± 0.44 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg128 | 39.12 ± 0.27 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg256 | 39.31 ± 0.69 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg512 | 40.52 ± 0.03 | 100% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp512 | 301.02 ± 1.74 | 147% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp1024 | 287.23 ± 0.20 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp2048 | 262.77 ± 1.81 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg128 | 18.80 ± 0.99 | 48% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg256 | 24.46 ± 3.04 | 83% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg512 | 36.32 ± 3.59 | 90% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp512 | 271.71 ± 3.53 | 133% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp1024 | 279.86 ± 45.63 | 100% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp2048 | 320.77 ± 5.00 | 124% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg128 | 43.51 ± 0.05 | 111% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg256 | 43.35 ± 0.09 | 110% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg512 | 42.60 ± 0.31 | 105% |
Q4_0_8_8 offers a nice bump to prompt processing and a small bump to text generation
</details>
</details>
## Which file should I choose?
<details>
<summary>Click here for details</summary>
A great write up with charts showing various performances is provided by Artefact2 [here](https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9)
The first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have.
If you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.
If you want the absolute maximum quality, add both your system RAM and your GPU's VRAM together, then similarly grab a quant with a file size 1-2GB Smaller than that total.
Next, you'll need to decide if you want to use an 'I-quant' or a 'K-quant'.
If you don't want to think too much, grab one of the K-quants. These are in format 'QX_K_X', like Q5_K_M.
If you want to get more into the weeds, you can check out this extremely useful feature chart:
[llama.cpp feature matrix](https://github.com/ggerganov/llama.cpp/wiki/Feature-matrix)
But basically, if you're aiming for below Q4, and you're running cuBLAS (Nvidia) or rocBLAS (AMD), you should look towards the I-quants. These are in format IQX_X, like IQ3_M. These are newer and offer better performance for their size.
These I-quants can also be used on CPU and Apple Metal, but will be slower than their K-quant equivalent, so speed vs performance is a tradeoff you'll have to decide.
The I-quants are *not* compatible with Vulcan, which is also AMD, so if you have an AMD card double check if you're using the rocBLAS build or the Vulcan build. At the time of writing this, LM Studio has a preview with ROCm support, and other inference engines have specific builds for ROCm.
</details>
## Credits
Thank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset.
Thank you ZeroWw for the inspiration to experiment with embed/output.
Thank you to LM Studio for sponsoring my work.
Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski

3
agentica-org_DeepScaleR-1.5B-Preview-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b3bcf41e68e20e224a5f26fd8d78cd0a9b52bd74e27d0a1fc16c455614d829f
size 876942752

3
agentica-org_DeepScaleR-1.5B-Preview-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65700250e7585098129a0d6cd4a1794c3b755b6f8b22530db87fa603f30fbce9
size 831977888

3
agentica-org_DeepScaleR-1.5B-Preview-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c995e9e6bfbe9aaa5b638bf87e9fe825f05a634469c516a76d67b8cdaa0acf25
size 769071008

3
agentica-org_DeepScaleR-1.5B-Preview-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f7844156f08a7fae7ff8d75acdd2dbf6ab68f293ef398169dd1cc4866b145e6
size 1067604896

3
agentica-org_DeepScaleR-1.5B-Preview-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5727e15d48dcd4ea9bcbfa5732b9cf80ed6a1cd82fb0a2f2e4eb839df81dadd8
size 1019712416

3
agentica-org_DeepScaleR-1.5B-Preview-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f05c6d2f31cd86e10f5e7cf0c5669e8ef33422086543b1840458daa746e97b8
size 752881568

3
agentica-org_DeepScaleR-1.5B-Preview-Q2_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9516d5d8dccd2bc7598e72c5da692ff251a7277b11ba6ef741d2526118340c46
size 980785568

3
agentica-org_DeepScaleR-1.5B-Preview-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15534d71d1ed408ae6be5a08aa0f4fe93d414f9353f5472c0c299833ca2a9d7d
size 980441504

3
agentica-org_DeepScaleR-1.5B-Preview-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d5bd442b30d74c5051699d8ce9a6906e12feed60a5578318b5a35547a471b446
size 924457376

3
agentica-org_DeepScaleR-1.5B-Preview-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:66251aeb5d5eb91ee6342c378abb0c1e7eafb1ce83f49526eb03387f5c31d9f8
size 861223328

3
agentica-org_DeepScaleR-1.5B-Preview-Q3_K_XL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f08b10b73cffdb233258f08c381df4e4d39d1a64d2dbf22350de04d79047bf2
size 1184643488

3
agentica-org_DeepScaleR-1.5B-Preview-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32ebacb157e5a2e2c8be00829160c2c6ccf69e2753aabcfc6fc942839636c950
size 1068809120

3
agentica-org_DeepScaleR-1.5B-Preview-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7298df356e0537560e31dc44b22c52e9805bb45b552762eccabd2c000f9a1b4b
size 1162701728

3
agentica-org_DeepScaleR-1.5B-Preview-Q4_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a6d853468859097ac1496529f797475f486909e4a698081b75b57ee00f68cb4b
size 1290529184

3
agentica-org_DeepScaleR-1.5B-Preview-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf51b412360a84792ae9145e2ca322379234c118dbff498ff08e589253b67ded
size 1117322144

3
agentica-org_DeepScaleR-1.5B-Preview-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b2658ee66a78334486d7ed47355747aa4f0e54fbf70319815af4cceb8d1e4ef
size 1071586208

3
agentica-org_DeepScaleR-1.5B-Preview-Q5_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fcaad8a946a6a6bbf38e9df31610d57fb96cffce97b00959dbf8a9d28f5a966b
size 1429531040

3
agentica-org_DeepScaleR-1.5B-Preview-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd02d15193c903fc0ba6b1fd7c41edd087f6f8616d2bec0af202775e47248bc5
size 1285495712

3
agentica-org_DeepScaleR-1.5B-Preview-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1b7c72ef561424a871f1403ebdb27703d5a08bbf9d2fd358a7947fe83ff46d9
size 1259174816

3
agentica-org_DeepScaleR-1.5B-Preview-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d33bcba2424718723ede65057f21e991e736340c3b27c36628583f27076a09a1
size 1464180128

3
agentica-org_DeepScaleR-1.5B-Preview-Q6_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b83a9424dde81a6aeeb13d64aef2e6e7a6d511de419b9b898aaa2e6f4d5a10a5
size 1577220512

3
agentica-org_DeepScaleR-1.5B-Preview-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:932ecb3ae043335c78dab621f032d32eb1868c80a27b4fe5f39c7850902de940
size 1894533536

3
agentica-org_DeepScaleR-1.5B-Preview-f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f0b350e65b4edd701c86fa3e75feb79a4e9b829f396809f389e041a7c9625f52
size 3560417696

3
agentica-org_DeepScaleR-1.5B-Preview-f32.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84159ad584aa54f1494e680899d405c8c3deaea300b507fcb30b98498cbd9ef5
size 7114303584

3
agentica-org_DeepScaleR-1.5B-Preview.imatrix Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6b1514490bf58737eaeec631d03281d604036d591dfea8ddc9093809133880d
size 2042214

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}