mradermacher/Atlas-Pro-7B-Preview-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Atlas-Pro-7B-Preview-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-21 17:29:48 +08:00
commit 66e4c6fd34
27 changed files with 275 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Atlas-Pro-7B-Preview.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Atlas-Pro-7B-Preview.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f20b3688405a91a2eab8d8e5c126810411e3a848f63e1cbebff5663108b9b476
size 2042197600

3
Atlas-Pro-7B-Preview.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:916e5d44a762e1c875099815b0f4e3e32832fd40819128f9f5cb08d688ff1b09
size 1903668832

3
Atlas-Pro-7B-Preview.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af8a3b5c3aa54c90b64e2e4897de77553d0bdf26e48b08dd184fc3d01a9d61d3
size 2780343904

3
Atlas-Pro-7B-Preview.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0492c0d78be68506ae71ddf06f8b21e97974a06a322abe4f91424d2e1c31b009
size 2595638880

3
Atlas-Pro-7B-Preview.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f3e6b123719e340dcec463e1ff2d36363749bb7bfa2425f65c1dc5b41e84cc48
size 2469023328

3
Atlas-Pro-7B-Preview.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9379b01ea89b2dde81a5fb82edca919b385f92ab5d30f585d5206824c3d9e00
size 2273078880

3
Atlas-Pro-7B-Preview.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:febb768d4f32b0203a90d11afee0fd4074c59f353b7a1e93f5931e31039b4c1a
size 3574013536

3
Atlas-Pro-7B-Preview.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e8d441234b77bdbcf73b938e5d51230dcead66283256d0ae21b5336de60bbd56
size 3499193952

3
Atlas-Pro-7B-Preview.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59520967f8eb47b48a84fc2efbc6a9991f461674fb11bbf97606adeade93834a
size 3346257504

3
Atlas-Pro-7B-Preview.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f12983adc2fa052e52343f1b900f9179db437ad36fec819eb4f585b93974d29b
size 3114516064

3
Atlas-Pro-7B-Preview.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a44014cd4756ed4666446a957ca2f8cd7749f3d157506eed048f1dae29818e78
size 4437814880

3
Atlas-Pro-7B-Preview.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5ad89557af890614192f01eb7d9abd8a358a92d18cd936b589c86b1116b24637
size 4218474080

3
Atlas-Pro-7B-Preview.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2caaea78d3b36bc2397c3e496ad22c9fdce2207f4e0b60a6a7728d674364a2cd
size 3015941728

3
Atlas-Pro-7B-Preview.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9879a4643118fd19abd71c751d73d1e4f7a53c227f899fe95fd953fbc81f83e8
size 2834075232

3
Atlas-Pro-7B-Preview.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49e349794ad0d11cc20393753b9e270065a6f399425db6544a1e952142278eac
size 4088460896

3
Atlas-Pro-7B-Preview.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:677a5a7a23ce730bb441930739b9ccad2c62b8ef47d0d2f2a3d71cfe20e5b691
size 3808392800

3
Atlas-Pro-7B-Preview.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ddcd55554286125163db34cfa589bf5c9fb4a212f0da40345be0dbcf16d7c9b
size 3492370016

3
Atlas-Pro-7B-Preview.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:685fd01bd7482bc38a4a271516fb6adedec5d2836c4006c42455a64398b0a56d
size 4444122720

3
Atlas-Pro-7B-Preview.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:538158bf9e203792474747e06601a6055c069bc578bfc705920b759a38e83c4a
size 4873285216

3
Atlas-Pro-7B-Preview.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff36dce2cf50983f802a4795249203eddd56dc46225db9c1283fe69591a4061b
size 4683075168

3
Atlas-Pro-7B-Preview.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6aade892a0fdcd4a834f1504285c15948fe2ff0c010a2ba7af6a4a950d887e71
size 4457770592

3
Atlas-Pro-7B-Preview.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8e4b67457e0d045586531d67c0d50ea48d3dfa62b7ff1767a7166598b74f25f9
size 5444832864

3
Atlas-Pro-7B-Preview.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6f51ee1bf012f7fd19be565ee03769a9db97e2003328504be0824f7b51cd9ce
size 5315178080

3
Atlas-Pro-7B-Preview.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ab9ceca9d8a98fb96115cdb536dde14291b7bad8981b2dc03844239aad8dabf
size 6254200416

140
README.md Normal file
View File

@@ -0,0 +1,140 @@
---
base_model: aayanmishra-ml/Athena-R3-7B
datasets:
- openai/gsm8k
- HuggingFaceH4/ultrachat_200k
extra_gated_fields:
Country: country
Date of Birth: date_picker
I agree to use this model in accordance with all applicable laws and ethical guidelines: checkbox
I agree to use this model under the MIT licence: checkbox
Intended Use:
options:
- Research
- Education
- Personal Development
- Commercial Use
- label: Other
value: other
type: select
Name: text
Organization: text
extra_gated_prompt: By accessing this model, you agree to comply with ethical usage
guidelines and accept full responsibility for its applications. You will not use
this model for harmful, malicious, or illegal activities, and you understand that
the model's use is subject to ongoing monitoring for misuse. This model is provided
'AS IS' and agreeing to this means that you are responsible for all the outputs
generated by you
language:
- en
- zh
- fr
- es
- pt
- de
- it
- ru
- ja
- ko
- vi
- th
- ar
- fa
- he
- tr
- cs
- pl
- hi
- bn
- ur
- id
- ms
- lo
- my
- ceb
- km
- tl
- nl
library_name: transformers
license: mit
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
- trl
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/aayanmishra-ml/Athena-R3-7B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Atlas-Pro-7B-Preview-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-IQ1_S.gguf) | i1-IQ1_S | 2.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-IQ1_M.gguf) | i1-IQ1_M | 2.1 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-IQ2_S.gguf) | i1-IQ2_S | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-IQ2_M.gguf) | i1-IQ2_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.9 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-Q2_K.gguf) | i1-Q2_K | 3.1 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.4 | |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-IQ3_S.gguf) | i1-IQ3_S | 3.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-IQ3_M.gguf) | i1-IQ3_M | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-Q4_0.gguf) | i1-Q4_0 | 4.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-Q4_1.gguf) | i1-Q4_1 | 5.0 | |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/Atlas-Pro-7B-Preview-i1-GGUF/resolve/main/Atlas-Pro-7B-Preview.i1-Q6_K.gguf) | i1-Q6_K | 6.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3ceb0c46b868f086404bab784383e9d4b5a0dda92c7443c4cf4d79787fab145
size 4536665