初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/LogicLumina-L3-13B-v2-i1-GGUF Source: Original Platform
This commit is contained in:
57
.gitattributes
vendored
Normal file
57
.gitattributes
vendored
Normal file
@@ -0,0 +1,57 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
imatrix.dat filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LogicLumina-L3-13B-v2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
LogicLumina-L3-13B-v2.i1-IQ1_M.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b9a7e77254f2eed21328609bbc4f8f478419794360419b6a585858ea89461318
|
||||
size 3138609984
|
||||
3
LogicLumina-L3-13B-v2.i1-IQ1_S.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:26f9cda858ea6635bb6b8f9c424d3896d417fffe3ec4c94520970b2abb31faf1
|
||||
size 2898686784
|
||||
3
LogicLumina-L3-13B-v2.i1-IQ2_M.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3fcb11406235584920b62b00d9e5ce11030a53534b5c76ff24646332f99d875d
|
||||
size 4517579584
|
||||
3
LogicLumina-L3-13B-v2.i1-IQ2_S.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:15def199c69c9336e3e7d79868e97fe21a7b5192d1006a7f8338a61a727677d7
|
||||
size 4197681984
|
||||
3
LogicLumina-L3-13B-v2.i1-IQ2_XS.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:41d8accaab098cff3d58bdee84e8d753c80d34101568d3d8770ec95a62653723
|
||||
size 3891147584
|
||||
3
LogicLumina-L3-13B-v2.i1-IQ2_XXS.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3e00bb2c9b3287c155ff3232ec3b5013e05b89a2d3a9db8934a3540e267c8b73
|
||||
size 3538481984
|
||||
3
LogicLumina-L3-13B-v2.i1-IQ3_M.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f8e5d305b454c421dfc7e403b44e858a4da95c6e8d9c0e6cc530c16ba245a7dc
|
||||
size 5984510784
|
||||
3
LogicLumina-L3-13B-v2.i1-IQ3_S.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ca815e21ee4a1b369d9d60c441af67f231464f3c719530129d9e3600bc4d09b2
|
||||
size 5658981184
|
||||
3
LogicLumina-L3-13B-v2.i1-IQ3_XS.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9d1248a4fba28ad799e6f2f79d7873409f1b31d278e14b7b8e5370e636107d5c
|
||||
size 5361611584
|
||||
3
LogicLumina-L3-13B-v2.i1-IQ3_XXS.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f4e5faace1a64a2395183d1a0f474131621f56b12ca5b98f37c50a5829c8e2f7
|
||||
size 4960561984
|
||||
3
LogicLumina-L3-13B-v2.i1-IQ4_XS.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3aa1d37f28af996076c0f46c5a080030b491aa030b5cabeaf9ee9608392f41ff
|
||||
size 6964222784
|
||||
3
LogicLumina-L3-13B-v2.i1-Q2_K.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ac1ff7e0cfa1e64cb61d1660a6e582d1c1dbbfee256e124d055d29f609e7045f
|
||||
size 4854270784
|
||||
3
LogicLumina-L3-13B-v2.i1-Q3_K_L.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:74f80af0a3290505f86bd73b1fa791b6e8a135f796ce483a264efd8c67589e91
|
||||
size 6929560384
|
||||
3
LogicLumina-L3-13B-v2.i1-Q3_K_M.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2cdea7b7dbb8727bb3bed69e1dcf7c8d1688a7e45615806ef597ad4ac738924b
|
||||
size 6337770304
|
||||
3
LogicLumina-L3-13B-v2.i1-Q3_K_S.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:81f865075b0101890598887f93a1d06bc40bd23d3eebaa074af6d344550761a1
|
||||
size 5658981184
|
||||
3
LogicLumina-L3-13B-v2.i1-Q4_0.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a2d18a6e4e7a5aec93099dcd0404b60de49769a26bf5c658d2b0ccd7dfa8b69e
|
||||
size 7387953984
|
||||
3
LogicLumina-L3-13B-v2.i1-Q4_K_M.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:37df30b5b5d1606da3b4be1aaaf348ad256c6fd232ba7c0cbb3bf051559566a0
|
||||
size 7865957184
|
||||
3
LogicLumina-L3-13B-v2.i1-Q4_K_S.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d9e9040e14fd82f6c9654c16f764c9ecb6d7d60f76886eff639ef6f0f873914d
|
||||
size 7423179584
|
||||
3
LogicLumina-L3-13B-v2.i1-Q5_K_M.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f723f9ba57874446a92642ae9f87465420ab4103efbe5b39c65af1426d378bbe
|
||||
size 9229925184
|
||||
3
LogicLumina-L3-13B-v2.i1-Q5_K_S.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:99346299f77c1e26282ffa9573e3888970af64c7f6aaa7249c83baf9482eaf37
|
||||
size 8972286784
|
||||
3
LogicLumina-L3-13B-v2.i1-Q6_K.gguf
Normal file
3
LogicLumina-L3-13B-v2.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:70b96052d14ae8394f801c1b23fa99bdd03a249d710533f32b2c5a64047dabea
|
||||
size 10679141184
|
||||
78
README.md
Normal file
78
README.md
Normal file
@@ -0,0 +1,78 @@
|
||||
---
|
||||
base_model: Abdulhanan2006/LogicLumina-L3-13B-v2
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- merge
|
||||
- mergekit
|
||||
- lazymergekit
|
||||
- PygmalionAI/pygmalion-2-13b
|
||||
- Abdulhanan2006/LogicLumina-L3-13B
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
weighted/imatrix quants of https://huggingface.co/Abdulhanan2006/LogicLumina-L3-13B-v2
|
||||
|
||||
<!-- provided-files -->
|
||||
static quants are available at https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 3.2 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-IQ2_S.gguf) | i1-IQ2_S | 4.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-IQ2_M.gguf) | i1-IQ2_M | 4.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-Q2_K.gguf) | i1-Q2_K | 5.0 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.1 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-IQ3_S.gguf) | i1-IQ3_S | 5.8 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.8 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-IQ3_M.gguf) | i1-IQ3_M | 6.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.4 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.0 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 7.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-Q4_0.gguf) | i1-Q4_0 | 7.5 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.5 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 8.0 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 9.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 9.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LogicLumina-L3-13B-v2-i1-GGUF/resolve/main/LogicLumina-L3-13B-v2.i1-Q6_K.gguf) | i1-Q6_K | 10.8 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
3
imatrix.dat
Normal file
3
imatrix.dat
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6e0fbd5d61782975e660a90e2c880214fa3199666b95fab1bed53d02a0477b79
|
||||
size 7136311
|
||||
Reference in New Issue
Block a user