Compare commits

..

10 Commits

Author SHA1 Message Date
Michael Radermacher
4b5252fefa auto-patch README.md 2024-08-02 10:58:38 +00:00
Michael Radermacher
d011d9d10d auto-patch README.md 2024-06-05 08:44:45 +00:00
Michael Radermacher
e15a95c65d uploaded from nethype/db1 2024-06-04 06:28:52 +00:00
Michael Radermacher
297facad9b uploaded from nethype/db1 2024-06-04 06:26:21 +00:00
Michael Radermacher
547dc669d6 uploaded from nethype/db1 2024-06-04 06:18:48 +00:00
Michael Radermacher
2ab4f0a9de uploaded from nethype/db1 2024-06-04 06:10:10 +00:00
Michael Radermacher
66495a75ec uploaded from nethype/db1 2024-06-04 06:00:50 +00:00
Michael Radermacher
a456a1cd8f uploaded from nethype/db1 2024-06-04 05:56:42 +00:00
Michael Radermacher
30655585b7 uploaded from nethype/db1 2024-06-04 05:53:11 +00:00
Michael Radermacher
8977c6cab3 uploaded from nethype/db1 2024-06-04 05:49:18 +00:00
10 changed files with 41 additions and 1 deletions

8
.gitattributes vendored
View File

@@ -47,3 +47,11 @@ piano-medley-7b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
piano-medley-7b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text piano-medley-7b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
piano-medley-7b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text piano-medley-7b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
piano-medley-7b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text piano-medley-7b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
piano-medley-7b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
piano-medley-7b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
piano-medley-7b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
piano-medley-7b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
piano-medley-7b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
piano-medley-7b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
piano-medley-7b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
piano-medley-7b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text

View File

@@ -41,10 +41,18 @@ more details, including on how to concatenate multi-part files.
| Link | Type | Size/GB | Notes | | Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------| |:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ1_S.gguf) | i1-IQ1_S | 1.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ1_M.gguf) | i1-IQ1_M | 1.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ2_S.gguf) | i1-IQ2_S | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ2_M.gguf) | i1-IQ2_M | 2.6 | | | [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ2_M.gguf) | i1-IQ2_M | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-Q2_K.gguf) | i1-Q2_K | 2.8 | IQ3_XXS probably better | | [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-Q2_K.gguf) | i1-Q2_K | 2.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.9 | lower quality | | [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.1 | |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.3 | IQ3_XS probably better | | [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.3 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ3_S.gguf) | i1-IQ3_S | 3.3 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ3_M.gguf) | i1-IQ3_M | 3.4 | |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.6 | IQ3_S probably better | | [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.9 | IQ3_M probably better | | [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.0 | | | [GGUF](https://huggingface.co/mradermacher/piano-medley-7b-i1-GGUF/resolve/main/piano-medley-7b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.0 | |
@@ -72,6 +80,6 @@ questions you might have and/or if you want some other model quantized.
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his hardware for calculating the imatrix for these quants. this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end --> <!-- end -->

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf1ec17af6acbaa465fe3e417b425d179e7b5eab355109b1540e73380e305b13
size 1754446272

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da723d24d108c6f2512839bef732f798b66cece0a54bc565d638d142adb9dc77
size 1612102080

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52fd2dc12272c1286e843c8fe3432eb32d52800e90b6ed7ad561a52fb0627447
size 2310920640

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be2bb0b5325021f193a973b6bb83e3c0161fb70db7060c2d90751eb30e17e887
size 2198256064

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aed10c965a8f54d00b093b9eddda125a9fa12da3815c17d425cbe265d8daf22c
size 1991686592

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0bb432ddfb972dfef54ea7bcd423e48e525c5e8843376d6bb80be295d80f8bea
size 3284892096

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:924d97309a7019d9e14db67f026aec57780bda294ad2f160e74bb32dc26f098b
size 3182393792

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f4e3043679be86bfc46473b6167f21270ac2c76af929312a3a1f3ad716350a9
size 3018815936