commit da0ae47606b9d584d03500c9018cffe808ce17ca Author: ModelHub XC Date: Tue Apr 21 23:48:41 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Einstein-7B-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..a8b3c7b --- /dev/null +++ b/.gitattributes @@ -0,0 +1,48 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Einstein-7B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Einstein-7B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Einstein-7B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Einstein-7B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Einstein-7B.f16.gguf filter=lfs diff=lfs merge=lfs -text +Einstein-7B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +Einstein-7B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Einstein-7B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Einstein-7B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Einstein-7B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Einstein-7B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Einstein-7B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Einstein-7B.Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Einstein-7B.IQ4_XS.gguf b/Einstein-7B.IQ4_XS.gguf new file mode 100644 index 0000000..a197071 --- /dev/null +++ b/Einstein-7B.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cae567a6bc5099dac5424e754daa915f20b41c981c6c80d61d7575f11019dd6d +size 3944391264 diff --git a/Einstein-7B.Q2_K.gguf b/Einstein-7B.Q2_K.gguf new file mode 100644 index 0000000..e08854a --- /dev/null +++ b/Einstein-7B.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:862684d78c92350c8650752a6eab913a1b03366a936f298e5ca856379f339d20 +size 2719244896 diff --git a/Einstein-7B.Q3_K_L.gguf b/Einstein-7B.Q3_K_L.gguf new file mode 100644 index 0000000..854e486 --- /dev/null +++ b/Einstein-7B.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:51bb6a9665d6834fdda4543508945c7da3cc1010a841750eb1ef75fff4004803 +size 3822027360 diff --git a/Einstein-7B.Q3_K_M.gguf b/Einstein-7B.Q3_K_M.gguf new file mode 100644 index 0000000..27a7f09 --- /dev/null +++ b/Einstein-7B.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1327d162850cf9aa08fcca9fd49979ea7570a34bdbd9966d8f59ed61e9e68b6a +size 3518988896 diff --git a/Einstein-7B.Q3_K_S.gguf b/Einstein-7B.Q3_K_S.gguf new file mode 100644 index 0000000..2d80a30 --- /dev/null +++ b/Einstein-7B.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:681865661f764267913e453382c599af622a8c39d54cada8eacc21f2e19b85d2 +size 3164570208 diff --git a/Einstein-7B.Q4_0_4_4.gguf b/Einstein-7B.Q4_0_4_4.gguf new file mode 100644 index 0000000..1abec69 --- /dev/null +++ b/Einstein-7B.Q4_0_4_4.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3719a33c999e0f151639ca8175f354c19602a84e272da8c2ef9a1f7bddaf7fa5 +size 4108919392 diff --git a/Einstein-7B.Q4_K_M.gguf b/Einstein-7B.Q4_K_M.gguf new file mode 100644 index 0000000..581074a --- /dev/null +++ b/Einstein-7B.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b1f958cd9d05f2d993b488922184312dac24fb1318db1a5efbe09f026a4b857d +size 4368441952 diff --git a/Einstein-7B.Q4_K_S.gguf b/Einstein-7B.Q4_K_S.gguf new file mode 100644 index 0000000..2788032 --- /dev/null +++ b/Einstein-7B.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c073773b6ffe4624d7dd0aaa5e1e287389b868dfde041b1129cc771d53e390e6 +size 4140376672 diff --git a/Einstein-7B.Q5_K_M.gguf b/Einstein-7B.Q5_K_M.gguf new file mode 100644 index 0000000..5dad66d --- /dev/null +++ b/Einstein-7B.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4f95714ff8104b5442f23f9655405cc270ec6e9458aa44f655ee699195bd4287 +size 5131412064 diff --git a/Einstein-7B.Q5_K_S.gguf b/Einstein-7B.Q5_K_S.gguf new file mode 100644 index 0000000..25b4915 --- /dev/null +++ b/Einstein-7B.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eabc6fe75e3987790ee7f59bd64ef3063b2f5fea6dc7943bae55a09c37d9661b +size 4997718624 diff --git a/Einstein-7B.Q6_K.gguf b/Einstein-7B.Q6_K.gguf new file mode 100644 index 0000000..dc20335 --- /dev/null +++ b/Einstein-7B.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bd4047972b5d0f77d800f47eface91bf7ab78ebc0e15b378ab180e04f1c60908 +size 5942067808 diff --git a/Einstein-7B.Q8_0.gguf b/Einstein-7B.Q8_0.gguf new file mode 100644 index 0000000..4fc2de7 --- /dev/null +++ b/Einstein-7B.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b28d84b42e1c3ba6a86073f4755eaa0706458855de016df89afa4dce3447044b +size 7695860320 diff --git a/Einstein-7B.f16.gguf b/Einstein-7B.f16.gguf new file mode 100644 index 0000000..e5ec2cc --- /dev/null +++ b/Einstein-7B.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5c1509f415eb6f6222552395be9420640150df25b042818e22350e227257779a +size 14484734560 diff --git a/README.md b/README.md new file mode 100644 index 0000000..59ea736 --- /dev/null +++ b/README.md @@ -0,0 +1,79 @@ +--- +base_model: Weyaxi/Einstein-7B +datasets: +- allenai/ai2_arc +- camel-ai/physics +- camel-ai/chemistry +- camel-ai/biology +- metaeval/reclor +- openbookqa +- mandyyyyii/scibench +- derek-thomas/ScienceQA +- wenhu/TheoremQA +- TIGER-Lab/ScienceEval +language: +- en +library_name: transformers +license: other +quantized_by: mradermacher +tags: +- axolotl +- generated_from_trainer +--- +## About + + + + + + +static quants of https://huggingface.co/Weyaxi/Einstein-7B + + +weighted/imatrix quants are available at https://huggingface.co/mradermacher/Einstein-7B-i1-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.Q2_K.gguf) | Q2_K | 2.8 | | +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.Q3_K_S.gguf) | Q3_K_S | 3.3 | | +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.Q3_K_M.gguf) | Q3_K_M | 3.6 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.Q3_K_L.gguf) | Q3_K_L | 3.9 | | +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.IQ4_XS.gguf) | IQ4_XS | 4.0 | | +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.Q4_0_4_4.gguf) | Q4_0_4_4 | 4.2 | fast on arm, low quality | +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.Q4_K_S.gguf) | Q4_K_S | 4.2 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.Q4_K_M.gguf) | Q4_K_M | 4.5 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.Q5_K_S.gguf) | Q5_K_S | 5.1 | | +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.Q5_K_M.gguf) | Q5_K_M | 5.2 | | +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.Q6_K.gguf) | Q6_K | 6.0 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.Q8_0.gguf) | Q8_0 | 7.8 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/Einstein-7B-GGUF/resolve/main/Einstein-7B.f16.gguf) | f16 | 14.6 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + +