初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/MobileLLM-1.5B-GGUF Source: Original Platform
This commit is contained in:
47
.gitattributes
vendored
Normal file
47
.gitattributes
vendored
Normal file
@@ -0,0 +1,47 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
MobileLLM-1.5B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
MobileLLM-1.5B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
MobileLLM-1.5B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
MobileLLM-1.5B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
MobileLLM-1.5B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
MobileLLM-1.5B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
MobileLLM-1.5B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
MobileLLM-1.5B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
MobileLLM-1.5B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
MobileLLM-1.5B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
MobileLLM-1.5B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
MobileLLM-1.5B.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
MobileLLM-1.5B.IQ4_XS.gguf
Normal file
3
MobileLLM-1.5B.IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:68cbcafe666967cf94ee62e97b19e427705dc2bef2de7238746bbadfce7384d9
|
||||
size 905758368
|
||||
3
MobileLLM-1.5B.Q2_K.gguf
Normal file
3
MobileLLM-1.5B.Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1a16c108ac530bf274760d55baea8c40fb840ce6829cf42d652dafca8c67fd99
|
||||
size 859313568
|
||||
3
MobileLLM-1.5B.Q3_K_L.gguf
Normal file
3
MobileLLM-1.5B.Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:430fe617534b1b046c5c9b9c43a2891c78f7250264a913c0784e151659198cd2
|
||||
size 983902368
|
||||
3
MobileLLM-1.5B.Q3_K_M.gguf
Normal file
3
MobileLLM-1.5B.Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1c82586688a55d56d9e3c17e9689c86dde1598cfc3f65c8b2965b32fbad168b3
|
||||
size 929207968
|
||||
3
MobileLLM-1.5B.Q3_K_S.gguf
Normal file
3
MobileLLM-1.5B.Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:eb9def38d7b9862d0ec1e47071cb44a4328e0fa24ce103905d47c602d2b0a57a
|
||||
size 855857568
|
||||
3
MobileLLM-1.5B.Q4_K_M.gguf
Normal file
3
MobileLLM-1.5B.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e9178986daff8f8c88e1f95c2d7ec0781cd003eb0cadd7051eeaea3677f49fc6
|
||||
size 1099339168
|
||||
3
MobileLLM-1.5B.Q4_K_S.gguf
Normal file
3
MobileLLM-1.5B.Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a68ad9b3c827288eea4c95279591fbf7c7adcad9e039c773193cf392513ffacf
|
||||
size 1053022368
|
||||
3
MobileLLM-1.5B.Q5_K_M.gguf
Normal file
3
MobileLLM-1.5B.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5a6c4f5a25168cf0ffafd70c2c56976e1e26565a0a443020c4a02d84a865b1cd
|
||||
size 1193815968
|
||||
3
MobileLLM-1.5B.Q5_K_S.gguf
Normal file
3
MobileLLM-1.5B.Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:50ec60cb724db0eaa3d7ec0a73ef8247750b60806aa7ec5656bb15aab141cc68
|
||||
size 1165611168
|
||||
3
MobileLLM-1.5B.Q6_K.gguf
Normal file
3
MobileLLM-1.5B.Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:dc5ee229527d5238df9c6faadc8218cdee5cb4a396e081bfca8e30c86ec4d2f2
|
||||
size 1570238368
|
||||
3
MobileLLM-1.5B.Q8_0.gguf
Normal file
3
MobileLLM-1.5B.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:210677e58ffddc7c0edbee20d3cce0cbc10a32c1a651278743eae36c5549ac51
|
||||
size 1661303968
|
||||
3
MobileLLM-1.5B.f16.gguf
Normal file
3
MobileLLM-1.5B.f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e1433efb3efc238903e7e666be6dbd6534148a3d42ccfa0d55731d08198a0c19
|
||||
size 3125879968
|
||||
236
README.md
Normal file
236
README.md
Normal file
@@ -0,0 +1,236 @@
|
||||
---
|
||||
base_model: facebook/MobileLLM-1.5B
|
||||
extra_gated_button_content: Submit
|
||||
extra_gated_fields:
|
||||
Affiliation: text
|
||||
? By clicking Submit below I accept the terms of the license and acknowledge that
|
||||
the information I provide will be collected stored processed and shared in accordance
|
||||
with the Meta Privacy Policy
|
||||
: checkbox
|
||||
Country: country
|
||||
Date of birth: date_picker
|
||||
First Name: text
|
||||
Job title:
|
||||
options:
|
||||
- Student
|
||||
- Research Graduate
|
||||
- AI researcher
|
||||
- AI developer/engineer
|
||||
- Reporter
|
||||
- Other
|
||||
type: select
|
||||
Last Name: text
|
||||
geo: ip_location
|
||||
extra_gated_heading: Please be sure to provide your full legal name, date of birth,
|
||||
and full organization name with all corporate identifiers. Avoid the use of acronyms
|
||||
and special characters. Failure to follow these instructions may prevent you from
|
||||
accessing this model and others on Hugging Face. You will not have the ability to
|
||||
edit this form after submission, so please ensure all information is accurate.
|
||||
extra_gated_prompt: "FAIR Noncommercial Research License\nLast Updated: April 17,
|
||||
2025\n\n“Acceptable Use Policy” means the FAIR Acceptable Use Policy, applicable
|
||||
to Research Materials, that is incorporated into this Agreement.\n\n“Agreement”
|
||||
means the terms and conditions for use, reproduction, distribution and modification
|
||||
of the Research Materials set forth herein.\n\n\n“Documentation” means the specifications,
|
||||
manuals and documentation accompanying \nResearch Materials distributed by Meta.\n\n\n“Licensee”
|
||||
or “you” means you, or your employer or any other person or entity (if you are entering
|
||||
into this Agreement on such person or entity’s behalf), of the age required under
|
||||
applicable laws, rules or regulations to provide legal consent and that has legal
|
||||
authority to bind your employer or such other person or entity if you are entering
|
||||
in this Agreement on their behalf.\n\n\n“Meta” or “we” means Meta Platforms Ireland
|
||||
Limited (if you are located in or, if you are an entity, your principal place of
|
||||
business is in the EEA or Switzerland) and Meta Platforms, Inc. (if you are located
|
||||
outside of the EEA or Switzerland).\n\n“Noncommercial Research Uses” means noncommercial
|
||||
research use cases related to research, development, education, processing, or analysis
|
||||
and in each case, is not primarily intended for commercial advantage or monetary
|
||||
compensation to you or others.\n\n“Research Materials” means, collectively, Documentation
|
||||
and the models, software and algorithms, including machine-learning model code,
|
||||
trained model weights, inference-enabling code, training-enabling code, fine-tuning
|
||||
enabling code, demonstration materials and other elements of the foregoing distributed
|
||||
by Meta and made available under this Agreement.\n\nBy clicking “I Accept” below
|
||||
or by using or distributing any portion or element of the Research Materials, you
|
||||
agree to be bound by this Agreement.\n\n\n1. License Rights and Redistribution.\n\n\na.
|
||||
Grant of Rights. You are granted a non-exclusive, worldwide, non-transferable and
|
||||
royalty-free limited license under Meta’s intellectual property or other rights
|
||||
owned by Meta embodied in the Research Materials to use, reproduce, distribute,
|
||||
copy, create derivative works of, and make modifications to the Research Materials.
|
||||
\ \n \nb. Redistribution and Use. \n i. You will not use the Research Materials
|
||||
or any outputs or results of the Research Materials in connection with any commercial
|
||||
uses or for any uses other than Noncommercial Research Uses;\n\n\nii. Distribution
|
||||
of Research Materials, and any derivative works thereof, are subject to the terms
|
||||
of this Agreement. If you distribute or make the Research Materials, or any derivative
|
||||
works thereof, available to a third party, you may only do so under the terms of
|
||||
this Agreement. You shall also provide a copy of this Agreement to such third party.\n\n\niii.
|
||||
\ If you submit for publication the results of research you perform on, using, or
|
||||
otherwise in connection with Research Materials, you must acknowledge the use of
|
||||
Research Materials in your publication.\n\n\niv. Your use of the Research Materials
|
||||
must comply with applicable laws and regulations (including Trade Control Laws)
|
||||
and adhere to the FAIR Acceptable Use Policy, which is hereby incorporated by reference
|
||||
into this Agreement.\n2. User Support. Your Noncommercial Research Use of the Research
|
||||
Materials is done at your own discretion; Meta does not process any information
|
||||
nor provide any service in relation to such use. Meta is under no obligation to
|
||||
provide any support services for the Research Materials. Any support provided is
|
||||
“as is”, “with all faults”, and without warranty of any kind.\n\n\n3. Disclaimer
|
||||
of Warranty. UNLESS REQUIRED BY APPLICABLE LAW, THE RESEARCH MATERIALS AND ANY OUTPUT
|
||||
AND RESULTS THEREFROM ARE PROVIDED ON AN “AS IS” BASIS, WITHOUT WARRANTIES OF ANY
|
||||
KIND, AND META DISCLAIMS ALL WARRANTIES OF ANY KIND, BOTH EXPRESS AND IMPLIED, INCLUDING,
|
||||
WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY,
|
||||
OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING
|
||||
THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE RESEARCH MATERIALS AND ASSUME
|
||||
ANY RISKS ASSOCIATED WITH YOUR USE OF THE RESEARCH MATERIALS AND ANY OUTPUT AND
|
||||
RESULTS.\n \n4. Limitation of Liability. IN NO EVENT WILL META OR ITS AFFILIATES
|
||||
BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE,
|
||||
PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR ANY LOST PROFITS
|
||||
OR ANY DIRECT OR INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE
|
||||
DAMAGES, EVEN IF META OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF
|
||||
ANY OF THE FOREGOING.\n \n5. Intellectual Property.\n\n\na. Subject to Meta’s ownership
|
||||
of Research Materials and derivatives made by or for Meta, with respect to any derivative
|
||||
works and modifications of the Research Materials that are made by you, as between
|
||||
you and Meta, you are and will be the owner of such derivative works and modifications.\n
|
||||
\nb. If you institute litigation or other proceedings against Meta or any entity
|
||||
(including a cross-claim or counterclaim in a lawsuit) alleging that the Research
|
||||
Materials, outputs or results, or any portion of any of the foregoing, constitutes
|
||||
infringement of intellectual property or other rights owned or licensable by you,
|
||||
then any licenses granted to you under this Agreement shall terminate as of the
|
||||
date such litigation or claim is filed or instituted. You will indemnify and hold
|
||||
harmless Meta from and against any claim by any third party arising out of or related
|
||||
to your use or distribution of the Research Materials.\n \n6. Term and Termination.
|
||||
The term of this Agreement will commence upon your acceptance of this Agreement
|
||||
or access to the Research Materials and will continue in full force and effect until
|
||||
terminated in accordance with the terms and conditions herein. Meta may terminate
|
||||
this Agreement if you are in breach of any term or condition of this Agreement.
|
||||
Upon termination of this Agreement, you shall delete and cease use of the Research
|
||||
Materials. Sections 5, 6 and 9 shall survive the termination of this Agreement.
|
||||
\n \n7. Governing Law and Jurisdiction. This Agreement will be governed and construed
|
||||
under the laws of the State of California without regard to choice of law principles,
|
||||
and the UN Convention on Contracts for the International Sale of Goods does not
|
||||
apply to this Agreement. The courts of California shall have exclusive jurisdiction
|
||||
of any dispute arising out of this Agreement. \n\n\n8. Modifications and Amendments.
|
||||
Meta may modify this Agreement from time to time by posting a revised version at
|
||||
[https://huggingface.co/facebook/Perception-LM-8B/blob/main/LICENSE]; provided that
|
||||
they are similar in spirit to the current version of the Agreement, but may differ
|
||||
in detail to address new problems or concerns. All such changes will be effective
|
||||
immediately. Your continued use of the Research Materials after any modification
|
||||
to this Agreement constitutes your agreement to such modification. Except as provided
|
||||
in this Agreement, no modification or addition to any provision of this Agreement
|
||||
will be binding unless it is in writing and signed by an authorized representative
|
||||
of both you and Meta.\n\n\nFAIR Acceptable Use Policy \n\nThe Fundamental AI Research
|
||||
(FAIR) team at Meta seeks to further understanding of new and existing research
|
||||
domains with the mission of advancing the state-of-the-art in artificial intelligence
|
||||
through open research for the benefit of all. \n\nAs part of this mission, Meta
|
||||
makes certain research materials available for noncommercial research use. Meta
|
||||
is committed to promoting the safe and responsible use of such research materials.
|
||||
\ \n\nProhibited Uses\n\nYou agree you will not use, or allow others to use, Research
|
||||
Materials to:\n\n Violate the law or others’ rights, including to:\nEngage in, promote,
|
||||
generate, contribute to, encourage, plan, incite, or further illegal or unlawful
|
||||
activity or content, such as:\nViolence or terrorism\nExploitation or harm to children,
|
||||
including the solicitation, creation, acquisition, or dissemination of child exploitative
|
||||
content or failure to report Child Sexual Abuse Material\nHuman trafficking, exploitation,
|
||||
and sexual violence\nThe illegal distribution of information or materials to minors,
|
||||
including obscene materials, or failure to employ legally required age-gating in
|
||||
connection with such information or materials.\nSexual solicitation\nAny other criminal
|
||||
activity\n\nEngage in, promote, incite, or facilitate the harassment, abuse, threatening,
|
||||
or bullying of individuals or groups of individuals\n\nEngage in, promote, incite,
|
||||
or facilitate discrimination or other unlawful or harmful conduct in the provision
|
||||
of employment, employment benefits, credit, housing, other economic benefits, or
|
||||
other essential goods and services\n\nEngage in the unauthorized or unlicensed practice
|
||||
of any profession including, but not limited to, financial, legal, medical/health,
|
||||
or related professional practices\n\nCollect, process, disclose, generate, or infer
|
||||
health, demographic, or other sensitive personal or private information about individuals
|
||||
without rights and consents required by applicable laws\n\nEngage in or facilitate
|
||||
any action or generate any content that infringes, misappropriates, or otherwise
|
||||
violates any third-party rights, including the outputs or results of any technology
|
||||
using FAIR research materials\n\nCreate, generate, or facilitate the creation of
|
||||
malicious code, malware, computer viruses or do anything else that could disable,
|
||||
overburden, interfere with or impair the proper working, integrity, operation or
|
||||
appearance of a website or computer system\n\n2. Engage in, promote, incite, facilitate,
|
||||
or assist in the planning or development of activities that present a risk of death
|
||||
or bodily harm to individuals, including use of research artifacts related to the
|
||||
following:\n\nMilitary, warfare, nuclear industries or applications, espionage,
|
||||
use for materials or activities that are subject to the International Traffic Arms
|
||||
Regulations (ITAR) maintained by the United States Department of State\n\nGuns and
|
||||
illegal weapons (including weapon development)\n\nIllegal drugs and regulated/controlled
|
||||
substances\n\nOperation of critical infrastructure, transportation technologies,
|
||||
or heavy machinery\n\nSelf-harm or harm to others, including suicide, cutting, and
|
||||
eating disorders\n\nAny content intended to incite or promote violence, abuse, or
|
||||
any infliction of bodily harm to an individual\n\n3. Intentionally deceive or mislead
|
||||
others, including use of FAIR Research Materials related to the following:\n\n Generating,
|
||||
promoting, or furthering fraud or the creation or promotion of disinformation\n\n
|
||||
Generating, promoting, or furthering defamatory content, including the creation
|
||||
of defamatory statements, images, or other content\n\nGenerating, promoting, or
|
||||
further distributing spam\n\n Impersonating another individual without consent,
|
||||
authorization, or legal right\n\nRepresenting that outputs of FAIR research materials
|
||||
or outputs from technology using FAIR research materials are human-generated\n\nGenerating
|
||||
or facilitating false online engagement, including fake reviews and other means
|
||||
of fake online engagement\n\n4. Fail to appropriately disclose to end users any
|
||||
known dangers of your Research Materials.\n\nPlease report any violation of this
|
||||
Policy or other problems that could lead to a violation of this Policy by submitting
|
||||
a report here [https://docs.google.com/forms/d/e/1FAIpQLSeb11cryAopJ7LNrC4nxEUXrHY26hfkXQMf_uH-oFgA3WlYZQ/viewform].
|
||||
\n"
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
license: other
|
||||
license_name: fair-noncommercial-research
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- facebook
|
||||
- meta
|
||||
- pytorch
|
||||
- mobilellm
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: -->
|
||||
static quants of https://huggingface.co/facebook/MobileLLM-1.5B
|
||||
|
||||
<!-- provided-files -->
|
||||
weighted/imatrix quants are available at https://huggingface.co/mradermacher/MobileLLM-1.5B-i1-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q3_K_S.gguf) | Q3_K_S | 1.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q2_K.gguf) | Q2_K | 1.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.IQ4_XS.gguf) | IQ4_XS | 1.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q3_K_M.gguf) | Q3_K_M | 1.0 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q3_K_L.gguf) | Q3_K_L | 1.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q4_K_S.gguf) | Q4_K_S | 1.2 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q4_K_M.gguf) | Q4_K_M | 1.2 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q5_K_S.gguf) | Q5_K_S | 1.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q5_K_M.gguf) | Q5_K_M | 1.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q6_K.gguf) | Q6_K | 1.7 | very good quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q8_0.gguf) | Q8_0 | 1.8 | fast, best quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.f16.gguf) | f16 | 3.2 | 16 bpw, overkill |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time.
|
||||
|
||||
<!-- end -->
|
||||
Reference in New Issue
Block a user