初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/MobileLLM-1.5B-GGUF Source: Original Platform
This commit is contained in:
47
.gitattributes
vendored
Normal file
47
.gitattributes
vendored
Normal file
@@ -0,0 +1,47 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MobileLLM-1.5B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MobileLLM-1.5B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MobileLLM-1.5B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MobileLLM-1.5B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MobileLLM-1.5B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MobileLLM-1.5B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MobileLLM-1.5B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MobileLLM-1.5B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MobileLLM-1.5B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MobileLLM-1.5B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MobileLLM-1.5B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MobileLLM-1.5B.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
MobileLLM-1.5B.IQ4_XS.gguf
Normal file
3
MobileLLM-1.5B.IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:68cbcafe666967cf94ee62e97b19e427705dc2bef2de7238746bbadfce7384d9
|
||||||
|
size 905758368
|
||||||
3
MobileLLM-1.5B.Q2_K.gguf
Normal file
3
MobileLLM-1.5B.Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1a16c108ac530bf274760d55baea8c40fb840ce6829cf42d652dafca8c67fd99
|
||||||
|
size 859313568
|
||||||
3
MobileLLM-1.5B.Q3_K_L.gguf
Normal file
3
MobileLLM-1.5B.Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:430fe617534b1b046c5c9b9c43a2891c78f7250264a913c0784e151659198cd2
|
||||||
|
size 983902368
|
||||||
3
MobileLLM-1.5B.Q3_K_M.gguf
Normal file
3
MobileLLM-1.5B.Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1c82586688a55d56d9e3c17e9689c86dde1598cfc3f65c8b2965b32fbad168b3
|
||||||
|
size 929207968
|
||||||
3
MobileLLM-1.5B.Q3_K_S.gguf
Normal file
3
MobileLLM-1.5B.Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:eb9def38d7b9862d0ec1e47071cb44a4328e0fa24ce103905d47c602d2b0a57a
|
||||||
|
size 855857568
|
||||||
3
MobileLLM-1.5B.Q4_K_M.gguf
Normal file
3
MobileLLM-1.5B.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e9178986daff8f8c88e1f95c2d7ec0781cd003eb0cadd7051eeaea3677f49fc6
|
||||||
|
size 1099339168
|
||||||
3
MobileLLM-1.5B.Q4_K_S.gguf
Normal file
3
MobileLLM-1.5B.Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a68ad9b3c827288eea4c95279591fbf7c7adcad9e039c773193cf392513ffacf
|
||||||
|
size 1053022368
|
||||||
3
MobileLLM-1.5B.Q5_K_M.gguf
Normal file
3
MobileLLM-1.5B.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:5a6c4f5a25168cf0ffafd70c2c56976e1e26565a0a443020c4a02d84a865b1cd
|
||||||
|
size 1193815968
|
||||||
3
MobileLLM-1.5B.Q5_K_S.gguf
Normal file
3
MobileLLM-1.5B.Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:50ec60cb724db0eaa3d7ec0a73ef8247750b60806aa7ec5656bb15aab141cc68
|
||||||
|
size 1165611168
|
||||||
3
MobileLLM-1.5B.Q6_K.gguf
Normal file
3
MobileLLM-1.5B.Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:dc5ee229527d5238df9c6faadc8218cdee5cb4a396e081bfca8e30c86ec4d2f2
|
||||||
|
size 1570238368
|
||||||
3
MobileLLM-1.5B.Q8_0.gguf
Normal file
3
MobileLLM-1.5B.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:210677e58ffddc7c0edbee20d3cce0cbc10a32c1a651278743eae36c5549ac51
|
||||||
|
size 1661303968
|
||||||
3
MobileLLM-1.5B.f16.gguf
Normal file
3
MobileLLM-1.5B.f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e1433efb3efc238903e7e666be6dbd6534148a3d42ccfa0d55731d08198a0c19
|
||||||
|
size 3125879968
|
||||||
236
README.md
Normal file
236
README.md
Normal file
@@ -0,0 +1,236 @@
|
|||||||
|
---
|
||||||
|
base_model: facebook/MobileLLM-1.5B
|
||||||
|
extra_gated_button_content: Submit
|
||||||
|
extra_gated_fields:
|
||||||
|
Affiliation: text
|
||||||
|
? By clicking Submit below I accept the terms of the license and acknowledge that
|
||||||
|
the information I provide will be collected stored processed and shared in accordance
|
||||||
|
with the Meta Privacy Policy
|
||||||
|
: checkbox
|
||||||
|
Country: country
|
||||||
|
Date of birth: date_picker
|
||||||
|
First Name: text
|
||||||
|
Job title:
|
||||||
|
options:
|
||||||
|
- Student
|
||||||
|
- Research Graduate
|
||||||
|
- AI researcher
|
||||||
|
- AI developer/engineer
|
||||||
|
- Reporter
|
||||||
|
- Other
|
||||||
|
type: select
|
||||||
|
Last Name: text
|
||||||
|
geo: ip_location
|
||||||
|
extra_gated_heading: Please be sure to provide your full legal name, date of birth,
|
||||||
|
and full organization name with all corporate identifiers. Avoid the use of acronyms
|
||||||
|
and special characters. Failure to follow these instructions may prevent you from
|
||||||
|
accessing this model and others on Hugging Face. You will not have the ability to
|
||||||
|
edit this form after submission, so please ensure all information is accurate.
|
||||||
|
extra_gated_prompt: "FAIR Noncommercial Research License\nLast Updated: April 17,
|
||||||
|
2025\n\n“Acceptable Use Policy” means the FAIR Acceptable Use Policy, applicable
|
||||||
|
to Research Materials, that is incorporated into this Agreement.\n\n“Agreement”
|
||||||
|
means the terms and conditions for use, reproduction, distribution and modification
|
||||||
|
of the Research Materials set forth herein.\n\n\n“Documentation” means the specifications,
|
||||||
|
manuals and documentation accompanying \nResearch Materials distributed by Meta.\n\n\n“Licensee”
|
||||||
|
or “you” means you, or your employer or any other person or entity (if you are entering
|
||||||
|
into this Agreement on such person or entity’s behalf), of the age required under
|
||||||
|
applicable laws, rules or regulations to provide legal consent and that has legal
|
||||||
|
authority to bind your employer or such other person or entity if you are entering
|
||||||
|
in this Agreement on their behalf.\n\n\n“Meta” or “we” means Meta Platforms Ireland
|
||||||
|
Limited (if you are located in or, if you are an entity, your principal place of
|
||||||
|
business is in the EEA or Switzerland) and Meta Platforms, Inc. (if you are located
|
||||||
|
outside of the EEA or Switzerland).\n\n“Noncommercial Research Uses” means noncommercial
|
||||||
|
research use cases related to research, development, education, processing, or analysis
|
||||||
|
and in each case, is not primarily intended for commercial advantage or monetary
|
||||||
|
compensation to you or others.\n\n“Research Materials” means, collectively, Documentation
|
||||||
|
and the models, software and algorithms, including machine-learning model code,
|
||||||
|
trained model weights, inference-enabling code, training-enabling code, fine-tuning
|
||||||
|
enabling code, demonstration materials and other elements of the foregoing distributed
|
||||||
|
by Meta and made available under this Agreement.\n\nBy clicking “I Accept” below
|
||||||
|
or by using or distributing any portion or element of the Research Materials, you
|
||||||
|
agree to be bound by this Agreement.\n\n\n1. License Rights and Redistribution.\n\n\na.
|
||||||
|
Grant of Rights. You are granted a non-exclusive, worldwide, non-transferable and
|
||||||
|
royalty-free limited license under Meta’s intellectual property or other rights
|
||||||
|
owned by Meta embodied in the Research Materials to use, reproduce, distribute,
|
||||||
|
copy, create derivative works of, and make modifications to the Research Materials.
|
||||||
|
\ \n \nb. Redistribution and Use. \n i. You will not use the Research Materials
|
||||||
|
or any outputs or results of the Research Materials in connection with any commercial
|
||||||
|
uses or for any uses other than Noncommercial Research Uses;\n\n\nii. Distribution
|
||||||
|
of Research Materials, and any derivative works thereof, are subject to the terms
|
||||||
|
of this Agreement. If you distribute or make the Research Materials, or any derivative
|
||||||
|
works thereof, available to a third party, you may only do so under the terms of
|
||||||
|
this Agreement. You shall also provide a copy of this Agreement to such third party.\n\n\niii.
|
||||||
|
\ If you submit for publication the results of research you perform on, using, or
|
||||||
|
otherwise in connection with Research Materials, you must acknowledge the use of
|
||||||
|
Research Materials in your publication.\n\n\niv. Your use of the Research Materials
|
||||||
|
must comply with applicable laws and regulations (including Trade Control Laws)
|
||||||
|
and adhere to the FAIR Acceptable Use Policy, which is hereby incorporated by reference
|
||||||
|
into this Agreement.\n2. User Support. Your Noncommercial Research Use of the Research
|
||||||
|
Materials is done at your own discretion; Meta does not process any information
|
||||||
|
nor provide any service in relation to such use. Meta is under no obligation to
|
||||||
|
provide any support services for the Research Materials. Any support provided is
|
||||||
|
“as is”, “with all faults”, and without warranty of any kind.\n\n\n3. Disclaimer
|
||||||
|
of Warranty. UNLESS REQUIRED BY APPLICABLE LAW, THE RESEARCH MATERIALS AND ANY OUTPUT
|
||||||
|
AND RESULTS THEREFROM ARE PROVIDED ON AN “AS IS” BASIS, WITHOUT WARRANTIES OF ANY
|
||||||
|
KIND, AND META DISCLAIMS ALL WARRANTIES OF ANY KIND, BOTH EXPRESS AND IMPLIED, INCLUDING,
|
||||||
|
WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY,
|
||||||
|
OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING
|
||||||
|
THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE RESEARCH MATERIALS AND ASSUME
|
||||||
|
ANY RISKS ASSOCIATED WITH YOUR USE OF THE RESEARCH MATERIALS AND ANY OUTPUT AND
|
||||||
|
RESULTS.\n \n4. Limitation of Liability. IN NO EVENT WILL META OR ITS AFFILIATES
|
||||||
|
BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE,
|
||||||
|
PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR ANY LOST PROFITS
|
||||||
|
OR ANY DIRECT OR INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE
|
||||||
|
DAMAGES, EVEN IF META OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF
|
||||||
|
ANY OF THE FOREGOING.\n \n5. Intellectual Property.\n\n\na. Subject to Meta’s ownership
|
||||||
|
of Research Materials and derivatives made by or for Meta, with respect to any derivative
|
||||||
|
works and modifications of the Research Materials that are made by you, as between
|
||||||
|
you and Meta, you are and will be the owner of such derivative works and modifications.\n
|
||||||
|
\nb. If you institute litigation or other proceedings against Meta or any entity
|
||||||
|
(including a cross-claim or counterclaim in a lawsuit) alleging that the Research
|
||||||
|
Materials, outputs or results, or any portion of any of the foregoing, constitutes
|
||||||
|
infringement of intellectual property or other rights owned or licensable by you,
|
||||||
|
then any licenses granted to you under this Agreement shall terminate as of the
|
||||||
|
date such litigation or claim is filed or instituted. You will indemnify and hold
|
||||||
|
harmless Meta from and against any claim by any third party arising out of or related
|
||||||
|
to your use or distribution of the Research Materials.\n \n6. Term and Termination.
|
||||||
|
The term of this Agreement will commence upon your acceptance of this Agreement
|
||||||
|
or access to the Research Materials and will continue in full force and effect until
|
||||||
|
terminated in accordance with the terms and conditions herein. Meta may terminate
|
||||||
|
this Agreement if you are in breach of any term or condition of this Agreement.
|
||||||
|
Upon termination of this Agreement, you shall delete and cease use of the Research
|
||||||
|
Materials. Sections 5, 6 and 9 shall survive the termination of this Agreement.
|
||||||
|
\n \n7. Governing Law and Jurisdiction. This Agreement will be governed and construed
|
||||||
|
under the laws of the State of California without regard to choice of law principles,
|
||||||
|
and the UN Convention on Contracts for the International Sale of Goods does not
|
||||||
|
apply to this Agreement. The courts of California shall have exclusive jurisdiction
|
||||||
|
of any dispute arising out of this Agreement. \n\n\n8. Modifications and Amendments.
|
||||||
|
Meta may modify this Agreement from time to time by posting a revised version at
|
||||||
|
[https://huggingface.co/facebook/Perception-LM-8B/blob/main/LICENSE]; provided that
|
||||||
|
they are similar in spirit to the current version of the Agreement, but may differ
|
||||||
|
in detail to address new problems or concerns. All such changes will be effective
|
||||||
|
immediately. Your continued use of the Research Materials after any modification
|
||||||
|
to this Agreement constitutes your agreement to such modification. Except as provided
|
||||||
|
in this Agreement, no modification or addition to any provision of this Agreement
|
||||||
|
will be binding unless it is in writing and signed by an authorized representative
|
||||||
|
of both you and Meta.\n\n\nFAIR Acceptable Use Policy \n\nThe Fundamental AI Research
|
||||||
|
(FAIR) team at Meta seeks to further understanding of new and existing research
|
||||||
|
domains with the mission of advancing the state-of-the-art in artificial intelligence
|
||||||
|
through open research for the benefit of all. \n\nAs part of this mission, Meta
|
||||||
|
makes certain research materials available for noncommercial research use. Meta
|
||||||
|
is committed to promoting the safe and responsible use of such research materials.
|
||||||
|
\ \n\nProhibited Uses\n\nYou agree you will not use, or allow others to use, Research
|
||||||
|
Materials to:\n\n Violate the law or others’ rights, including to:\nEngage in, promote,
|
||||||
|
generate, contribute to, encourage, plan, incite, or further illegal or unlawful
|
||||||
|
activity or content, such as:\nViolence or terrorism\nExploitation or harm to children,
|
||||||
|
including the solicitation, creation, acquisition, or dissemination of child exploitative
|
||||||
|
content or failure to report Child Sexual Abuse Material\nHuman trafficking, exploitation,
|
||||||
|
and sexual violence\nThe illegal distribution of information or materials to minors,
|
||||||
|
including obscene materials, or failure to employ legally required age-gating in
|
||||||
|
connection with such information or materials.\nSexual solicitation\nAny other criminal
|
||||||
|
activity\n\nEngage in, promote, incite, or facilitate the harassment, abuse, threatening,
|
||||||
|
or bullying of individuals or groups of individuals\n\nEngage in, promote, incite,
|
||||||
|
or facilitate discrimination or other unlawful or harmful conduct in the provision
|
||||||
|
of employment, employment benefits, credit, housing, other economic benefits, or
|
||||||
|
other essential goods and services\n\nEngage in the unauthorized or unlicensed practice
|
||||||
|
of any profession including, but not limited to, financial, legal, medical/health,
|
||||||
|
or related professional practices\n\nCollect, process, disclose, generate, or infer
|
||||||
|
health, demographic, or other sensitive personal or private information about individuals
|
||||||
|
without rights and consents required by applicable laws\n\nEngage in or facilitate
|
||||||
|
any action or generate any content that infringes, misappropriates, or otherwise
|
||||||
|
violates any third-party rights, including the outputs or results of any technology
|
||||||
|
using FAIR research materials\n\nCreate, generate, or facilitate the creation of
|
||||||
|
malicious code, malware, computer viruses or do anything else that could disable,
|
||||||
|
overburden, interfere with or impair the proper working, integrity, operation or
|
||||||
|
appearance of a website or computer system\n\n2. Engage in, promote, incite, facilitate,
|
||||||
|
or assist in the planning or development of activities that present a risk of death
|
||||||
|
or bodily harm to individuals, including use of research artifacts related to the
|
||||||
|
following:\n\nMilitary, warfare, nuclear industries or applications, espionage,
|
||||||
|
use for materials or activities that are subject to the International Traffic Arms
|
||||||
|
Regulations (ITAR) maintained by the United States Department of State\n\nGuns and
|
||||||
|
illegal weapons (including weapon development)\n\nIllegal drugs and regulated/controlled
|
||||||
|
substances\n\nOperation of critical infrastructure, transportation technologies,
|
||||||
|
or heavy machinery\n\nSelf-harm or harm to others, including suicide, cutting, and
|
||||||
|
eating disorders\n\nAny content intended to incite or promote violence, abuse, or
|
||||||
|
any infliction of bodily harm to an individual\n\n3. Intentionally deceive or mislead
|
||||||
|
others, including use of FAIR Research Materials related to the following:\n\n Generating,
|
||||||
|
promoting, or furthering fraud or the creation or promotion of disinformation\n\n
|
||||||
|
Generating, promoting, or furthering defamatory content, including the creation
|
||||||
|
of defamatory statements, images, or other content\n\nGenerating, promoting, or
|
||||||
|
further distributing spam\n\n Impersonating another individual without consent,
|
||||||
|
authorization, or legal right\n\nRepresenting that outputs of FAIR research materials
|
||||||
|
or outputs from technology using FAIR research materials are human-generated\n\nGenerating
|
||||||
|
or facilitating false online engagement, including fake reviews and other means
|
||||||
|
of fake online engagement\n\n4. Fail to appropriately disclose to end users any
|
||||||
|
known dangers of your Research Materials.\n\nPlease report any violation of this
|
||||||
|
Policy or other problems that could lead to a violation of this Policy by submitting
|
||||||
|
a report here [https://docs.google.com/forms/d/e/1FAIpQLSeb11cryAopJ7LNrC4nxEUXrHY26hfkXQMf_uH-oFgA3WlYZQ/viewform].
|
||||||
|
\n"
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
library_name: transformers
|
||||||
|
license: other
|
||||||
|
license_name: fair-noncommercial-research
|
||||||
|
quantized_by: mradermacher
|
||||||
|
tags:
|
||||||
|
- facebook
|
||||||
|
- meta
|
||||||
|
- pytorch
|
||||||
|
- mobilellm
|
||||||
|
---
|
||||||
|
## About
|
||||||
|
|
||||||
|
<!-- ### quantize_version: 2 -->
|
||||||
|
<!-- ### output_tensor_quantised: 1 -->
|
||||||
|
<!-- ### convert_type: hf -->
|
||||||
|
<!-- ### vocab_type: -->
|
||||||
|
<!-- ### tags: -->
|
||||||
|
static quants of https://huggingface.co/facebook/MobileLLM-1.5B
|
||||||
|
|
||||||
|
<!-- provided-files -->
|
||||||
|
weighted/imatrix quants are available at https://huggingface.co/mradermacher/MobileLLM-1.5B-i1-GGUF
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||||
|
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||||
|
more details, including on how to concatenate multi-part files.
|
||||||
|
|
||||||
|
## Provided Quants
|
||||||
|
|
||||||
|
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||||
|
|
||||||
|
| Link | Type | Size/GB | Notes |
|
||||||
|
|:-----|:-----|--------:|:------|
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q3_K_S.gguf) | Q3_K_S | 1.0 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q2_K.gguf) | Q2_K | 1.0 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.IQ4_XS.gguf) | IQ4_XS | 1.0 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q3_K_M.gguf) | Q3_K_M | 1.0 | lower quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q3_K_L.gguf) | Q3_K_L | 1.1 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q4_K_S.gguf) | Q4_K_S | 1.2 | fast, recommended |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q4_K_M.gguf) | Q4_K_M | 1.2 | fast, recommended |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q5_K_S.gguf) | Q5_K_S | 1.3 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q5_K_M.gguf) | Q5_K_M | 1.3 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q6_K.gguf) | Q6_K | 1.7 | very good quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q8_0.gguf) | Q8_0 | 1.8 | fast, best quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.f16.gguf) | f16 | 3.2 | 16 bpw, overkill |
|
||||||
|
|
||||||
|
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||||
|
types (lower is better):
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
And here are Artefact2's thoughts on the matter:
|
||||||
|
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||||
|
|
||||||
|
## FAQ / Model Request
|
||||||
|
|
||||||
|
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||||
|
questions you might have and/or if you want some other model quantized.
|
||||||
|
|
||||||
|
## Thanks
|
||||||
|
|
||||||
|
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||||
|
me use its servers and providing upgrades to my workstation to enable
|
||||||
|
this work in my free time.
|
||||||
|
|
||||||
|
<!-- end -->
|
||||||
Reference in New Issue
Block a user